2024-09-13T18:35:33.341 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T18:35:33.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:35:33.460 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004 branch: wip-rishabh-testing-20240910.100730-reef description: fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} email: null first_in_suite: false job_id: '7904004' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client acl type: posix_acl client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEeSfjCy9eD+cDuevsRD3GEdPHnMK9vzvVo+92YxG2h37qSVbhUnWG2XGORDoTnjBorXRiFCzoLjHr8nsENX3eA= smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC4M4kjidzZ9dqO8rYomYwqUjNiw1vW6G04Ak2DgQbh/WA7e3kGKjjnlwbi1n9h2SjVhDeaLmzitWh3WsE6Gg+w= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - fs/misc/acl.sh - fs/misc/chmod.sh - fs/misc/dac_override.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T18:35:33.460 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T18:35:33.461 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T18:35:33.461 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T18:35:33.463 INFO:teuthology.task.internal:Checking packages... 2024-09-13T18:35:33.484 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T18:35:33.485 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:35:33.485 INFO:teuthology.packaging:ref: None 2024-09-13T18:35:33.485 INFO:teuthology.packaging:tag: None 2024-09-13T18:35:33.485 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:35:33.485 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:35:33.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:35:33.643 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860.g6c6b083f 2024-09-13T18:35:33.644 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T18:35:33.650 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T18:35:33.650 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T18:35:33.741 INFO:teuthology.task.internal:Saving configuration 2024-09-13T18:35:33.757 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T18:35:33.772 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T18:35:33.805 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:30:18.035724', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEeSfjCy9eD+cDuevsRD3GEdPHnMK9vzvVo+92YxG2h37qSVbhUnWG2XGORDoTnjBorXRiFCzoLjHr8nsENX3eA='} 2024-09-13T18:35:33.838 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:30:18.034184', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC4M4kjidzZ9dqO8rYomYwqUjNiw1vW6G04Ak2DgQbh/WA7e3kGKjjnlwbi1n9h2SjVhDeaLmzitWh3WsE6Gg+w='} 2024-09-13T18:35:33.838 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T18:35:33.911 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-13T18:35:33.911 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-13T18:35:33.911 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T18:35:34.086 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6f59b8bbe0>, signals=[15]) 2024-09-13T18:35:34.086 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T18:35:34.109 INFO:teuthology.task.internal:Opening connections... 2024-09-13T18:35:34.109 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:35:34.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:35:34.197 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-09-13T18:35:34.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:35:34.279 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T18:35:34.284 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-09-13T18:35:34.303 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-09-13T18:35:34.303 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-09-13T18:35:34.360 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-09-13T18:35:34.361 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-09-13T18:35:34.361 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-09-13T18:35:34.361 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-09-13T18:35:34.361 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-09-13T18:35:34.361 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-09-13T18:35:34.361 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T18:35:34.361 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-09-13T18:35:34.361 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-09-13T18:35:34.361 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T18:35:34.361 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-09-13T18:35:34.361 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T18:35:34.361 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T18:35:34.362 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T18:35:34.362 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-09-13T18:35:34.396 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-09-13T18:35:34.415 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-09-13T18:35:34.415 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-09-13T18:35:34.473 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2024-09-13T18:35:34.473 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="9" 2024-09-13T18:35:34.473 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2024-09-13T18:35:34.473 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2024-09-13T18:35:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="9" 2024-09-13T18:35:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el9" 2024-09-13T18:35:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T18:35:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2024-09-13T18:35:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:LOGO="fedora-logo-icon" 2024-09-13T18:35:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T18:35:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2024-09-13T18:35:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T18:35:34.474 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T18:35:34.475 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T18:35:34.475 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-09-13T18:35:34.504 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T18:35:34.513 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T18:35:34.612 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T18:35:34.613 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:35:34.615 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:35:34.632 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T18:35:34.667 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T18:35:34.667 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:35:34.672 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:35:34.827 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T18:35:34.895 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T18:35:34.908 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T18:35:34.908 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T18:35:34.908 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:35:34.909 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:35:34.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:35:34.926 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-09-13T18:35:34.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:35:34.927 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-09-13T18:35:34.984 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-503.el9.x86_64 2024-09-13T18:35:34.985 INFO:teuthology.task.kernel:Running kernel on smithi029: 5.14.0-503.el9.x86_64 2024-09-13T18:35:34.985 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2024-09-13T18:35:34.986 INFO:teuthology.orchestra.run.smithi096.stdout:5.14.0-503.el9.x86_64 2024-09-13T18:35:34.986 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.14.0-503.el9.x86_64 2024-09-13T18:35:34.986 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum install -y kernel 2024-09-13T18:35:37.819 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.2 MB 00:01 2024-09-13T18:35:38.483 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-13T18:35:39.486 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-13T18:35:41.894 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 20 MB 00:02 2024-09-13T18:35:43.962 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-13T18:35:45.729 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 19 kB 00:00 2024-09-13T18:35:46.574 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-13T18:35:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-13T18:35:49.307 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-13T18:35:50.338 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-13T18:35:51.989 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T18:35:53.986 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T18:35:53.986 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T18:35:54.067 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-09-13T18:35:54.078 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-09-13T18:35:54.078 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2024-09-13T18:35:54.079 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-09-13T18:35:54.079 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-09-13T18:35:54.079 INFO:teuthology.orchestra.run.smithi096.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T18:35:54.079 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-09-13T18:35:54.079 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T18:35:54.080 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T18:35:54.080 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T18:35:54.080 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:35:54.080 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-09-13T18:35:54.080 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-09-13T18:35:54.081 INFO:teuthology.orchestra.run.smithi096.stdout:Install 4 Packages 2024-09-13T18:35:54.081 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:35:54.081 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 79 M 2024-09-13T18:35:54.081 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 126 M 2024-09-13T18:35:54.081 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-09-13T18:35:54.206 INFO:teuthology.orchestra.run.smithi096.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 213 kB/s | 23 kB 00:00 2024-09-13T18:35:54.756 INFO:teuthology.orchestra.run.smithi096.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 52 MB/s | 29 MB 00:00 2024-09-13T18:35:54.915 INFO:teuthology.orchestra.run.smithi096.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-13T18:35:55.332 INFO:teuthology.orchestra.run.smithi096.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-13T18:35:55.332 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:35:55.332 INFO:teuthology.orchestra.run.smithi096.stdout:Total 63 MB/s | 79 MB 00:01 2024-09-13T18:35:56.003 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T18:35:56.018 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-09-13T18:35:56.368 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-09-13T18:35:56.368 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-09-13T18:35:57.326 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-09-13T18:35:57.326 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-09-13T18:35:58.120 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T18:35:58.121 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T18:35:58.228 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-13T18:35:58.244 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-13T18:35:58.244 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2024-09-13T18:35:58.244 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-13T18:35:58.244 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-13T18:35:58.244 INFO:teuthology.orchestra.run.smithi029.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T18:35:58.244 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-13T18:35:58.245 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T18:35:58.245 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T18:35:58.245 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T18:35:58.245 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:35:58.245 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-13T18:35:58.245 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-13T18:35:58.245 INFO:teuthology.orchestra.run.smithi029.stdout:Install 4 Packages 2024-09-13T18:35:58.245 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:35:58.246 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 79 M 2024-09-13T18:35:58.246 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 126 M 2024-09-13T18:35:58.246 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-13T18:35:58.459 INFO:teuthology.orchestra.run.smithi029.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 256 kB/s | 23 kB 00:00 2024-09-13T18:35:59.066 INFO:teuthology.orchestra.run.smithi029.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi029.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-09-13T18:36:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:36:00.475 INFO:teuthology.orchestra.run.smithi029.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 14 MB/s | 29 MB 00:02 2024-09-13T18:36:00.475 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:36:00.475 INFO:teuthology.orchestra.run.smithi029.stdout:Total 35 MB/s | 79 MB 00:02 2024-09-13T18:36:00.500 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:36:01.189 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-13T18:36:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-13T18:36:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-13T18:36:02.582 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-13T18:36:02.583 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-13T18:36:03.293 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:36:03.426 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:36:05.153 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-13T18:36:05.882 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:36:05.981 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:36:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:36:08.309 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:36:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:36:08.991 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:36:13.150 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:36:14.122 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:36:14.173 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:36:19.313 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:36:51.680 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:36:51.720 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:36:52.089 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:36:52.089 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:36:52.089 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:36:52.089 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:36:52.978 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:36:52.978 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:36:52.978 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-09-13T18:36:52.978 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T18:36:52.978 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T18:36:52.978 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T18:36:52.978 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T18:36:52.978 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:36:52.978 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-09-13T18:36:53.336 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:36:53.418 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:36:53.418 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:36:53.418 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T18:36:53.419 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:36:53.419 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:36:53.420 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T18:36:53.420 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:36:53.420 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:36:53.479 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:36:53.479 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:36:53.479 DEBUG:teuthology.orchestra.run.smithi096:> sudo rpm -qi grub2-tools 2024-09-13T18:36:53.512 INFO:teuthology.orchestra.run.smithi096.stdout:Name : grub2-tools 2024-09-13T18:36:53.512 INFO:teuthology.orchestra.run.smithi096.stdout:Epoch : 1 2024-09-13T18:36:53.512 INFO:teuthology.orchestra.run.smithi096.stdout:Version : 2.06 2024-09-13T18:36:53.512 INFO:teuthology.orchestra.run.smithi096.stdout:Release : 82.el9 2024-09-13T18:36:53.512 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: x86_64 2024-09-13T18:36:53.512 INFO:teuthology.orchestra.run.smithi096.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T18:36:53.512 INFO:teuthology.orchestra.run.smithi096.stdout:Group : Unspecified 2024-09-13T18:36:53.512 INFO:teuthology.orchestra.run.smithi096.stdout:Size : 8274670 2024-09-13T18:36:53.513 INFO:teuthology.orchestra.run.smithi096.stdout:License : GPLv3+ 2024-09-13T18:36:53.513 INFO:teuthology.orchestra.run.smithi096.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T18:36:53.513 INFO:teuthology.orchestra.run.smithi096.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T18:36:53.513 INFO:teuthology.orchestra.run.smithi096.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T18:36:53.513 INFO:teuthology.orchestra.run.smithi096.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T18:36:53.513 INFO:teuthology.orchestra.run.smithi096.stdout:Packager : builder@centos.org 2024-09-13T18:36:53.513 INFO:teuthology.orchestra.run.smithi096.stdout:Vendor : CentOS 2024-09-13T18:36:53.514 INFO:teuthology.orchestra.run.smithi096.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T18:36:53.514 INFO:teuthology.orchestra.run.smithi096.stdout:Summary : Support tools for GRUB. 2024-09-13T18:36:53.514 INFO:teuthology.orchestra.run.smithi096.stdout:Description : 2024-09-13T18:36:53.514 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:36:53.514 INFO:teuthology.orchestra.run.smithi096.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T18:36:53.514 INFO:teuthology.orchestra.run.smithi096.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T18:36:53.514 INFO:teuthology.orchestra.run.smithi096.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T18:36:53.514 INFO:teuthology.orchestra.run.smithi096.stdout:hardware devices. 2024-09-13T18:36:53.514 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:36:53.514 INFO:teuthology.orchestra.run.smithi096.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T18:36:53.515 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T18:36:53.515 INFO:teuthology.task.kernel:Updating grub on smithi096 to boot 5.14.0-505.el9.x86_64 2024-09-13T18:36:53.515 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T18:36:54.174 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-09-13T18:36:55.558 INFO:teuthology.orchestra.run.smithi096.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T18:36:55.607 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-09-13T18:36:55.609 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-09-13T18:36:55.624 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.2Jh7ySqBVO 2024-09-13T18:36:55.625 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2Jh7ySqBVO 2024-09-13T18:36:55.704 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.2Jh7ySqBVO 2024-09-13T18:36:55.843 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.2Jh7ySqBVO is 6KB 2024-09-13T18:36:55.893 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.2Jh7ySqBVO 2024-09-13T18:36:55.908 DEBUG:teuthology.orchestra.run.smithi096:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T18:36:55.971 INFO:teuthology.orchestra.run.smithi096.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T18:36:55.971 INFO:teuthology.orchestra.run.smithi096.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T18:36:55.971 INFO:teuthology.orchestra.run.smithi096.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T18:36:55.971 INFO:teuthology.orchestra.run.smithi096.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T18:36:55.972 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T18:36:56.106 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-09-13T18:37:00.216 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:37:00.257 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:37:00.604 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:37:00.604 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:37:00.604 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:37:00.604 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:37:01.666 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:37:01.666 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:37:01.666 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-13T18:37:01.667 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T18:37:01.667 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T18:37:01.667 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T18:37:01.667 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T18:37:01.667 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:37:01.667 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-13T18:37:02.116 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:37:02.224 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:37:02.225 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:37:02.225 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T18:37:02.225 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:37:02.225 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:37:02.225 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T18:37:02.225 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:37:02.225 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:37:02.285 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:37:02.286 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:37:02.286 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2024-09-13T18:37:02.317 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2024-09-13T18:37:02.317 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2024-09-13T18:37:02.317 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.06 2024-09-13T18:37:02.317 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 82.el9 2024-09-13T18:37:02.318 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2024-09-13T18:37:02.318 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T18:37:02.318 INFO:teuthology.orchestra.run.smithi029.stdout:Group : Unspecified 2024-09-13T18:37:02.318 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 8274670 2024-09-13T18:37:02.318 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2024-09-13T18:37:02.319 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T18:37:02.319 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T18:37:02.319 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T18:37:02.319 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T18:37:02.320 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : builder@centos.org 2024-09-13T18:37:02.320 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : CentOS 2024-09-13T18:37:02.320 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T18:37:02.320 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2024-09-13T18:37:02.320 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2024-09-13T18:37:02.321 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:37:02.321 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T18:37:02.321 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T18:37:02.321 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T18:37:02.321 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2024-09-13T18:37:02.322 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:37:02.322 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T18:37:02.323 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T18:37:02.323 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 5.14.0-505.el9.x86_64 2024-09-13T18:37:02.323 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T18:37:03.111 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-09-13T18:37:04.688 INFO:teuthology.orchestra.run.smithi029.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T18:37:04.733 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-09-13T18:37:04.735 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-09-13T18:37:04.758 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.yWWzyc48dg 2024-09-13T18:37:04.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yWWzyc48dg 2024-09-13T18:37:04.824 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.yWWzyc48dg 2024-09-13T18:37:04.969 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.yWWzyc48dg is 6KB 2024-09-13T18:37:05.018 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.yWWzyc48dg 2024-09-13T18:37:05.032 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T18:37:05.106 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T18:37:05.106 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T18:37:05.106 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T18:37:05.106 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T18:37:05.106 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T18:37:05.264 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2024-09-13T18:37:26.128 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T18:37:26.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-13T18:37:26.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:37:35.273 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T18:37:35.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-13T18:37:35.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:38:00.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-13T18:38:09.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-13T18:38:09.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:38:28.161 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-13T18:38:35.291 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T18:38:40.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-13T18:38:40.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:38:40.653 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-09-13T18:38:41.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-13T18:38:41.025 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T18:38:41.025 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-09-13T18:38:41.039 INFO:teuthology.orchestra.run.smithi096.stdout:5.14.0-505.el9.x86_64 2024-09-13T18:38:41.039 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T18:38:41.040 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:38:41.040 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T18:38:42.040 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T18:38:42.040 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:38:42.136 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2024-09-13T18:38:42.155 DEBUG:teuthology.parallel:result is None 2024-09-13T18:38:44.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-13T18:38:44.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:38:51.863 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-09-13T18:38:52.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-13T18:38:52.296 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T18:38:52.296 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-09-13T18:38:52.311 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-505.el9.x86_64 2024-09-13T18:38:52.311 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T18:38:52.311 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:38:52.312 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T18:38:53.313 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T18:38:53.313 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:38:53.531 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2024-09-13T18:38:53.551 DEBUG:teuthology.parallel:result is None 2024-09-13T18:38:53.552 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T18:38:53.561 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T18:38:53.561 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:38:53.563 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:38:53.582 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T18:38:53.622 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T18:38:53.682 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T18:38:53.682 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:38:53.684 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:38:53.789 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T18:38:53.802 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T18:38:53.802 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:38:53.805 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:38:53.835 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:38:53.846 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:38:53.874 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:38:53.885 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:38:53.887 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T18:38:53.894 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T18:38:53.894 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:38:53.896 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:38:53.924 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T18:38:53.935 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T18:38:53.935 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:38:53.960 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:38:53.981 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:38:54.063 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:38:54.103 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:38:54.190 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:38:54.221 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:38:54.221 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:38:54.283 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:38:54.335 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:38:54.384 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:38:54.480 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:38:54.511 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:38:54.511 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:38:54.578 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-09-13T18:38:54.580 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-09-13T18:38:54.627 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:38:54.680 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:38:55.176 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T18:38:55.185 INFO:teuthology.task.internal:Starting timer... 2024-09-13T18:38:55.185 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T18:38:55.249 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T18:38:55.415 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-13T18:38:55.415 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2024-09-13T18:38:55.515 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: 2024-09-13T18:38:55.517 DEBUG:teuthology.orchestra.run.smithi096:> sudo service auditd rotate 2024-09-13T18:38:55.571 INFO:teuthology.orchestra.run.smithi096.stdout:Rotating logs: 2024-09-13T18:38:55.572 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T18:38:55.573 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2024-09-13T18:38:55.602 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2024-09-13T18:38:55.603 DEBUG:teuthology.orchestra.run.smithi096:> /usr/sbin/getenforce 2024-09-13T18:38:55.659 INFO:teuthology.orchestra.run.smithi096.stdout:Permissive 2024-09-13T18:38:55.660 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi096.front.sepia.ceph.com': 'permissive'} 2024-09-13T18:38:55.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:38:55.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:38:55.687 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:38:55.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:38:55.714 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T18:38:55.715 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2024-09-13T18:38:55.775 DEBUG:teuthology.orchestra.run.smithi096:> sudo /usr/sbin/setenforce permissive 2024-09-13T18:38:55.814 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T18:38:55.823 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T18:38:55.826 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T18:38:55.940 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T18:38:55.950 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T18:38:55.951 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi096.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T18:42:50.366 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi096.front.sepia.ceph.com')] 2024-09-13T18:42:50.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-13T18:42:50.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:42:50.464 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-09-13T18:42:50.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-13T18:42:50.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-13T18:42:50.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:42:50.653 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-09-13T18:42:50.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-13T18:42:50.738 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T18:42:50.750 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T18:42:50.750 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:42:50.750 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:42:50.755 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:42:50.806 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:42:50.811 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:42:50.827 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2024-09-13T18:42:50.846 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2024-09-13T18:42:50.853 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: ntpd: command not found 2024-09-13T18:42:50.861 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:42:50.864 INFO:teuthology.orchestra.run.smithi096.stdout:506 Cannot talk to daemon 2024-09-13T18:42:50.877 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:42:50.879 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:42:50.894 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:42:50.935 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:42:50.938 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:42:50.938 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-09-13T18:42:50.938 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:42:50.938 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:42:50.938 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:42:50.938 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:42:50.962 INFO:teuthology.orchestra.run.smithi096.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:42:50.966 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:42:50.967 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2024-09-13T18:42:50.967 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:42:50.967 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:42:50.967 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:42:50.967 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:42:50.968 INFO:teuthology.run_tasks:Running task install... 2024-09-13T18:42:50.975 DEBUG:teuthology.task.install:project ceph 2024-09-13T18:42:50.976 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:42:50.976 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:42:50.976 INFO:teuthology.task.install:Using flavor: default 2024-09-13T18:42:50.981 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:42:50.982 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T18:42:50.982 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:42:50.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:42:50.984 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:42:50.985 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:42:51.141 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T18:42:51.141 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T18:42:51.154 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T18:42:51.154 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T18:42:51.261 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:42:51.262 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:42:51.262 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:42:51.271 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:42:51.272 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:42:51.272 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:42:51.290 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T18:42:51.291 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:42:51.298 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T18:42:51.298 DEBUG:teuthology.orchestra.run.smithi096:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:42:51.359 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:42:51.363 DEBUG:teuthology.orchestra.run.smithi096:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:42:51.438 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:42:51.440 DEBUG:teuthology.orchestra.run.smithi096:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:42:51.505 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2024-09-13T18:42:51.505 INFO:teuthology.orchestra.run.smithi096.stdout:check_obsoletes = 1 2024-09-13T18:42:51.507 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2024-09-13T18:42:51.507 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum clean all 2024-09-13T18:42:51.731 INFO:teuthology.orchestra.run.smithi096.stdout:45 files removed 2024-09-13T18:42:51.741 INFO:teuthology.orchestra.run.smithi029.stdout:45 files removed 2024-09-13T18:42:51.758 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T18:42:51.769 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T18:42:52.308 INFO:teuthology.orchestra.run.smithi096.stdout:ceph packages for x86_64 292 kB/s | 78 kB 00:00 2024-09-13T18:42:52.346 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 281 kB/s | 78 kB 00:00 2024-09-13T18:42:52.576 INFO:teuthology.orchestra.run.smithi096.stdout:ceph noarch packages 51 kB/s | 11 kB 00:00 2024-09-13T18:42:52.638 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-13T18:42:52.835 INFO:teuthology.orchestra.run.smithi096.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-13T18:42:52.923 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-09-13T18:42:53.434 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-13T18:42:54.751 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-13T18:42:55.504 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-13T18:42:57.044 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-13T18:43:00.739 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.5 MB 00:01 2024-09-13T18:43:02.293 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-13T18:43:02.569 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-13T18:43:03.440 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-13T18:43:03.995 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - Extras packages 97 kB/s | 19 kB 00:00 2024-09-13T18:43:05.050 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-13T18:43:09.105 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-13T18:43:10.505 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-13T18:43:11.644 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:43:11.645 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:43:11.657 INFO:teuthology.orchestra.run.smithi029.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:43:11.657 INFO:teuthology.orchestra.run.smithi029.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:43:11.658 INFO:teuthology.orchestra.run.smithi029.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:43:11.659 INFO:teuthology.orchestra.run.smithi029.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T18:43:11.661 INFO:teuthology.orchestra.run.smithi029.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T18:43:11.664 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T18:43:11.665 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T18:43:11.731 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-13T18:43:11.753 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================== 2024-09-13T18:43:11.753 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-13T18:43:11.754 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================== 2024-09-13T18:43:11.754 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-13T18:43:11.754 INFO:teuthology.orchestra.run.smithi029.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:43:11.754 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T18:43:11.754 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T18:43:11.754 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T18:43:11.754 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T18:43:11.754 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T18:43:11.754 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T18:43:11.754 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T18:43:11.754 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T18:43:11.754 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T18:43:11.755 INFO:teuthology.orchestra.run.smithi029.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T18:43:11.756 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T18:43:11.756 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:43:11.756 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T18:43:11.756 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T18:43:11.756 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T18:43:11.756 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T18:43:11.756 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T18:43:11.756 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T18:43:11.756 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T18:43:11.756 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T18:43:11.756 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:43:11.756 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:43:11.757 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:43:11.759 INFO:teuthology.orchestra.run.smithi029.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:43:11.760 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:43:11.761 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:43:11.761 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:43:11.761 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:43:11.761 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:43:11.761 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:43:11.761 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:43:11.761 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:43:11.761 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:43:11.761 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:43:11.761 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:43:11.761 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:43:11.761 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:43:11.762 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:43:11.763 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:43:11.764 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:43:11.765 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-13T18:43:11.765 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================== 2024-09-13T18:43:11.765 INFO:teuthology.orchestra.run.smithi029.stdout:Install 130 Packages 2024-09-13T18:43:11.765 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 8 Packages 2024-09-13T18:43:11.765 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:43:11.765 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 203 M 2024-09-13T18:43:11.765 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-13T18:43:12.318 INFO:teuthology.orchestra.run.smithi029.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 55 kB/s | 6.5 kB 00:00 2024-09-13T18:43:12.520 INFO:teuthology.orchestra.run.smithi029.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 4.2 MB/s | 852 kB 00:00 2024-09-13T18:43:12.569 INFO:teuthology.orchestra.run.smithi029.stdout:(3/138): ceph-immutable-object-cache-18.2.4-860 2.8 MB/s | 142 kB 00:00 2024-09-13T18:43:12.778 INFO:teuthology.orchestra.run.smithi029.stdout:(4/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 10 MB/s | 2.1 MB 00:00 2024-09-13T18:43:12.849 INFO:teuthology.orchestra.run.smithi096.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:43:12.850 INFO:teuthology.orchestra.run.smithi096.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:43:12.861 INFO:teuthology.orchestra.run.smithi096.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:43:12.861 INFO:teuthology.orchestra.run.smithi096.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:43:12.862 INFO:teuthology.orchestra.run.smithi096.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:43:12.863 INFO:teuthology.orchestra.run.smithi096.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T18:43:12.865 INFO:teuthology.orchestra.run.smithi096.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T18:43:12.867 INFO:teuthology.orchestra.run.smithi096.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T18:43:12.868 INFO:teuthology.orchestra.run.smithi096.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T18:43:12.887 INFO:teuthology.orchestra.run.smithi029.stdout:(5/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 7.4 MB/s | 5.1 MB 00:00 2024-09-13T18:43:12.929 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-09-13T18:43:12.950 INFO:teuthology.orchestra.run.smithi096.stdout:====================================================================================== 2024-09-13T18:43:12.950 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2024-09-13T18:43:12.950 INFO:teuthology.orchestra.run.smithi096.stdout:====================================================================================== 2024-09-13T18:43:12.950 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-09-13T18:43:12.951 INFO:teuthology.orchestra.run.smithi096.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:43:12.951 INFO:teuthology.orchestra.run.smithi096.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T18:43:12.951 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T18:43:12.951 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T18:43:12.951 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T18:43:12.951 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T18:43:12.951 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T18:43:12.951 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T18:43:12.951 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T18:43:12.951 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T18:43:12.952 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T18:43:12.952 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T18:43:12.952 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T18:43:12.952 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T18:43:12.952 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T18:43:12.952 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T18:43:12.952 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:43:12.952 INFO:teuthology.orchestra.run.smithi096.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:43:12.953 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T18:43:12.953 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T18:43:12.953 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T18:43:12.953 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T18:43:12.953 INFO:teuthology.orchestra.run.smithi096.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T18:43:12.953 INFO:teuthology.orchestra.run.smithi096.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T18:43:12.953 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:43:12.953 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T18:43:12.954 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T18:43:12.954 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T18:43:12.954 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T18:43:12.954 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T18:43:12.954 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T18:43:12.955 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T18:43:12.955 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T18:43:12.955 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:43:12.955 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T18:43:12.955 INFO:teuthology.orchestra.run.smithi096.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T18:43:12.955 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrading: 2024-09-13T18:43:12.955 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:43:12.956 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:43:12.956 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:43:12.956 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:43:12.956 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T18:43:12.956 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:43:12.956 INFO:teuthology.orchestra.run.smithi096.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:43:12.956 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:43:12.957 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-09-13T18:43:12.957 INFO:teuthology.orchestra.run.smithi096.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T18:43:12.957 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:43:12.957 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T18:43:12.957 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T18:43:12.957 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T18:43:12.957 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T18:43:12.957 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T18:43:12.957 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T18:43:12.957 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T18:43:12.957 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T18:43:12.957 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:43:12.958 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:43:12.959 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:43:12.960 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:43:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:43:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:43:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:43:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:43:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:43:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:43:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:43:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:43:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:43:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:43:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:43:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:43:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:43:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:43:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:43:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:43:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:43:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:43:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:43:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:43:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:43:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout:====================================================================================== 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout:Install 130 Packages 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrade 8 Packages 2024-09-13T18:43:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:43:12.965 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 203 M 2024-09-13T18:43:12.965 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-09-13T18:43:12.979 INFO:teuthology.orchestra.run.smithi029.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 7.3 MB/s | 1.5 MB 00:00 2024-09-13T18:43:13.279 INFO:teuthology.orchestra.run.smithi029.stdout:(7/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-13T18:43:13.448 INFO:teuthology.orchestra.run.smithi096.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 35 kB/s | 6.5 kB 00:00 2024-09-13T18:43:13.665 INFO:teuthology.orchestra.run.smithi096.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 3.8 MB/s | 852 kB 00:00 2024-09-13T18:43:13.715 INFO:teuthology.orchestra.run.smithi096.stdout:(3/138): ceph-immutable-object-cache-18.2.4-860 2.8 MB/s | 142 kB 00:00 2024-09-13T18:43:13.788 INFO:teuthology.orchestra.run.smithi029.stdout:(8/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 12 MB/s | 18 MB 00:01 2024-09-13T18:43:13.839 INFO:teuthology.orchestra.run.smithi029.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 503 kB/s | 25 kB 00:00 2024-09-13T18:43:13.982 INFO:teuthology.orchestra.run.smithi096.stdout:(4/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 7.9 MB/s | 2.1 MB 00:00 2024-09-13T18:43:14.006 INFO:teuthology.orchestra.run.smithi029.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 11 MB/s | 7.7 MB 00:00 2024-09-13T18:43:14.057 INFO:teuthology.orchestra.run.smithi096.stdout:(5/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 6.4 MB/s | 5.1 MB 00:00 2024-09-13T18:43:14.065 INFO:teuthology.orchestra.run.smithi029.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 3.8 MB/s | 224 kB 00:00 2024-09-13T18:43:14.191 INFO:teuthology.orchestra.run.smithi096.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 7.0 MB/s | 1.5 MB 00:00 2024-09-13T18:43:14.357 INFO:teuthology.orchestra.run.smithi029.stdout:(12/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 12 MB/s | 17 MB 00:01 2024-09-13T18:43:14.393 INFO:teuthology.orchestra.run.smithi029.stdout:(13/138): libcephfs-devel-18.2.4-860.g6c6b083f. 95 kB/s | 31 kB 00:00 2024-09-13T18:43:14.433 INFO:teuthology.orchestra.run.smithi096.stdout:(7/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-13T18:43:14.434 INFO:teuthology.orchestra.run.smithi029.stdout:(14/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 9.0 MB/s | 712 kB 00:00 2024-09-13T18:43:14.460 INFO:teuthology.orchestra.run.smithi029.stdout:(15/138): libcephsqlite-18.2.4-860.g6c6b083f.el 2.4 MB/s | 166 kB 00:00 2024-09-13T18:43:14.511 INFO:teuthology.orchestra.run.smithi029.stdout:(16/138): librados-devel-18.2.4-860.g6c6b083f.e 1.6 MB/s | 127 kB 00:00 2024-09-13T18:43:14.553 INFO:teuthology.orchestra.run.smithi029.stdout:(17/138): libradosstriper1-18.2.4-860.g6c6b083f 5.0 MB/s | 478 kB 00:00 2024-09-13T18:43:14.662 INFO:teuthology.orchestra.run.smithi029.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 414 kB/s | 45 kB 00:00 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi096.stdout:(8/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 10 MB/s | 18 MB 00:01 2024-09-13T18:43:15.037 INFO:teuthology.orchestra.run.smithi029.stdout:(19/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 8.5 MB/s | 4.5 MB 00:00 2024-09-13T18:43:15.071 INFO:teuthology.orchestra.run.smithi029.stdout:(20/138): python3-ceph-common-18.2.4-860.g6c6b0 316 kB/s | 129 kB 00:00 2024-09-13T18:43:15.091 INFO:teuthology.orchestra.run.smithi096.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 434 kB/s | 25 kB 00:00 2024-09-13T18:43:15.113 INFO:teuthology.orchestra.run.smithi029.stdout:(21/138): python3-cephfs-18.2.4-860.g6c6b083f.e 2.1 MB/s | 162 kB 00:00 2024-09-13T18:43:15.147 INFO:teuthology.orchestra.run.smithi029.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 4.1 MB/s | 321 kB 00:00 2024-09-13T18:43:15.192 INFO:teuthology.orchestra.run.smithi096.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 10 MB/s | 7.7 MB 00:00 2024-09-13T18:43:15.251 INFO:teuthology.orchestra.run.smithi096.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 3.8 MB/s | 224 kB 00:00 2024-09-13T18:43:15.256 INFO:teuthology.orchestra.run.smithi029.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 2.1 MB/s | 301 kB 00:00 2024-09-13T18:43:15.282 INFO:teuthology.orchestra.run.smithi029.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 740 kB/s | 99 kB 00:00 2024-09-13T18:43:15.309 INFO:teuthology.orchestra.run.smithi096.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 534 kB/s | 31 kB 00:00 2024-09-13T18:43:15.324 INFO:teuthology.orchestra.run.smithi029.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.3 MB/s | 87 kB 00:00 2024-09-13T18:43:15.408 INFO:teuthology.orchestra.run.smithi029.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 2.0 MB/s | 172 kB 00:00 2024-09-13T18:43:15.451 INFO:teuthology.orchestra.run.smithi096.stdout:(13/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 4.9 MB/s | 712 kB 00:00 2024-09-13T18:43:15.492 INFO:teuthology.orchestra.run.smithi029.stdout:(27/138): ceph-grafana-dashboards-18.2.4-860.g6 292 kB/s | 24 kB 00:00 2024-09-13T18:43:15.526 INFO:teuthology.orchestra.run.smithi096.stdout:(14/138): libcephsqlite-18.2.4-860.g6c6b083f.el 2.2 MB/s | 166 kB 00:00 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:(28/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 1.8 MB/s | 139 kB 00:00 2024-09-13T18:43:15.610 INFO:teuthology.orchestra.run.smithi096.stdout:(15/138): librados-devel-18.2.4-860.g6c6b083f.e 1.5 MB/s | 127 kB 00:00 2024-09-13T18:43:15.695 INFO:teuthology.orchestra.run.smithi029.stdout:(29/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 7.3 MB/s | 3.0 MB 00:00 2024-09-13T18:43:15.852 INFO:teuthology.orchestra.run.smithi096.stdout:(16/138): libradosstriper1-18.2.4-860.g6c6b083f 1.9 MB/s | 478 kB 00:00 2024-09-13T18:43:15.979 INFO:teuthology.orchestra.run.smithi029.stdout:(30/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 8.6 MB/s | 3.5 MB 00:00 2024-09-13T18:43:16.019 INFO:teuthology.orchestra.run.smithi096.stdout:(17/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 9.0 MB/s | 17 MB 00:01 2024-09-13T18:43:16.037 INFO:teuthology.orchestra.run.smithi029.stdout:(31/138): ceph-mgr-modules-core-18.2.4-860.g6c6 4.1 MB/s | 246 kB 00:00 2024-09-13T18:43:16.078 INFO:teuthology.orchestra.run.smithi096.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 776 kB/s | 45 kB 00:00 2024-09-13T18:43:16.121 INFO:teuthology.orchestra.run.smithi029.stdout:(32/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 591 kB/s | 49 kB 00:00 2024-09-13T18:43:16.144 INFO:teuthology.orchestra.run.smithi096.stdout:(19/138): python3-ceph-common-18.2.4-860.g6c6b0 1.9 MB/s | 129 kB 00:00 2024-09-13T18:43:16.195 INFO:teuthology.orchestra.run.smithi096.stdout:(20/138): python3-cephfs-18.2.4-860.g6c6b083f.e 3.2 MB/s | 162 kB 00:00 2024-09-13T18:43:16.254 INFO:teuthology.orchestra.run.smithi096.stdout:(21/138): python3-rados-18.2.4-860.g6c6b083f.el 5.4 MB/s | 321 kB 00:00 2024-09-13T18:43:16.320 INFO:teuthology.orchestra.run.smithi096.stdout:(22/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 9.5 MB/s | 4.5 MB 00:00 2024-09-13T18:43:16.346 INFO:teuthology.orchestra.run.smithi096.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 3.2 MB/s | 301 kB 00:00 2024-09-13T18:43:16.371 INFO:teuthology.orchestra.run.smithi096.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T18:43:16.396 INFO:teuthology.orchestra.run.smithi096.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-13T18:43:16.448 INFO:teuthology.orchestra.run.smithi096.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 3.4 MB/s | 172 kB 00:00 2024-09-13T18:43:16.497 INFO:teuthology.orchestra.run.smithi096.stdout:(27/138): ceph-grafana-dashboards-18.2.4-860.g6 492 kB/s | 24 kB 00:00 2024-09-13T18:43:16.547 INFO:teuthology.orchestra.run.smithi096.stdout:(28/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 2.7 MB/s | 139 kB 00:00 2024-09-13T18:43:16.614 INFO:teuthology.orchestra.run.smithi096.stdout:(29/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 12 MB/s | 3.0 MB 00:00 2024-09-13T18:43:16.755 INFO:teuthology.orchestra.run.smithi029.stdout:(33/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 14 MB/s | 40 MB 00:02 2024-09-13T18:43:16.781 INFO:teuthology.orchestra.run.smithi029.stdout:(34/138): ceph-prometheus-alerts-18.2.4-860.g6c 25 kB/s | 16 kB 00:00 2024-09-13T18:43:16.882 INFO:teuthology.orchestra.run.smithi096.stdout:(30/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 11 MB/s | 3.5 MB 00:00 2024-09-13T18:43:16.931 INFO:teuthology.orchestra.run.smithi029.stdout:(35/138): ceph-mgr-diskprediction-local-18.2.4- 6.0 MB/s | 7.4 MB 00:01 2024-09-13T18:43:16.932 INFO:teuthology.orchestra.run.smithi096.stdout:(31/138): ceph-mgr-modules-core-18.2.4-860.g6c6 4.8 MB/s | 246 kB 00:00 2024-09-13T18:43:16.965 INFO:teuthology.orchestra.run.smithi029.stdout:(36/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 1.2 MB/s | 264 kB 00:00 2024-09-13T18:43:16.991 INFO:teuthology.orchestra.run.smithi096.stdout:(32/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 848 kB/s | 49 kB 00:00 2024-09-13T18:43:16.991 INFO:teuthology.orchestra.run.smithi029.stdout:(37/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 1.1 MB/s | 226 kB 00:00 2024-09-13T18:43:17.016 INFO:teuthology.orchestra.run.smithi029.stdout:(38/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 217 kB/s | 18 kB 00:00 2024-09-13T18:43:17.049 INFO:teuthology.orchestra.run.smithi096.stdout:(33/138): ceph-prometheus-alerts-18.2.4-860.g6c 282 kB/s | 16 kB 00:00 2024-09-13T18:43:17.100 INFO:teuthology.orchestra.run.smithi029.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 733 kB/s | 80 kB 00:00 2024-09-13T18:43:17.141 INFO:teuthology.orchestra.run.smithi096.stdout:(34/138): ceph-mgr-diskprediction-local-18.2.4- 14 MB/s | 7.4 MB 00:00 2024-09-13T18:43:17.142 INFO:teuthology.orchestra.run.smithi029.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-13T18:43:17.166 INFO:teuthology.orchestra.run.smithi096.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 2.2 MB/s | 264 kB 00:00 2024-09-13T18:43:17.184 INFO:teuthology.orchestra.run.smithi029.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-13T18:43:17.200 INFO:teuthology.orchestra.run.smithi096.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 3.8 MB/s | 226 kB 00:00 2024-09-13T18:43:17.218 INFO:teuthology.orchestra.run.smithi029.stdout:(42/138): libgfortran-11.5.0-2.el9.x86_64.rpm 3.4 MB/s | 801 kB 00:00 2024-09-13T18:43:17.226 INFO:teuthology.orchestra.run.smithi096.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 309 kB/s | 18 kB 00:00 2024-09-13T18:43:17.237 INFO:teuthology.orchestra.run.smithi029.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 106 kB 00:00 2024-09-13T18:43:17.262 INFO:teuthology.orchestra.run.smithi029.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 135 kB 00:00 2024-09-13T18:43:17.288 INFO:teuthology.orchestra.run.smithi029.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-13T18:43:17.322 INFO:teuthology.orchestra.run.smithi029.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-13T18:43:17.364 INFO:teuthology.orchestra.run.smithi029.stdout:(47/138): python3-cryptography-36.0.1-4.el9.x86 5.5 MB/s | 1.2 MB 00:00 2024-09-13T18:43:17.506 INFO:teuthology.orchestra.run.smithi029.stdout:(48/138): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-13T18:43:17.531 INFO:teuthology.orchestra.run.smithi029.stdout:(49/138): boost-program-options-1.75.0-8.el9.x8 639 kB/s | 107 kB 00:00 2024-09-13T18:43:17.557 INFO:teuthology.orchestra.run.smithi029.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 428 kB/s | 22 kB 00:00 2024-09-13T18:43:17.584 INFO:teuthology.orchestra.run.smithi096.stdout:(38/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 16 MB/s | 40 MB 00:02 2024-09-13T18:43:17.599 INFO:teuthology.orchestra.run.smithi029.stdout:(51/138): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-13T18:43:17.625 INFO:teuthology.orchestra.run.smithi029.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 487 kB/s | 33 kB 00:00 2024-09-13T18:43:17.650 INFO:teuthology.orchestra.run.smithi029.stdout:(53/138): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-13T18:43:17.676 INFO:teuthology.orchestra.run.smithi029.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 359 kB/s | 18 kB 00:00 2024-09-13T18:43:17.701 INFO:teuthology.orchestra.run.smithi096.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 159 kB/s | 80 kB 00:00 2024-09-13T18:43:17.710 INFO:teuthology.orchestra.run.smithi029.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 188 kB/s | 11 kB 00:00 2024-09-13T18:43:17.735 INFO:teuthology.orchestra.run.smithi029.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.6 MB/s | 160 kB 00:00 2024-09-13T18:43:17.743 INFO:teuthology.orchestra.run.smithi096.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-13T18:43:17.761 INFO:teuthology.orchestra.run.smithi029.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-13T18:43:17.802 INFO:teuthology.orchestra.run.smithi096.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-13T18:43:17.803 INFO:teuthology.orchestra.run.smithi029.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 9.6 MB/s | 662 kB 00:00 2024-09-13T18:43:17.835 INFO:teuthology.orchestra.run.smithi096.stdout:(42/138): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-13T18:43:17.872 INFO:teuthology.orchestra.run.smithi029.stdout:(59/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-13T18:43:17.877 INFO:teuthology.orchestra.run.smithi096.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-13T18:43:17.897 INFO:teuthology.orchestra.run.smithi029.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 261 kB/s | 24 kB 00:00 2024-09-13T18:43:17.903 INFO:teuthology.orchestra.run.smithi096.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-13T18:43:17.923 INFO:teuthology.orchestra.run.smithi029.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 937 kB/s | 47 kB 00:00 2024-09-13T18:43:17.936 INFO:teuthology.orchestra.run.smithi096.stdout:(45/138): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-13T18:43:17.957 INFO:teuthology.orchestra.run.smithi029.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 292 kB 00:00 2024-09-13T18:43:17.961 INFO:teuthology.orchestra.run.smithi096.stdout:(46/138): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-13T18:43:17.982 INFO:teuthology.orchestra.run.smithi029.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 652 kB/s | 38 kB 00:00 2024-09-13T18:43:17.987 INFO:teuthology.orchestra.run.smithi096.stdout:(47/138): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-13T18:43:18.016 INFO:teuthology.orchestra.run.smithi029.stdout:(64/138): libtool-2.4.6-46.el9.x86_64.rpm 2.2 MB/s | 581 kB 00:00 2024-09-13T18:43:18.029 INFO:teuthology.orchestra.run.smithi096.stdout:(48/138): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-09-13T18:43:18.054 INFO:teuthology.orchestra.run.smithi096.stdout:(49/138): automake-1.16.2-8.el9.noarch.rpm 5.7 MB/s | 689 kB 00:00 2024-09-13T18:43:18.079 INFO:teuthology.orchestra.run.smithi096.stdout:(50/138): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-13T18:43:18.105 INFO:teuthology.orchestra.run.smithi096.stdout:(51/138): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-13T18:43:18.121 INFO:teuthology.orchestra.run.smithi096.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 784 kB/s | 33 kB 00:00 2024-09-13T18:43:18.142 INFO:teuthology.orchestra.run.smithi029.stdout:(65/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-13T18:43:18.155 INFO:teuthology.orchestra.run.smithi096.stdout:(53/138): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-13T18:43:18.172 INFO:teuthology.orchestra.run.smithi096.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-13T18:43:18.189 INFO:teuthology.orchestra.run.smithi096.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 332 kB/s | 11 kB 00:00 2024-09-13T18:43:18.200 INFO:teuthology.orchestra.run.smithi029.stdout:(66/138): postgresql-13.16-1.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-09-13T18:43:18.248 INFO:teuthology.orchestra.run.smithi096.stdout:(56/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-09-13T18:43:18.273 INFO:teuthology.orchestra.run.smithi096.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 541 kB/s | 45 kB 00:00 2024-09-13T18:43:18.298 INFO:teuthology.orchestra.run.smithi096.stdout:(58/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-13T18:43:18.301 INFO:teuthology.orchestra.run.smithi029.stdout:(67/138): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-13T18:43:18.332 INFO:teuthology.orchestra.run.smithi096.stdout:(59/138): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-13T18:43:18.343 INFO:teuthology.orchestra.run.smithi029.stdout:(68/138): postgresql-contrib-13.16-1.el9.x86_64 4.4 MB/s | 910 kB 00:00 2024-09-13T18:43:18.357 INFO:teuthology.orchestra.run.smithi096.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-13T18:43:18.377 INFO:teuthology.orchestra.run.smithi029.stdout:(69/138): postgresql-private-libs-13.16-1.el9.x 780 kB/s | 137 kB 00:00 2024-09-13T18:43:18.382 INFO:teuthology.orchestra.run.smithi096.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-13T18:43:18.416 INFO:teuthology.orchestra.run.smithi096.stdout:(62/138): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-13T18:43:18.427 INFO:teuthology.orchestra.run.smithi029.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-13T18:43:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 659 kB/s | 38 kB 00:00 2024-09-13T18:43:18.475 INFO:teuthology.orchestra.run.smithi096.stdout:(64/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-13T18:43:18.553 INFO:teuthology.orchestra.run.smithi029.stdout:(71/138): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-13T18:43:18.559 INFO:teuthology.orchestra.run.smithi096.stdout:(65/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-13T18:43:18.587 INFO:teuthology.orchestra.run.smithi029.stdout:(72/138): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-13T18:43:18.612 INFO:teuthology.orchestra.run.smithi029.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 435 kB/s | 26 kB 00:00 2024-09-13T18:43:18.638 INFO:teuthology.orchestra.run.smithi029.stdout:(74/138): python3-jsonpointer-2.0-4.el9.noarch. 379 kB/s | 19 kB 00:00 2024-09-13T18:43:18.643 INFO:teuthology.orchestra.run.smithi096.stdout:(66/138): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-13T18:43:18.684 INFO:teuthology.orchestra.run.smithi096.stdout:(67/138): postgresql-13.16-1.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-09-13T18:43:18.710 INFO:teuthology.orchestra.run.smithi096.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-13T18:43:18.743 INFO:teuthology.orchestra.run.smithi096.stdout:(69/138): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-13T18:43:18.756 INFO:teuthology.orchestra.run.smithi029.stdout:(75/138): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-13T18:43:18.782 INFO:teuthology.orchestra.run.smithi029.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 242 kB/s | 35 kB 00:00 2024-09-13T18:43:18.794 INFO:teuthology.orchestra.run.smithi096.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-13T18:43:18.808 INFO:teuthology.orchestra.run.smithi029.stdout:(77/138): python3-mako-1.1.4-6.el9.noarch.rpm 883 kB/s | 172 kB 00:00 2024-09-13T18:43:18.833 INFO:teuthology.orchestra.run.smithi029.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.8 MB/s | 250 kB 00:00 2024-09-13T18:43:18.867 INFO:teuthology.orchestra.run.smithi029.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-13T18:43:18.881 INFO:teuthology.orchestra.run.smithi096.stdout:(71/138): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-09-13T18:43:18.892 INFO:teuthology.orchestra.run.smithi029.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-13T18:43:18.902 INFO:teuthology.orchestra.run.smithi096.stdout:(72/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-09-13T18:43:18.918 INFO:teuthology.orchestra.run.smithi029.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 834 kB/s | 42 kB 00:00 2024-09-13T18:43:18.928 INFO:teuthology.orchestra.run.smithi096.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-13T18:43:18.952 INFO:teuthology.orchestra.run.smithi029.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-13T18:43:18.953 INFO:teuthology.orchestra.run.smithi096.stdout:(74/138): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-13T18:43:18.977 INFO:teuthology.orchestra.run.smithi029.stdout:(83/138): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-13T18:43:18.978 INFO:teuthology.orchestra.run.smithi096.stdout:(75/138): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-13T18:43:19.003 INFO:teuthology.orchestra.run.smithi029.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-13T18:43:19.003 INFO:teuthology.orchestra.run.smithi096.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-13T18:43:19.029 INFO:teuthology.orchestra.run.smithi029.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-13T18:43:19.080 INFO:teuthology.orchestra.run.smithi096.stdout:(77/138): postgresql-server-13.16-1.el9.x86_64. 15 MB/s | 5.8 MB 00:00 2024-09-13T18:43:19.080 INFO:teuthology.orchestra.run.smithi029.stdout:(86/138): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-13T18:43:19.104 INFO:teuthology.orchestra.run.smithi096.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-13T18:43:19.130 INFO:teuthology.orchestra.run.smithi096.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-13T18:43:19.155 INFO:teuthology.orchestra.run.smithi096.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-13T18:43:19.172 INFO:teuthology.orchestra.run.smithi096.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-13T18:43:19.179 INFO:teuthology.orchestra.run.smithi029.stdout:(87/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-13T18:43:19.205 INFO:teuthology.orchestra.run.smithi029.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-13T18:43:19.206 INFO:teuthology.orchestra.run.smithi096.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-13T18:43:19.231 INFO:teuthology.orchestra.run.smithi029.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T18:43:19.232 INFO:teuthology.orchestra.run.smithi096.stdout:(83/138): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-13T18:43:19.256 INFO:teuthology.orchestra.run.smithi096.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-13T18:43:19.257 INFO:teuthology.orchestra.run.smithi029.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-13T18:43:19.281 INFO:teuthology.orchestra.run.smithi096.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-13T18:43:19.283 INFO:teuthology.orchestra.run.smithi029.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T18:43:19.317 INFO:teuthology.orchestra.run.smithi029.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 741 kB/s | 45 kB 00:00 2024-09-13T18:43:19.357 INFO:teuthology.orchestra.run.smithi096.stdout:(86/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-13T18:43:19.367 INFO:teuthology.orchestra.run.smithi029.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.3 MB/s | 111 kB 00:00 2024-09-13T18:43:19.382 INFO:teuthology.orchestra.run.smithi096.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-13T18:43:19.407 INFO:teuthology.orchestra.run.smithi096.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-13T18:43:19.410 INFO:teuthology.orchestra.run.smithi029.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.3 MB/s | 308 kB 00:00 2024-09-13T18:43:19.432 INFO:teuthology.orchestra.run.smithi096.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T18:43:19.435 INFO:teuthology.orchestra.run.smithi029.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T18:43:19.458 INFO:teuthology.orchestra.run.smithi096.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-13T18:43:19.461 INFO:teuthology.orchestra.run.smithi029.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T18:43:19.483 INFO:teuthology.orchestra.run.smithi096.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T18:43:19.486 INFO:teuthology.orchestra.run.smithi029.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T18:43:19.509 INFO:teuthology.orchestra.run.smithi096.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-13T18:43:19.554 INFO:teuthology.orchestra.run.smithi029.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-13T18:43:19.559 INFO:teuthology.orchestra.run.smithi096.stdout:(93/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 6.0 MB/s | 308 kB 00:00 2024-09-13T18:43:19.585 INFO:teuthology.orchestra.run.smithi096.stdout:(94/138): fmt-8.1.1-5.el9.x86_64.rpm 1.1 MB/s | 111 kB 00:00 2024-09-13T18:43:19.610 INFO:teuthology.orchestra.run.smithi096.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T18:43:19.612 INFO:teuthology.orchestra.run.smithi029.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 9.2 MB/s | 548 kB 00:00 2024-09-13T18:43:19.635 INFO:teuthology.orchestra.run.smithi096.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T18:43:19.638 INFO:teuthology.orchestra.run.smithi029.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T18:43:19.660 INFO:teuthology.orchestra.run.smithi096.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T18:43:19.728 INFO:teuthology.orchestra.run.smithi096.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-13T18:43:19.730 INFO:teuthology.orchestra.run.smithi029.stdout:(101/138): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-13T18:43:19.756 INFO:teuthology.orchestra.run.smithi029.stdout:(102/138): python3-cachetools-4.2.4-1.el9.noarc 274 kB/s | 32 kB 00:00 2024-09-13T18:43:19.770 INFO:teuthology.orchestra.run.smithi096.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 13 MB/s | 548 kB 00:00 2024-09-13T18:43:19.781 INFO:teuthology.orchestra.run.smithi029.stdout:(103/138): python3-certifi-2023.05.07-4.el9.noa 279 kB/s | 14 kB 00:00 2024-09-13T18:43:19.794 INFO:teuthology.orchestra.run.smithi096.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T18:43:19.954 INFO:teuthology.orchestra.run.smithi096.stdout:(101/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-13T18:43:19.979 INFO:teuthology.orchestra.run.smithi096.stdout:(102/138): python3-cachetools-4.2.4-1.el9.noarc 175 kB/s | 32 kB 00:00 2024-09-13T18:43:20.012 INFO:teuthology.orchestra.run.smithi096.stdout:(103/138): python3-cheroot-8.6.0-4.el9.noarch.r 6.5 MB/s | 172 kB 00:00 2024-09-13T18:43:20.037 INFO:teuthology.orchestra.run.smithi096.stdout:(104/138): python3-certifi-2023.05.07-4.el9.noa 169 kB/s | 14 kB 00:00 2024-09-13T18:43:20.057 INFO:teuthology.orchestra.run.smithi029.stdout:(104/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-13T18:43:20.063 INFO:teuthology.orchestra.run.smithi096.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 7.2 MB/s | 358 kB 00:00 2024-09-13T18:43:20.082 INFO:teuthology.orchestra.run.smithi029.stdout:(105/138): python3-cheroot-8.6.0-4.el9.noarch.r 526 kB/s | 172 kB 00:00 2024-09-13T18:43:20.088 INFO:teuthology.orchestra.run.smithi096.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 433 kB/s | 11 kB 00:00 2024-09-13T18:43:20.113 INFO:teuthology.orchestra.run.smithi096.stdout:(107/138): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-13T18:43:20.118 INFO:teuthology.orchestra.run.smithi029.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 398 kB/s | 11 kB 00:00 2024-09-13T18:43:20.138 INFO:teuthology.orchestra.run.smithi096.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-13T18:43:20.152 INFO:teuthology.orchestra.run.smithi029.stdout:(107/138): python3-cherrypy-18.6.1-2.el9.noarch 969 kB/s | 358 kB 00:00 2024-09-13T18:43:20.164 INFO:teuthology.orchestra.run.smithi096.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-13T18:43:20.178 INFO:teuthology.orchestra.run.smithi029.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 312 kB/s | 18 kB 00:00 2024-09-13T18:43:20.189 INFO:teuthology.orchestra.run.smithi096.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-13T18:43:20.211 INFO:teuthology.orchestra.run.smithi029.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 693 kB/s | 23 kB 00:00 2024-09-13T18:43:20.214 INFO:teuthology.orchestra.run.smithi096.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-13T18:43:20.245 INFO:teuthology.orchestra.run.smithi029.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 289 kB/s | 19 kB 00:00 2024-09-13T18:43:20.270 INFO:teuthology.orchestra.run.smithi029.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 333 kB/s | 20 kB 00:00 2024-09-13T18:43:20.281 INFO:teuthology.orchestra.run.smithi096.stdout:(112/138): libarrow-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2024-09-13T18:43:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:(112/138): python3-google-auth-2.34.0-1.el9.noa 894 kB/s | 220 kB 00:00 2024-09-13T18:43:20.323 INFO:teuthology.orchestra.run.smithi096.stdout:(113/138): python3-logutils-0.3.5-21.el9.noarch 426 kB/s | 46 kB 00:00 2024-09-13T18:43:20.338 INFO:teuthology.orchestra.run.smithi029.stdout:(113/138): python3-logutils-0.3.5-21.el9.noarch 688 kB/s | 46 kB 00:00 2024-09-13T18:43:20.349 INFO:teuthology.orchestra.run.smithi096.stdout:(114/138): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-13T18:43:20.372 INFO:teuthology.orchestra.run.smithi029.stdout:(114/138): python3-more-itertools-8.12.0-2.el9. 1.1 MB/s | 79 kB 00:00 2024-09-13T18:43:20.374 INFO:teuthology.orchestra.run.smithi096.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-13T18:43:20.397 INFO:teuthology.orchestra.run.smithi029.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 979 kB/s | 58 kB 00:00 2024-09-13T18:43:20.399 INFO:teuthology.orchestra.run.smithi096.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-13T18:43:20.423 INFO:teuthology.orchestra.run.smithi029.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 652 kB/s | 16 kB 00:00 2024-09-13T18:43:20.424 INFO:teuthology.orchestra.run.smithi096.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-13T18:43:20.450 INFO:teuthology.orchestra.run.smithi096.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-13T18:43:20.457 INFO:teuthology.orchestra.run.smithi029.stdout:(117/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-09-13T18:43:20.475 INFO:teuthology.orchestra.run.smithi096.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-13T18:43:20.491 INFO:teuthology.orchestra.run.smithi029.stdout:(118/138): python3-pecan-1.4.2-3.el9.noarch.rpm 2.2 MB/s | 272 kB 00:00 2024-09-13T18:43:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T18:43:20.519 INFO:teuthology.orchestra.run.smithi029.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 520 kB/s | 31 kB 00:00 2024-09-13T18:43:20.526 INFO:teuthology.orchestra.run.smithi096.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-13T18:43:20.542 INFO:teuthology.orchestra.run.smithi029.stdout:(120/138): python3-routes-2.5.1-5.el9.noarch.rp 3.6 MB/s | 188 kB 00:00 2024-09-13T18:43:20.543 INFO:teuthology.orchestra.run.smithi096.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 852 kB/s | 36 kB 00:00 2024-09-13T18:43:20.567 INFO:teuthology.orchestra.run.smithi029.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-13T18:43:20.568 INFO:teuthology.orchestra.run.smithi096.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-13T18:43:20.593 INFO:teuthology.orchestra.run.smithi029.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-13T18:43:20.610 INFO:teuthology.orchestra.run.smithi096.stdout:(124/138): python3-kubernetes-26.1.0-2.el9.noar 2.4 MB/s | 1.0 MB 00:00 2024-09-13T18:43:20.619 INFO:teuthology.orchestra.run.smithi029.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-13T18:43:20.635 INFO:teuthology.orchestra.run.smithi096.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-13T18:43:20.661 INFO:teuthology.orchestra.run.smithi096.stdout:(126/138): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-13T18:43:20.662 INFO:teuthology.orchestra.run.smithi029.stdout:(124/138): python3-kubernetes-26.1.0-2.el9.noar 2.5 MB/s | 1.0 MB 00:00 2024-09-13T18:43:20.686 INFO:teuthology.orchestra.run.smithi096.stdout:(127/138): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-13T18:43:20.695 INFO:teuthology.orchestra.run.smithi029.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-13T18:43:20.711 INFO:teuthology.orchestra.run.smithi096.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-13T18:43:20.729 INFO:teuthology.orchestra.run.smithi029.stdout:(126/138): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-13T18:43:20.736 INFO:teuthology.orchestra.run.smithi096.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-13T18:43:20.755 INFO:teuthology.orchestra.run.smithi029.stdout:(127/138): python3-zc-lockfile-2.0-10.el9.noarc 337 kB/s | 20 kB 00:00 2024-09-13T18:43:20.787 INFO:teuthology.orchestra.run.smithi096.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-13T18:43:20.789 INFO:teuthology.orchestra.run.smithi029.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-13T18:43:20.864 INFO:teuthology.orchestra.run.smithi029.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 2.1 MB/s | 427 kB 00:00 2024-09-13T18:43:20.870 INFO:teuthology.orchestra.run.smithi096.stdout:(131/138): NetworkManager-1.49.90-1.el9.x86_64. 28 MB/s | 2.3 MB 00:00 2024-09-13T18:43:20.932 INFO:teuthology.orchestra.run.smithi029.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-13T18:43:20.946 INFO:teuthology.orchestra.run.smithi096.stdout:(132/138): NetworkManager-libnm-1.49.90-1.el9.x 24 MB/s | 1.8 MB 00:00 2024-09-13T18:43:20.996 INFO:teuthology.orchestra.run.smithi096.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 815 kB/s | 41 kB 00:00 2024-09-13T18:43:21.046 INFO:teuthology.orchestra.run.smithi096.stdout:(134/138): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-13T18:43:21.096 INFO:teuthology.orchestra.run.smithi096.stdout:(135/138): librados2-18.2.4-860.g6c6b083f.el9.x 8.6 MB/s | 3.3 MB 00:00 2024-09-13T18:43:21.155 INFO:teuthology.orchestra.run.smithi096.stdout:(136/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 7.2 MB/s | 3.0 MB 00:00 2024-09-13T18:43:21.166 INFO:teuthology.orchestra.run.smithi029.stdout:(131/138): librados2-18.2.4-860.g6c6b083f.el9.x 8.8 MB/s | 3.3 MB 00:00 2024-09-13T18:43:21.214 INFO:teuthology.orchestra.run.smithi096.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-13T18:43:21.241 INFO:teuthology.orchestra.run.smithi029.stdout:(132/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 8.0 MB/s | 3.0 MB 00:00 2024-09-13T18:43:21.264 INFO:teuthology.orchestra.run.smithi096.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-13T18:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout:Total 24 MB/s | 203 MB 00:08 2024-09-13T18:43:21.350 INFO:teuthology.orchestra.run.smithi029.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 376 kB/s | 41 kB 00:00 2024-09-13T18:43:21.575 INFO:teuthology.orchestra.run.smithi029.stdout:(134/138): NetworkManager-tui-1.49.90-1.el9.x86 1.1 MB/s | 249 kB 00:00 2024-09-13T18:43:21.992 INFO:teuthology.orchestra.run.smithi029.stdout:(135/138): NetworkManager-1.49.90-1.el9.x86_64. 2.2 MB/s | 2.3 MB 00:01 2024-09-13T18:43:22.051 INFO:teuthology.orchestra.run.smithi029.stdout:(136/138): NetworkManager-libnm-1.49.90-1.el9.x 2.0 MB/s | 1.8 MB 00:00 2024-09-13T18:43:22.101 INFO:teuthology.orchestra.run.smithi029.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 2.6 MB/s | 1.4 MB 00:00 2024-09-13T18:43:22.360 INFO:teuthology.orchestra.run.smithi029.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 2.4 MB 00:00 2024-09-13T18:43:22.366 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:43:22.366 INFO:teuthology.orchestra.run.smithi029.stdout:Total 19 MB/s | 203 MB 00:10 2024-09-13T18:43:22.375 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-09-13T18:43:22.521 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-09-13T18:43:22.521 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-09-13T18:43:23.496 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-13T18:43:23.656 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-13T18:43:23.656 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-13T18:43:24.534 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-09-13T18:43:24.534 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-09-13T18:43:25.952 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-13T18:43:25.952 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-13T18:43:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-09-13T18:43:30.251 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T18:43:30.289 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T18:43:30.352 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T18:43:30.394 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T18:43:30.605 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T18:43:30.605 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T18:43:30.864 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T18:43:30.916 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:43:31.038 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:43:31.192 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:43:31.266 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:43:31.297 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:43:31.461 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T18:43:31.518 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T18:43:31.546 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:43:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:43:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:43:31.870 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:43:31.977 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T18:43:32.051 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-13T18:43:32.085 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:43:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:43:32.251 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T18:43:32.304 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T18:43:32.362 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T18:43:32.404 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T18:43:32.427 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:43:32.429 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T18:43:32.466 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T18:43:32.487 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T18:43:32.509 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T18:43:32.581 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T18:43:32.617 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T18:43:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T18:43:32.723 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T18:43:32.777 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T18:43:32.806 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T18:43:32.830 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T18:43:32.851 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T18:43:32.937 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T18:43:32.978 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T18:43:33.009 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:43:33.022 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T18:43:33.096 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T18:43:33.132 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:43:33.161 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:43:33.230 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T18:43:33.254 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:43:33.282 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T18:43:33.285 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:43:33.486 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T18:43:33.557 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T18:43:33.585 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:43:33.696 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:43:33.728 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:43:33.825 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T18:43:33.910 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T18:43:33.949 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T18:43:33.964 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:43:33.986 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T18:43:34.028 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T18:43:34.129 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T18:43:34.194 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T18:43:34.246 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:43:34.262 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T18:43:34.370 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T18:43:34.384 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:43:34.407 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T18:43:34.462 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T18:43:34.545 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T18:43:34.575 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T18:43:34.659 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T18:43:34.698 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:43:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T18:43:34.740 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T18:43:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T18:43:34.786 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T18:43:34.860 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T18:43:34.891 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T18:43:34.901 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T18:43:34.930 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T18:43:34.931 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T18:43:34.972 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T18:43:35.010 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T18:43:35.071 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T18:43:35.075 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T18:43:35.109 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T18:43:35.115 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T18:43:35.164 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T18:43:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T18:43:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T18:43:35.232 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T18:43:35.265 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T18:43:35.273 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T18:43:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T18:43:35.318 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T18:43:35.329 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T18:43:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T18:43:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T18:43:35.395 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T18:43:35.429 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T18:43:35.463 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T18:43:35.505 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T18:43:35.547 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T18:43:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T18:43:35.599 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T18:43:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T18:43:35.654 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T18:43:35.980 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T18:43:36.051 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T18:43:36.190 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T18:43:36.284 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T18:43:36.336 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T18:43:36.375 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T18:43:36.417 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T18:43:36.607 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T18:43:36.663 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T18:43:36.766 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T18:43:36.782 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T18:43:36.817 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T18:43:36.874 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T18:43:36.957 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T18:43:36.995 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T18:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T18:43:37.040 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T18:43:37.074 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T18:43:37.099 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T18:43:37.152 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T18:43:37.172 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T18:43:37.203 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T18:43:37.215 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T18:43:37.347 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T18:43:37.390 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T18:43:37.401 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T18:43:37.434 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T18:43:37.434 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T18:43:37.523 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T18:43:37.540 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T18:43:37.584 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T18:43:37.636 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T18:43:37.667 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T18:43:37.694 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T18:43:37.857 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T18:43:38.286 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T18:43:38.316 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:43:38.339 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T18:43:38.384 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T18:43:38.421 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T18:43:38.456 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T18:43:38.498 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T18:43:38.542 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T18:43:38.577 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T18:43:38.612 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T18:43:38.663 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T18:43:38.776 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T18:43:38.833 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T18:43:39.579 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:43:39.602 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T18:43:39.652 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T18:43:39.675 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T18:43:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T18:43:39.710 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T18:43:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T18:43:39.815 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T18:43:39.855 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T18:43:40.017 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T18:43:40.046 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T18:43:40.060 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:43:40.078 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T18:43:40.133 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:43:40.164 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T18:43:40.167 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T18:43:40.201 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T18:43:40.606 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T18:43:40.638 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:43:40.709 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:43:40.740 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T18:43:40.882 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T18:43:41.013 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:43:42.349 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:43:42.463 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T18:43:42.492 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T18:43:42.534 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T18:43:42.811 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:43:42.844 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:43:42.861 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T18:43:43.154 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:43:43.388 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:43:43.423 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:43:43.500 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:43:43.500 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:43:43.500 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:43:43.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:43:43.537 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:43:43.541 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:43:43.806 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T18:43:43.869 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T18:43:44.306 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T18:43:44.338 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:43:44.410 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:43:44.442 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T18:43:46.655 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:43:46.690 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:43:47.255 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:43:47.306 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:43:47.418 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:43:47.418 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:43:47.418 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:43:47.419 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:43:47.469 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:43:55.189 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:43:55.190 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /sys 2024-09-13T18:43:55.190 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /proc 2024-09-13T18:43:55.190 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /mnt 2024-09-13T18:43:55.190 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /var/tmp 2024-09-13T18:43:55.190 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /home 2024-09-13T18:43:55.190 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /root 2024-09-13T18:43:55.190 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /tmp 2024-09-13T18:43:55.190 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:43:55.378 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:43:55.394 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:43:55.394 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:43:55.394 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T18:43:55.394 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:43:56.831 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:43:56.858 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:43:56.858 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:43:56.858 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:43:56.858 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:43:56.858 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:43:56.858 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:43:57.065 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:43:57.088 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:43:57.088 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:43:57.088 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:43:57.088 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:43:57.088 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:43:57.089 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:43:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:43:57.547 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:43:57.547 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:43:57.547 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:43:57.547 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:43:57.547 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:43:57.547 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:43:57.654 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T18:43:57.702 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T18:43:57.766 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T18:43:57.960 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T18:43:58.017 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T18:43:58.085 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T18:43:58.173 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T18:43:58.313 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T18:43:58.358 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T18:43:58.390 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T18:43:58.418 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T18:43:58.843 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:43:58.867 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:43:58.896 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T18:43:58.959 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T18:43:58.982 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:44:00.021 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:44:00.058 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:44:01.022 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:44:01.051 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:44:01.151 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:44:01.325 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T18:44:01.361 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:44:01.385 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:44:01.385 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:01.385 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:44:01.385 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:44:01.385 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:44:01.386 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:01.429 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:44:01.440 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:44:01.534 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T18:44:01.588 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T18:44:02.304 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T18:44:02.331 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:44:02.354 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:44:02.355 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:02.355 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:44:02.355 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:44:02.355 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:44:02.355 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:02.399 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:44:02.422 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:44:02.423 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:02.423 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:44:02.423 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:02.466 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:44:02.489 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:44:02.489 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:02.489 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T18:44:02.490 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:44:02.490 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:44:02.490 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:44:02.815 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:44:02.815 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:02.816 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:44:02.816 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:44:02.816 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:44:02.816 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:02.913 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:44:02.913 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2024-09-13T18:44:02.913 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2024-09-13T18:44:02.913 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2024-09-13T18:44:02.913 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2024-09-13T18:44:02.913 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2024-09-13T18:44:02.913 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /root 2024-09-13T18:44:02.913 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2024-09-13T18:44:02.914 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:44:03.126 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:44:03.126 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:03.126 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T18:44:03.126 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:04.642 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:44:04.670 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:44:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:44:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:44:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:44:04.671 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:04.885 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:44:04.910 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:44:04.910 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:04.910 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:44:04.911 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:44:04.911 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:44:04.911 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:05.378 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:44:05.404 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:44:05.404 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:05.404 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:44:05.404 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:44:05.404 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:44:05.404 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:05.520 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T18:44:05.579 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T18:44:05.652 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T18:44:05.865 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T18:44:05.927 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T18:44:06.011 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T18:44:06.109 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T18:44:06.262 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T18:44:06.307 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T18:44:06.347 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T18:44:06.375 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T18:44:06.487 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T18:44:06.528 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T18:44:06.569 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T18:44:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T18:44:06.795 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:44:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T18:44:06.829 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:44:06.850 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T18:44:06.867 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T18:44:06.885 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T18:44:06.918 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T18:44:06.964 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T18:44:06.977 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T18:44:07.013 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:44:07.587 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:44:07.630 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:44:07.650 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:44:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:44:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:44:08.476 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T18:44:08.569 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T18:44:08.626 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T18:44:08.714 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T18:44:08.747 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T18:44:08.772 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T18:44:08.807 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T18:44:08.807 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:44:08.891 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:44:08.891 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:44:08.975 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:44:09.000 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T18:44:09.007 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:44:09.007 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:44:09.178 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:44:09.194 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:44:09.194 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:44:09.200 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:44:09.287 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:44:09.311 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:44:09.360 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:44:09.486 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T18:44:09.514 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:44:09.541 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:44:09.541 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:09.541 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:44:09.541 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:44:09.541 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:44:09.542 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:09.591 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:44:09.604 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:44:09.709 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T18:44:09.774 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T18:44:10.529 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T18:44:10.570 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:44:10.596 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:44:10.596 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:10.596 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:44:10.596 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:44:10.597 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:44:10.597 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:10.640 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:44:10.664 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:44:10.665 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:10.665 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:44:10.665 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:10.716 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:44:10.741 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:44:10.741 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:10.741 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T18:44:10.742 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:44:10.742 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:44:10.742 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:11.051 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:44:11.076 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:44:11.076 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:44:11.076 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:44:11.076 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:44:11.076 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:44:11.076 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:14.615 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:44:14.615 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T18:44:14.615 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T18:44:14.615 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T18:44:14.615 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T18:44:14.615 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T18:44:14.616 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T18:44:14.616 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T18:44:14.616 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:44:14.616 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:44:14.616 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:44:14.616 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T18:44:14.616 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T18:44:14.616 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:44:14.616 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T18:44:14.616 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T18:44:14.616 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T18:44:14.617 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T18:44:14.617 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T18:44:14.617 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T18:44:14.617 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T18:44:14.617 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T18:44:14.617 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T18:44:14.617 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T18:44:14.617 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T18:44:14.617 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T18:44:14.617 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T18:44:14.617 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T18:44:14.617 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T18:44:14.618 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T18:44:14.619 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T18:44:14.620 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T18:44:14.620 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T18:44:14.620 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T18:44:14.620 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T18:44:14.620 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T18:44:14.620 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T18:44:14.620 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T18:44:14.620 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T18:44:14.620 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T18:44:14.620 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T18:44:14.621 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T18:44:14.621 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T18:44:14.621 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T18:44:14.621 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T18:44:14.621 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T18:44:14.621 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T18:44:14.621 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T18:44:14.621 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T18:44:14.621 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T18:44:14.621 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T18:44:14.621 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T18:44:14.621 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T18:44:14.622 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T18:44:14.623 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T18:44:14.624 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T18:44:14.624 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T18:44:14.627 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T18:44:14.627 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T18:44:14.627 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T18:44:14.627 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T18:44:14.628 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T18:44:14.628 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T18:44:14.628 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T18:44:14.628 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T18:44:14.628 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T18:44:14.628 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T18:44:14.628 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T18:44:14.629 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T18:44:14.629 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T18:44:14.629 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T18:44:14.629 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T18:44:14.629 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T18:44:14.629 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T18:44:14.629 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T18:44:14.630 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T18:44:14.630 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T18:44:14.630 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T18:44:14.630 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T18:44:14.630 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T18:44:14.630 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T18:44:14.631 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T18:44:14.631 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T18:44:14.631 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T18:44:14.631 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T18:44:14.631 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T18:44:14.631 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T18:44:14.631 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T18:44:14.631 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T18:44:14.632 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T18:44:14.632 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T18:44:14.632 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T18:44:14.632 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T18:44:14.632 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T18:44:14.632 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T18:44:14.632 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T18:44:14.632 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T18:44:14.632 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T18:44:14.985 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T18:44:15.027 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T18:44:15.077 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T18:44:15.109 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T18:44:15.319 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T18:44:15.380 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T18:44:15.412 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T18:44:15.450 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T18:44:15.514 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T18:44:16.189 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:44:16.238 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:44:16.260 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:44:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:44:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:17.120 INFO:teuthology.orchestra.run.smithi096.stdout:Upgraded: 2024-09-13T18:44:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:44:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:44:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:44:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:44:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:44:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:44:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:44:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:44:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:44:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:44:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:44:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:44:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T18:44:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:44:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T18:44:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:44:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:44:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:44:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:44:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:44:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:44:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T18:44:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:44:17.126 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:44:17.127 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:44:17.128 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:44:17.129 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:44:17.129 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:44:17.129 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.129 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.129 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:44:17.129 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:44:17.129 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:44:17.129 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.129 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:44:17.129 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:44:17.129 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:44:17.129 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:44:17.130 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:44:17.130 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:44:17.130 INFO:teuthology.orchestra.run.smithi096.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:44:17.130 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:44:17.130 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:44:17.130 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:44:17.130 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:44:17.130 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.130 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.130 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:17.130 INFO:teuthology.orchestra.run.smithi096.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:44:17.131 INFO:teuthology.orchestra.run.smithi096.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:44:17.131 INFO:teuthology.orchestra.run.smithi096.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:44:17.131 INFO:teuthology.orchestra.run.smithi096.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T18:44:17.131 INFO:teuthology.orchestra.run.smithi096.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T18:44:17.131 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:44:17.131 INFO:teuthology.orchestra.run.smithi096.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:44:17.131 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:17.131 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-09-13T18:44:17.168 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T18:44:17.282 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T18:44:17.335 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T18:44:17.449 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T18:44:17.490 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T18:44:17.524 DEBUG:teuthology.parallel:result is None 2024-09-13T18:44:17.525 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T18:44:17.567 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T18:44:17.567 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:44:17.724 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:44:17.724 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:44:17.822 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:44:17.856 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T18:44:17.862 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:44:17.862 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:44:18.058 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:44:18.059 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:44:18.202 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:44:18.287 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:44:27.542 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:44:27.542 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T18:44:27.542 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T18:44:27.542 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T18:44:27.542 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T18:44:27.542 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T18:44:27.543 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T18:44:27.543 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T18:44:27.543 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:44:27.543 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:44:27.543 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:44:27.543 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T18:44:27.543 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T18:44:27.543 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:44:27.543 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T18:44:27.543 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T18:44:27.543 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T18:44:27.543 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T18:44:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T18:44:27.555 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T18:44:27.555 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T18:44:27.555 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T18:44:27.555 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T18:44:27.555 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T18:44:27.555 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T18:44:27.555 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T18:44:27.555 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T18:44:27.556 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T18:44:27.557 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T18:44:27.558 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T18:44:27.559 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T18:44:27.560 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T18:44:27.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T18:44:27.562 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T18:44:27.563 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T18:44:27.564 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T18:44:27.564 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T18:44:30.061 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:44:30.061 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:30.061 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2024-09-13T18:44:30.061 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:44:30.061 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:44:30.061 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:44:30.061 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:44:30.062 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.062 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.062 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:44:30.062 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:44:30.062 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-13T18:44:30.062 INFO:teuthology.orchestra.run.smithi029.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T18:44:30.062 INFO:teuthology.orchestra.run.smithi029.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:44:30.062 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:44:30.062 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.062 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.062 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.062 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.063 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:30.063 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.063 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.063 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.063 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:30.063 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:30.063 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:30.063 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:30.063 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:30.063 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.063 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.063 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:44:30.064 INFO:teuthology.orchestra.run.smithi029.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:44:30.065 INFO:teuthology.orchestra.run.smithi029.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:44:30.065 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:44:30.065 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T18:44:30.065 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:44:30.065 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:44:30.065 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.065 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.065 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.065 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:44:30.065 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:44:30.065 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:44:30.065 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:44:30.066 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:44:30.066 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.066 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.066 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:44:30.066 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.066 INFO:teuthology.orchestra.run.smithi029.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T18:44:30.066 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:44:30.066 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T18:44:30.066 INFO:teuthology.orchestra.run.smithi029.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:44:30.066 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:44:30.067 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:44:30.067 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:44:30.067 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:44:30.067 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:44:30.067 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T18:44:30.067 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T18:44:30.067 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T18:44:30.067 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T18:44:30.067 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:44:30.067 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:44:30.067 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:44:30.068 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:44:30.069 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:44:30.069 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:44:30.069 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:44:30.069 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:44:30.069 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:44:30.069 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:44:30.069 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:44:30.069 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:44:30.070 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:44:30.070 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:44:30.070 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:44:30.070 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:44:30.070 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:44:30.070 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:44:30.070 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:44:30.070 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:44:30.070 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:44:30.070 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:44:30.070 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:44:30.070 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:44:30.071 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:44:30.071 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:44:30.071 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:44:30.071 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:44:30.071 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:44:30.071 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.071 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.071 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:44:30.071 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:44:30.072 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:44:30.072 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.072 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:44:30.072 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:44:30.072 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:44:30.072 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:44:30.072 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:44:30.072 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:44:30.072 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:44:30.072 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:44:30.072 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:44:30.072 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:44:30.073 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:44:30.073 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.073 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.073 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:44:30.073 INFO:teuthology.orchestra.run.smithi029.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:44:30.073 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:44:30.073 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:44:30.073 INFO:teuthology.orchestra.run.smithi029.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T18:44:30.073 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T18:44:30.073 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:44:30.074 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:44:30.074 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:30.074 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-13T18:44:30.571 DEBUG:teuthology.parallel:result is None 2024-09-13T18:44:30.572 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:44:30.728 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:44:30.753 INFO:teuthology.orchestra.run.smithi029.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T18:44:30.753 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T18:44:30.753 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T18:44:30.755 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:44:30.901 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:44:30.928 INFO:teuthology.orchestra.run.smithi096.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T18:44:30.928 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T18:44:30.928 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T18:44:30.930 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T18:44:30.930 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:44:30.930 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:44:30.962 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:44:30.962 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:44:30.999 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T18:44:31.000 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:44:31.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:44:31.031 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:44:31.099 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:44:31.100 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:44:31.128 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:44:31.197 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T18:44:31.197 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:44:31.197 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:44:31.224 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:44:31.291 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:44:31.291 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:44:31.319 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:44:31.387 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T18:44:31.387 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:44:31.387 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:44:31.413 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:44:31.480 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:44:31.480 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:44:31.507 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:44:31.574 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T18:44:31.652 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T18:44:31.652 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2024-09-13T18:44:31.655 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2024-09-13T18:44:31.682 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T18:44:31.682 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:44:31.723 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:44:31.748 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T18:44:31.749 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:44:31.790 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:44:31.821 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T18:44:31.821 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T18:44:31.821 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T18:44:31.821 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:44:31.821 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:44:31.870 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:44:31.991 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-13T18:44:32.016 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:44:32.017 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:44:32.033 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:44:32.153 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-13T18:44:32.182 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T18:44:32.182 INFO:tasks.ceph:config {'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T18:44:32.183 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc}', 'email': None, 'first_in_suite': False, 'job_id': '7904004', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEeSfjCy9eD+cDuevsRD3GEdPHnMK9vzvVo+92YxG2h37qSVbhUnWG2XGORDoTnjBorXRiFCzoLjHr8nsENX3eA=', 'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC4M4kjidzZ9dqO8rYomYwqUjNiw1vW6G04Ak2DgQbh/WA7e3kGKjjnlwbi1n9h2SjVhDeaLmzitWh3WsE6Gg+w='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['fs/misc/acl.sh', 'fs/misc/chmod.sh', 'fs/misc/dac_override.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T18:44:32.183 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:44:32.185 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:44:32.233 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:44:32.241 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:44:32.297 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:44:32.298 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:44:32.322 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:44:32.322 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2024-09-13T18:44:32.379 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:44:32.379 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:44:32.379 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-13T18:44:32.379 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:44:32.379 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:44:32.379 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-13 18:44:18.664199162 +0000 2024-09-13T18:44:32.379 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-13 18:42:28.833937824 +0000 2024-09-13T18:44:32.379 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-13 18:42:28.833937824 +0000 2024-09-13T18:44:32.379 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-13 18:42:28.833937824 +0000 2024-09-13T18:44:32.380 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:44:32.443 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-13T18:44:32.443 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-13T18:44:32.443 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000104898 s, 4.9 MB/s 2024-09-13T18:44:32.445 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:44:32.502 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2024-09-13T18:44:32.558 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:44:32.558 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:44:32.558 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-13T18:44:32.558 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:44:32.558 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:44:32.558 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-13 18:44:18.664199162 +0000 2024-09-13T18:44:32.559 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-13 18:42:29.168931874 +0000 2024-09-13T18:44:32.559 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-13 18:42:29.168931874 +0000 2024-09-13T18:44:32.559 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-13 18:42:29.168931874 +0000 2024-09-13T18:44:32.559 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:44:32.622 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-13T18:44:32.622 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-13T18:44:32.622 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 9.6269e-05 s, 5.3 MB/s 2024-09-13T18:44:32.623 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:44:32.680 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2024-09-13T18:44:32.736 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:44:32.736 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:44:32.736 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-13T18:44:32.737 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:44:32.737 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:44:32.737 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-13 18:44:18.664199162 +0000 2024-09-13T18:44:32.737 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-13 18:42:29.536925339 +0000 2024-09-13T18:44:32.737 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-13 18:42:29.536925339 +0000 2024-09-13T18:44:32.737 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-13 18:42:29.536925339 +0000 2024-09-13T18:44:32.737 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:44:32.800 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-13T18:44:32.800 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-13T18:44:32.800 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000101709 s, 5.0 MB/s 2024-09-13T18:44:32.801 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:44:32.858 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2024-09-13T18:44:32.914 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:44:32.915 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:44:32.915 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-13T18:44:32.915 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:44:32.915 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:44:32.915 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-13 18:44:18.665199144 +0000 2024-09-13T18:44:32.916 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-13 18:42:29.871919389 +0000 2024-09-13T18:44:32.916 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-13 18:42:29.871919389 +0000 2024-09-13T18:44:32.916 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-13 18:42:29.871919389 +0000 2024-09-13T18:44:32.916 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:44:32.978 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-13T18:44:32.978 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-13T18:44:32.978 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 8.7722e-05 s, 5.8 MB/s 2024-09-13T18:44:32.979 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:44:33.035 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:33.036 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:44:33.036 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:44:33.053 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:44:33.053 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2024-09-13T18:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-13T18:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-13 18:44:09.719699666 +0000 2024-09-13T18:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-13 18:42:18.136972616 +0000 2024-09-13T18:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-13 18:42:18.136972616 +0000 2024-09-13T18:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-09-13 18:42:18.136972616 +0000 2024-09-13T18:44:33.109 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:44:33.174 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-13T18:44:33.174 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-13T18:44:33.174 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000209947 s, 2.4 MB/s 2024-09-13T18:44:33.175 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:44:33.231 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2024-09-13T18:44:33.287 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:44:33.288 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:44:33.288 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-13T18:44:33.288 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:44:33.288 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:44:33.288 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-13 18:44:09.720699643 +0000 2024-09-13T18:44:33.288 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-13 18:42:18.464964957 +0000 2024-09-13T18:44:33.288 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-13 18:42:18.464964957 +0000 2024-09-13T18:44:33.288 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-09-13 18:42:18.464964957 +0000 2024-09-13T18:44:33.288 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:44:33.350 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-13T18:44:33.350 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-13T18:44:33.350 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000170993 s, 3.0 MB/s 2024-09-13T18:44:33.351 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:44:33.407 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2024-09-13T18:44:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:44:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:44:33.462 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-13T18:44:33.462 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:44:33.463 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:44:33.463 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-13 18:44:09.720699643 +0000 2024-09-13T18:44:33.463 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-13 18:42:18.785957462 +0000 2024-09-13T18:44:33.463 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-13 18:42:18.785957462 +0000 2024-09-13T18:44:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-09-13 18:42:18.785957462 +0000 2024-09-13T18:44:33.463 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:44:33.525 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-13T18:44:33.525 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-13T18:44:33.525 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000172901 s, 3.0 MB/s 2024-09-13T18:44:33.526 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:44:33.581 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2024-09-13T18:44:33.637 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:44:33.637 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:44:33.637 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-13T18:44:33.637 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:44:33.637 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:44:33.638 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-13 18:44:09.720699643 +0000 2024-09-13T18:44:33.638 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-13 18:42:19.106949966 +0000 2024-09-13T18:44:33.638 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-13 18:42:19.106949966 +0000 2024-09-13T18:44:33.638 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-09-13 18:42:19.106949966 +0000 2024-09-13T18:44:33.638 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:44:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-13T18:44:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-13T18:44:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000213121 s, 2.4 MB/s 2024-09-13T18:44:33.702 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:44:33.759 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:33.759 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:44:33.759 INFO:tasks.ceph:Generating config... 2024-09-13T18:44:33.761 INFO:tasks.ceph:[client] client acl type = posix_acl 2024-09-13T18:44:33.761 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T18:44:33.761 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T18:44:33.761 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T18:44:33.761 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T18:44:33.761 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T18:44:33.761 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T18:44:33.761 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T18:44:33.761 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T18:44:33.761 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T18:44:33.761 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T18:44:33.762 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T18:44:33.762 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T18:44:33.763 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T18:44:33.764 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T18:44:33.764 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T18:44:33.836 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T18:44:33.839 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T18:44:33.886 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:44:33.913 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29'), ('mon.b', '172.21.15.96'), ('mon.c', '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]')] 2024-09-13T18:44:33.913 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T18:44:33.914 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:44:33.914 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:44:33.969 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --add b 172.21.15.96 --addv c '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:34.057 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:34.057 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid 41f49ea7-93ea-4289-a814-d28f860525af 2024-09-13T18:44:34.057 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = pacific 2024-09-13T18:44:34.057 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2024-09-13T18:44:34.057 INFO:teuthology.orchestra.run.smithi029.stdout:fsid 41f49ea7-93ea-4289-a814-d28f860525af 2024-09-13T18:44:34.057 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2024-09-13T18:44:34.055475+0000 2024-09-13T18:44:34.057 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-09-13T18:44:34.055475+0000 2024-09-13T18:44:34.057 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 16 (pacific) 2024-09-13T18:44:34.057 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2024-09-13T18:44:34.058 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-13T18:44:34.058 INFO:teuthology.orchestra.run.smithi029.stdout:1: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.b 2024-09-13T18:44:34.058 INFO:teuthology.orchestra.run.smithi029.stdout:2: [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] mon.c 2024-09-13T18:44:34.058 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T18:44:34.059 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:44:34.074 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 41f49ea7-93ea-4289-a814-d28f860525af... 2024-09-13T18:44:34.075 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:44:34.117 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:44:34.161 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2024-09-13T18:44:34.161 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2024-09-13T18:44:34.161 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:44:34.161 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2024-09-13T18:44:34.161 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2024-09-13T18:44:34.162 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2024-09-13T18:44:34.163 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2024-09-13T18:44:34.164 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.29,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]" 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = 41f49ea7-93ea-4289-a814-d28f860525af 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.165 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore compression mode = aggressive 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 20 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 20 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 10 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:44:34.167 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: osd op complaint time = 180 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2024-09-13T18:44:34.168 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.169 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: mon op complaint time = 120 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on pool no app = False 2024-09-13T18:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout: client acl type = posix_acl 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout: client mount timeout = 600 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout: rados mon op timeout = 900 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout: rados osd op timeout = 900 2024-09-13T18:44:34.171 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout:[mds] 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds = 20 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds balancer = 20 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout: mds debug frag = True 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout: mds debug scatterstat = True 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout: mds op complaint time = 180 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout: mds verify scatter = True 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout: osd op complaint time = 180 2024-09-13T18:44:34.172 INFO:teuthology.orchestra.run.smithi096.stdout: rados mon op timeout = 900 2024-09-13T18:44:34.173 INFO:teuthology.orchestra.run.smithi096.stdout: rados osd op timeout = 900 2024-09-13T18:44:34.173 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-09-13T18:44:34.173 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2024-09-13T18:44:34.173 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:44:34.173 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2024-09-13T18:44:34.173 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.173 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.174 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:44:34.175 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]" 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = 41f49ea7-93ea-4289-a814-d28f860525af 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.176 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.177 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2024-09-13T18:44:34.178 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore compression mode = aggressive 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 20 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 20 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 10 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2024-09-13T18:44:34.179 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-09-13T18:44:34.180 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.181 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on pool no app = False 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2024-09-13T18:44:34.182 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout: client acl type = posix_acl 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2024-09-13T18:44:34.183 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2024-09-13T18:44:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds balancer = 20 2024-09-13T18:44:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-09-13T18:44:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2024-09-13T18:44:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = True 2024-09-13T18:44:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2024-09-13T18:44:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = True 2024-09-13T18:44:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2024-09-13T18:44:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2024-09-13T18:44:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2024-09-13T18:44:34.185 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T18:44:34.186 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T18:44:34.281 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T18:44:34.282 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:44:34.282 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T18:44:34.297 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:44:34.297 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T18:44:34.353 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:44:34.353 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:44:34.354 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:44:34.354 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:44:34.431 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:44:34.431 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:34.487 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2024-09-13T18:44:34.487 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:44:34.487 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:44:34.487 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:44:34.522 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:44:34.522 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:34.578 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T18:44:34.578 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T18:44:34.578 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:44:34.635 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:44:34.638 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:44:34.692 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:44:34.695 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T18:44:34.695 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:44:34.749 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:44:34.751 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T18:44:34.777 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:44:34.827 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:44:34.830 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T18:44:34.854 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T18:44:34.855 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:44:34.897 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T18:44:34.910 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T18:44:34.910 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:44:34.911 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T18:44:34.976 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:34.976 INFO:tasks.ceph:role: osd.0 2024-09-13T18:44:34.976 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:44:34.976 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:44:35.041 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:44:35.041 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:44:35.041 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:44:35.041 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:44:35.041 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:44:35.041 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:44:35.042 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:44:35.042 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:44:35.042 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:44:35.042 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:44:35.073 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-09-13T18:44:35.075 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-09-13T18:44:35.075 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T18:44:35.146 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T18:44:35.217 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T18:44:35.284 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:35.284 INFO:tasks.ceph:role: osd.1 2024-09-13T18:44:35.284 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:44:35.284 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:44:35.349 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:44:35.350 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:44:35.350 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:44:35.350 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:44:35.350 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:44:35.350 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:44:35.350 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:44:35.350 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:44:35.350 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:44:35.350 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:44:35.382 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-09-13T18:44:35.384 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-09-13T18:44:35.384 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T18:44:35.456 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T18:44:35.532 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T18:44:35.600 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:35.600 INFO:tasks.ceph:role: osd.2 2024-09-13T18:44:35.600 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:44:35.600 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:44:35.666 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:44:35.666 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:44:35.666 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:44:35.666 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:44:35.667 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:44:35.667 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:44:35.667 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:44:35.667 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:44:35.667 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:44:35.667 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:44:35.699 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-09-13T18:44:35.701 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-09-13T18:44:35.701 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T18:44:35.771 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T18:44:35.841 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T18:44:35.907 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:35.907 INFO:tasks.ceph:role: osd.3 2024-09-13T18:44:35.907 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:44:35.907 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:44:35.973 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:44:35.973 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:44:35.973 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:44:35.973 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:44:35.973 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:44:35.973 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:44:35.973 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:44:35.973 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:44:35.974 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:44:35.974 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:44:36.007 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-09-13T18:44:36.007 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-09-13T18:44:36.007 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T18:44:36.077 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T18:44:36.147 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:36.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:36.247+0000 7fa160a18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T18:44:36.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:36.247+0000 7fa160a18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T18:44:36.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:36.247+0000 7fa160a18640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:44:36.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:36.247+0000 7fa160a18640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:44:36.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:36.247+0000 7fa160a18640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:44:36.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:36.248+0000 7fa160a18640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T18:44:39.095 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:44:39.126 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:39.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:39.216+0000 7ff84d60e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T18:44:39.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:39.217+0000 7ff84d60e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T18:44:39.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:39.217+0000 7ff84d60e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:44:39.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:39.217+0000 7ff84d60e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:44:39.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:39.217+0000 7ff84d60e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:44:39.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:39.217+0000 7ff84d60e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T18:44:42.080 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:44:42.110 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:42.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:42.203+0000 7f628702a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T18:44:42.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:42.203+0000 7f628702a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T18:44:42.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:42.203+0000 7f628702a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:44:42.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:42.203+0000 7f628702a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:44:42.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:42.203+0000 7f628702a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:44:42.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:42.203+0000 7f628702a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T18:44:45.051 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:44:45.081 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:45.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:45.171+0000 7fae4ae2e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T18:44:45.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:45.171+0000 7fae4ae2e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T18:44:45.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:45.171+0000 7fae4ae2e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:44:45.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:45.171+0000 7fae4ae2e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:44:45.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:45.171+0000 7fae4ae2e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:44:45.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:44:45.171+0000 7fae4ae2e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T18:44:48.027 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:44:48.059 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T18:44:48.090 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:48.091 INFO:tasks.ceph:role: osd.4 2024-09-13T18:44:48.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-13T18:44:48.091 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:44:48.166 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:44:48.167 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:44:48.167 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:44:48.167 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:44:48.167 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:44:48.167 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:44:48.167 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:44:48.167 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:44:48.167 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:44:48.167 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:44:48.674 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-09-13T18:44:48.677 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-09-13T18:44:48.677 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T18:44:48.810 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T18:44:48.846 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T18:44:48.914 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:48.914 INFO:tasks.ceph:role: osd.5 2024-09-13T18:44:48.914 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-13T18:44:48.915 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:44:48.989 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:44:48.989 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:44:48.989 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:44:48.989 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:44:48.989 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:44:48.989 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:44:48.990 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:44:48.990 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:44:48.990 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:44:48.990 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:44:49.436 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-09-13T18:44:49.439 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-09-13T18:44:49.439 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T18:44:49.533 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T18:44:49.564 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T18:44:49.632 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:49.632 INFO:tasks.ceph:role: osd.6 2024-09-13T18:44:49.632 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-13T18:44:49.632 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:44:49.706 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:44:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:44:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:44:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:44:49.706 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:44:49.706 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:44:49.706 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:44:49.707 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:44:49.707 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:44:49.707 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:44:50.198 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-09-13T18:44:50.201 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-09-13T18:44:50.201 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T18:44:50.337 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T18:44:50.369 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T18:44:50.436 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:50.436 INFO:tasks.ceph:role: osd.7 2024-09-13T18:44:50.436 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-13T18:44:50.437 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:44:50.509 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:44:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:44:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:44:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:44:50.510 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:44:50.510 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:44:50.510 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:44:50.510 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:44:50.511 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:44:50.511 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:44:51.028 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-09-13T18:44:51.030 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-09-13T18:44:51.030 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T18:44:51.180 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T18:44:51.217 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:51.324+0000 7fa193d2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T18:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:51.324+0000 7fa193d2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T18:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:51.324+0000 7fa193d2c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:51.324+0000 7fa193d2c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:51.324+0000 7fa193d2c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:51.325+0000 7fa193d2c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T18:44:54.187 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:44:54.216 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:54.303+0000 7ff39a01b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T18:44:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:54.303+0000 7ff39a01b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T18:44:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:54.303+0000 7ff39a01b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:44:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:54.303+0000 7ff39a01b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:44:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:54.303+0000 7ff39a01b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:44:54.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:54.304+0000 7ff39a01b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T18:44:57.171 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:44:57.199 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:57.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:57.288+0000 7f095a4d6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T18:44:57.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:57.288+0000 7f095a4d6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T18:44:57.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:57.288+0000 7f095a4d6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:44:57.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:57.288+0000 7f095a4d6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:44:57.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:57.288+0000 7f095a4d6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:44:57.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:44:57.288+0000 7f095a4d6640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T18:45:00.159 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T18:45:00.188 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:45:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:00.275+0000 7f5dbae16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T18:45:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:00.275+0000 7f5dbae16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T18:45:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:00.275+0000 7f5dbae16640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:45:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:00.275+0000 7f5dbae16640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:45:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:00.275+0000 7f5dbae16640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:45:00.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:00.276+0000 7f5dbae16640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T18:45:02.184 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:02.188 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:03.124 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T18:45:03.150 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T18:45:03.150 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:03.150 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T18:45:03.182 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:03.182 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T18:45:03.252 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:03.252 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T18:45:03.321 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:03.321 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T18:45:03.389 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:03.389 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T18:45:03.457 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:03.457 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T18:45:03.524 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:45:03.524 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T18:45:03.553 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:45:03.553 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T18:45:03.621 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:45:03.621 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T18:45:03.687 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:45:03.687 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T18:45:03.753 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:45:03.753 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T18:45:03.818 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:45:03.818 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T18:45:03.882 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:03.883 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T18:45:03.900 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T18:45:03.901 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:45:03.944 DEBUG:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:45:03.967 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2024-09-13T18:45:03.968 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQASiORm3J7OJRAAwYcIMxrKCBSapFNqQHREvQ== 2024-09-13T18:45:03.968 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-09-13T18:45:03.968 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQASiORmqVmNLBAAafgOiQfk8DzftKjGAmaXOQ== 2024-09-13T18:45:03.968 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2024-09-13T18:45:03.968 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAUiORmv47QDhAA4PrlKTH6OgHTwhn61jQxCA== 2024-09-13T18:45:03.968 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2024-09-13T18:45:03.968 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAXiORmqO75DBAALrORfOhRZUwN9GiFMBqZcQ== 2024-09-13T18:45:03.968 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAaiORmAAQpDBAAKHMf6KV6/sExPPiPCRvj0w== 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.3] 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAdiORmgzxFChAAhKItkOXb48zBePj3o6El0A== 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQASiORmPKw0KRAAcZLmhGYZ/6RXkrEC+8VFvQ== 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQASiORmeiZAMRAAOLg2Zot9AL3Zyo8Yhq0nug== 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.4] 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAjiORmablhExAAEhIr7BqwcB7Yfyx0LasXFA== 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.5] 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAmiORmniUkEhAA06uF1IcPLpfibaBwsbfK4A== 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.6] 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQApiORm9jE3ERAAqQ1h9nEmyMoIqVho6LryZg== 2024-09-13T18:45:03.969 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.7] 2024-09-13T18:45:03.970 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAsiORmWZl3EBAAvsK1Yt/KJGaU1fxZuvfrAg== 2024-09-13T18:45:03.970 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-09-13T18:45:03.970 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQASiORmA95qNRAAyFQ+7kVVh2LlfweB/G262g== 2024-09-13T18:45:03.971 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2024-09-13T18:45:03.971 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQASiORm3J7OJRAAwYcIMxrKCBSapFNqQHREvQ== 2024-09-13T18:45:03.971 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-09-13T18:45:03.971 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQASiORmqVmNLBAAafgOiQfk8DzftKjGAmaXOQ== 2024-09-13T18:45:03.971 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2024-09-13T18:45:03.971 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAUiORmv47QDhAA4PrlKTH6OgHTwhn61jQxCA== 2024-09-13T18:45:03.971 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2024-09-13T18:45:03.971 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAXiORmqO75DBAALrORfOhRZUwN9GiFMBqZcQ== 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAaiORmAAQpDBAAKHMf6KV6/sExPPiPCRvj0w== 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAdiORmgzxFChAAhKItkOXb48zBePj3o6El0A== 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQASiORmPKw0KRAAcZLmhGYZ/6RXkrEC+8VFvQ== 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQASiORmeiZAMRAAOLg2Zot9AL3Zyo8Yhq0nug== 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.4] 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAjiORmablhExAAEhIr7BqwcB7Yfyx0LasXFA== 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.5] 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAmiORmniUkEhAA06uF1IcPLpfibaBwsbfK4A== 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.6] 2024-09-13T18:45:03.972 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQApiORm9jE3ERAAqQ1h9nEmyMoIqVho6LryZg== 2024-09-13T18:45:03.973 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.7] 2024-09-13T18:45:03.973 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAsiORmWZl3EBAAvsK1Yt/KJGaU1fxZuvfrAg== 2024-09-13T18:45:03.973 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-09-13T18:45:03.973 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQASiORmA95qNRAAyFQ+7kVVh2LlfweB/G262g== 2024-09-13T18:45:03.973 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:45:04.014 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:45:04.066 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:45:04.068 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:45:04.122 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.124 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.175 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.178 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.228 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.230 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.280 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.283 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.333 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:45:04.336 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:45:04.386 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:45:04.389 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:45:04.442 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.444 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.495 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.497 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.547 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.549 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.600 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.602 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:45:04.652 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:45:04.655 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:45:04.708 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T18:45:04.708 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T18:45:04.734 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:45:04.832 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T18:45:04.857 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T18:45:04.883 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:45:04.979 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T18:45:05.004 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T18:45:05.068 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:45:05.163 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T18:45:05.187 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:45:05.190 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:45:05.243 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T18:45:05.243 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:45:05.243 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:45:05.246 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:45:05.246 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T18:45:05.246 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T18:45:05.285 INFO:tasks.ceph.mon.b:Started 2024-09-13T18:45:05.285 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T18:45:05.286 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T18:45:05.287 INFO:tasks.ceph.mon.c:Started 2024-09-13T18:45:05.287 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T18:45:05.288 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T18:45:05.288 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T18:45:05.292 INFO:tasks.ceph.mgr.y:Started 2024-09-13T18:45:05.292 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T18:45:05.292 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T18:45:05.294 INFO:tasks.ceph.mgr.x:Started 2024-09-13T18:45:05.295 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T18:45:05.295 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T18:45:05.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.394+0000 7fe059745640 1 Processor -- start 2024-09-13T18:45:05.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.394+0000 7fe059745640 1 -- start start 2024-09-13T18:45:05.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.395+0000 7fe059745640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05413f680 0x7fe05413fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.395+0000 7fe059745640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0540b4690 con 0x7fe0540b42b0 2024-09-13T18:45:05.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.395+0000 7fe059745640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0540b5610 con 0x7fe05414e380 2024-09-13T18:45:05.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.395+0000 7fe059745640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe054146a30 con 0x7fe05413f680 2024-09-13T18:45:05.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.395+0000 7fe052ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe0540b42b0 0x7fe054146320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36546/0 (socket says 172.21.15.29:36546) 2024-09-13T18:45:05.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.395+0000 7fe052ffd640 1 -- 172.21.15.29:0/197960758 learned_addr learned my addr 172.21.15.29:0/197960758 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:05.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.395+0000 7fe0527fc640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05413f680 0x7fe05413fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.395+0000 7fe0527fc640 1 -- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05413f680 msgr2=0x7fe05413fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:45:05.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.395+0000 7fe0527fc640 1 -- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05413f680 msgr2=0x7fe05413fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:45:05.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.395+0000 7fe0527fc640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05413f680 0x7fe05413fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:45:05.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.395+0000 7fe0527fc640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05413f680 0x7fe05413fae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:45:05.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559330588 0 0) 0x7fe0540b4690 con 0x7fe0540b42b0 2024-09-13T18:45:05.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe03c003520 con 0x7fe0540b42b0 2024-09-13T18:45:05.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2325396658 0 0) 0x7fe03c003520 con 0x7fe0540b42b0 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05413f680 msgr2=0x7fe05413fae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05413f680 0x7fe05413fae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 >> v1:172.21.15.96:6789/0 conn(0x7fe05414e380 legacy=0x7fe054150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0540b35f0 con 0x7fe0540b42b0 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7fe044001670 con 0x7fe0540b42b0 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 >> v1:172.21.15.29:6789/0 conn(0x7fe0540b42b0 legacy=0x7fe054146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe03c0039a0 0x7fe03c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05413f680 0x7fe03c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c004d00 0x7fe03c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe054146a30 con 0x7fe03c004d00 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c00bb90 con 0x7fe03c0039a0 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.556+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c00bd50 con 0x7fe05413f680 2024-09-13T18:45:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.557+0000 7fe052ffd640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe03c0039a0 0x7fe03c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.557+0000 7fe0537fe640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c004d00 0x7fe03c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.557+0000 7fe0527fc640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05413f680 0x7fe03c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.557+0000 7fe0537fe640 1 -- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05413f680 msgr2=0x7fe03c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:05.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.557+0000 7fe0537fe640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05413f680 0x7fe03c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.557+0000 7fe0537fe640 1 -- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe03c0039a0 msgr2=0x7fe03c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:05.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.557+0000 7fe0537fe640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe03c0039a0 0x7fe03c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.557+0000 7fe0537fe640 1 -- 172.21.15.29:0/197960758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c003520 con 0x7fe03c004d00 2024-09-13T18:45:05.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.558+0000 7fe0537fe640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c004d00 0x7fe03c005180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe04c001e50 tx=0x7fe03c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaffd8fb9a31c6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:05.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.558+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c02ae70 con 0x7fe03c004d00 2024-09-13T18:45:05.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.558+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c003970 con 0x7fe03c004d00 2024-09-13T18:45:05.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.558+0000 7fe051ffb640 1 -- 172.21.15.29:0/197960758 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c003d20 con 0x7fe03c004d00 2024-09-13T18:45:05.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.558+0000 7fe059745640 1 -- 172.21.15.29:0/197960758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c004d00 msgr2=0x7fe03c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.558+0000 7fe059745640 1 --2- 172.21.15.29:0/197960758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c004d00 0x7fe03c005180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe04c001e50 tx=0x7fe03c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.558+0000 7fe0537fe640 1 -- 172.21.15.29:0/197960758 reap_dead start 2024-09-13T18:45:05.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.559+0000 7fe059745640 1 -- 172.21.15.29:0/197960758 shutdown_connections 2024-09-13T18:45:05.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.559+0000 7fe059745640 1 -- 172.21.15.29:0/197960758 >> 172.21.15.29:0/197960758 conn(0x7fe054071df0 msgr2=0x7fe0540bb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.559+0000 7fe059745640 1 -- 172.21.15.29:0/197960758 shutdown_connections 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.559+0000 7fe059745640 1 -- 172.21.15.29:0/197960758 wait complete. 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.560+0000 7fe059745640 1 Processor -- start 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.560+0000 7fe059745640 1 -- start start 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe059745640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c004d00 0x7fe054131b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe059745640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe054141be0 0x7fe0541de8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe059745640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe0540b98d0 0x7fe0540b9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe059745640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540bb030 con 0x7fe03c004d00 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe059745640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540bb310 con 0x7fe054141be0 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe059745640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe054142060 con 0x7fe0540b98d0 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe052ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c004d00 0x7fe054131b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe052ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c004d00 0x7fe054131b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37486/0 (socket says 172.21.15.29:37486) 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe052ffd640 1 -- 172.21.15.29:0/1663247100 learned_addr learned my addr 172.21.15.29:0/1663247100 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe0527fc640 1 --2- 172.21.15.29:0/1663247100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe054141be0 0x7fe0541de8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe0537fe640 1 --2- 172.21.15.29:0/1663247100 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe0540b98d0 0x7fe0540b9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe052ffd640 1 -- 172.21.15.29:0/1663247100 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe0540b98d0 msgr2=0x7fe0540b9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe052ffd640 1 --2- 172.21.15.29:0/1663247100 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe0540b98d0 0x7fe0540b9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe052ffd640 1 -- 172.21.15.29:0/1663247100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe054141be0 msgr2=0x7fe0541de8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe052ffd640 1 --2- 172.21.15.29:0/1663247100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe054141be0 0x7fe0541de8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe052ffd640 1 -- 172.21.15.29:0/1663247100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0540b5fa0 con 0x7fe03c004d00 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe052ffd640 1 --2- 172.21.15.29:0/1663247100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c004d00 0x7fe054131b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe0440072f0 tx=0x7fe0440077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe03b7fe640 1 -- 172.21.15.29:0/1663247100 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400f8e0 con 0x7fe03c004d00 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe03b7fe640 1 -- 172.21.15.29:0/1663247100 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400fa40 con 0x7fe03c004d00 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe03b7fe640 1 -- 172.21.15.29:0/1663247100 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400fdd0 con 0x7fe03c004d00 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe059745640 1 -- 172.21.15.29:0/1663247100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe054142330 con 0x7fe03c004d00 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.561+0000 7fe059745640 1 -- 172.21.15.29:0/1663247100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe054143170 con 0x7fe03c004d00 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.562+0000 7fe03b7fe640 1 -- 172.21.15.29:0/1663247100 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe04401d760 con 0x7fe03c004d00 2024-09-13T18:45:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.562+0000 7fe03b7fe640 1 -- 172.21.15.29:0/1663247100 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe044013830 con 0x7fe03c004d00 2024-09-13T18:45:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.562+0000 7fe059745640 1 -- 172.21.15.29:0/1663247100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe054143330 con 0x7fe03c004d00 2024-09-13T18:45:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.565+0000 7fe03b7fe640 1 -- 172.21.15.29:0/1663247100 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe054143330 con 0x7fe03c004d00 2024-09-13T18:45:05.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.630+0000 7fe059745640 1 -- 172.21.15.29:0/1663247100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe0540b38e0 con 0x7fe03c004d00 2024-09-13T18:45:05.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.633+0000 7fe03b7fe640 1 -- 172.21.15.29:0/1663247100 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe044013a40 con 0x7fe03c004d00 2024-09-13T18:45:05.635 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-09-13T18:45:05.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.634+0000 7fe059745640 1 -- 172.21.15.29:0/1663247100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c004d00 msgr2=0x7fe054131b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.634+0000 7fe059745640 1 --2- 172.21.15.29:0/1663247100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c004d00 0x7fe054131b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe0440072f0 tx=0x7fe0440077b0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.634+0000 7fe059745640 1 -- 172.21.15.29:0/1663247100 shutdown_connections 2024-09-13T18:45:05.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.634+0000 7fe059745640 1 --2- 172.21.15.29:0/1663247100 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe0540b98d0 0x7fe0540b9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.634+0000 7fe059745640 1 --2- 172.21.15.29:0/1663247100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe054141be0 0x7fe0541de8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.634+0000 7fe059745640 1 --2- 172.21.15.29:0/1663247100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c004d00 0x7fe054131b90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.634+0000 7fe059745640 1 -- 172.21.15.29:0/1663247100 >> 172.21.15.29:0/1663247100 conn(0x7fe054071df0 msgr2=0x7fe0540b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:05.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.634+0000 7fe059745640 1 -- 172.21.15.29:0/1663247100 shutdown_connections 2024-09-13T18:45:05.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:05.634+0000 7fe059745640 1 -- 172.21.15.29:0/1663247100 wait complete. 2024-09-13T18:45:05.647 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T18:45:05.647 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T18:45:05.647 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:05.647 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T18:45:05.663 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:05.661+0000 7f99e3523040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:45:05.673 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:05.673 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T18:45:05.674 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:05.672+0000 7f0533216040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:45:05.699 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:05.699 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T18:45:05.703 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:05.701+0000 7f99e3523040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:45:05.718 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:05.716+0000 7f0533216040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:45:05.743 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:05.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T18:45:05.809 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:45:05.809 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T18:45:05.835 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:45:05.835 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T18:45:05.849 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:05.847+0000 7f99e3523040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:45:05.867 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:05.865+0000 7f0533216040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:45:05.873 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:45:05.873 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T18:45:05.901 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:05.899+0000 7f99e3523040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:45:05.920 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:05.917+0000 7f0533216040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:45:05.925 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-13T18:45:05.925 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T18:45:05.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new b3adb7e9-f0fd-4244-a0f1-468ccddc384d 0 2024-09-13T18:45:06.068 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:06.066+0000 7f99e3523040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:45:06.092 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:06.090+0000 7f0533216040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:45:06.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.126+0000 7fc7be2b1640 1 Processor -- start 2024-09-13T18:45:06.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.126+0000 7fc7be2b1640 1 -- start start 2024-09-13T18:45:06.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7be2b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc7b80b0f50 0x7fc7b80b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7be2b1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc7b814c0b0 0x7fc7b814e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7be2b1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b80b91a0 con 0x7fc7b80b8dc0 2024-09-13T18:45:06.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7be2b1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b80b4d80 con 0x7fc7b814c0b0 2024-09-13T18:45:06.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7be2b1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b80b18f0 con 0x7fc7b80b0f50 2024-09-13T18:45:06.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7affff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc7b80b0f50 0x7fc7b80b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7bc84e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc7b814c0b0 0x7fc7b814e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7b7fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc7b80b8dc0 0x7fc7b813d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:49152/0 (socket says 172.21.15.96:49152) 2024-09-13T18:45:06.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7b7fff640 1 -- 172.21.15.96:0/3966521698 learned_addr learned my addr 172.21.15.96:0/3966521698 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-13T18:45:06.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7b77fe640 1 -- 172.21.15.96:0/3966521698 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288225297 0 0) 0x7fc7b80b91a0 con 0x7fc7b80b8dc0 2024-09-13T18:45:06.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7b77fe640 1 -- 172.21.15.96:0/3966521698 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7a4003520 con 0x7fc7b80b8dc0 2024-09-13T18:45:06.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7bc84e640 1 -- 172.21.15.96:0/3966521698 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc7b80b0f50 msgr2=0x7fc7b80b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:06.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7bc84e640 1 --2- 172.21.15.96:0/3966521698 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc7b80b0f50 0x7fc7b80b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7bc84e640 1 -- 172.21.15.96:0/3966521698 >> v1:172.21.15.96:6789/0 conn(0x7fc7b80b8dc0 legacy=0x7fc7b813d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7bc84e640 1 -- 172.21.15.96:0/3966521698 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b813dff0 con 0x7fc7b814c0b0 2024-09-13T18:45:06.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.127+0000 7fc7affff640 1 --2- 172.21.15.96:0/3966521698 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc7b80b0f50 0x7fc7b80b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.128+0000 7fc7bc84e640 1 --2- 172.21.15.96:0/3966521698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7b814c0b0 0x7fc7b814e4a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009dc0 tx=0x7fc7b002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44a1be179b08464a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.129+0000 7fc7b77fe640 1 -- 172.21.15.96:0/3966521698 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0007740 con 0x7fc7b814c0b0 2024-09-13T18:45:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.129+0000 7fc7b77fe640 1 -- 172.21.15.96:0/3966521698 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b002d050 con 0x7fc7b814c0b0 2024-09-13T18:45:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.129+0000 7fc7b77fe640 1 -- 172.21.15.96:0/3966521698 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0007ac0 con 0x7fc7b814c0b0 2024-09-13T18:45:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.129+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3966521698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7b814c0b0 msgr2=0x7fc7b814e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.129+0000 7fc7be2b1640 1 --2- 172.21.15.96:0/3966521698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7b814c0b0 0x7fc7b814e4a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009dc0 tx=0x7fc7b002a5f0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.129+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3966521698 shutdown_connections 2024-09-13T18:45:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.129+0000 7fc7be2b1640 1 --2- 172.21.15.96:0/3966521698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7b814c0b0 0x7fc7b814e4a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.129+0000 7fc7be2b1640 1 --2- 172.21.15.96:0/3966521698 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc7b80b0f50 0x7fc7b80b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.129+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3966521698 >> 172.21.15.96:0/3966521698 conn(0x7fc7b806b610 msgr2=0x7fc7b80b8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.129+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3966521698 shutdown_connections 2024-09-13T18:45:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.129+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3966521698 wait complete. 2024-09-13T18:45:06.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.130+0000 7fc7be2b1640 1 Processor -- start 2024-09-13T18:45:06.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.130+0000 7fc7be2b1640 1 -- start start 2024-09-13T18:45:06.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7be2b1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7b80b0f50 0x7fc7b81dc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7be2b1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7b80b8dc0 0x7fc7b813e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7be2b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc7b814c0b0 0x7fc7b813eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7be2b1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8138340 con 0x7fc7b80b8dc0 2024-09-13T18:45:06.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7be2b1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b81dcae0 con 0x7fc7b80b0f50 2024-09-13T18:45:06.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7be2b1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8140ed0 con 0x7fc7b814c0b0 2024-09-13T18:45:06.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7b7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7b80b0f50 0x7fc7b81dc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7b7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7b80b0f50 0x7fc7b81dc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35388/0 (socket says 172.21.15.96:35388) 2024-09-13T18:45:06.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7b7fff640 1 -- 172.21.15.96:0/3411189726 learned_addr learned my addr 172.21.15.96:0/3411189726 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-13T18:45:06.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7bc84e640 1 --2- 172.21.15.96:0/3411189726 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc7b814c0b0 0x7fc7b813eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7affff640 1 --2- 172.21.15.96:0/3411189726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7b80b8dc0 0x7fc7b813e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7b7fff640 1 -- 172.21.15.96:0/3411189726 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc7b814c0b0 msgr2=0x7fc7b813eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7b7fff640 1 --2- 172.21.15.96:0/3411189726 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc7b814c0b0 0x7fc7b813eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7b7fff640 1 -- 172.21.15.96:0/3411189726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7b80b8dc0 msgr2=0x7fc7b813e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7b7fff640 1 --2- 172.21.15.96:0/3411189726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7b80b8dc0 0x7fc7b813e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.131+0000 7fc7b7fff640 1 -- 172.21.15.96:0/3411189726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a0009400 con 0x7fc7b80b0f50 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.132+0000 7fc7b7fff640 1 --2- 172.21.15.96:0/3411189726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7b80b0f50 0x7fc7b81dc5a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800c530 tx=0x7fc7a800c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.132+0000 7fc7b57fa640 1 -- 172.21.15.96:0/3411189726 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8005ce0 con 0x7fc7b80b0f50 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.132+0000 7fc7b57fa640 1 -- 172.21.15.96:0/3411189726 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a8005e40 con 0x7fc7b80b0f50 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.132+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3411189726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b0009a70 con 0x7fc7b80b0f50 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.132+0000 7fc7b57fa640 1 -- 172.21.15.96:0/3411189726 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80072b0 con 0x7fc7b80b0f50 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.132+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3411189726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b8137f60 con 0x7fc7b80b0f50 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.132+0000 7fc7b57fa640 1 -- 172.21.15.96:0/3411189726 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc7a801c440 con 0x7fc7b80b0f50 2024-09-13T18:45:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.132+0000 7fc7b57fa640 1 -- 172.21.15.96:0/3411189726 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc7a8012850 con 0x7fc7b80b0f50 2024-09-13T18:45:06.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.133+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3411189726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b80b05b0 con 0x7fc7b80b0f50 2024-09-13T18:45:06.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.135+0000 7fc7b57fa640 1 -- 172.21.15.96:0/3411189726 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fc7a8017070 con 0x7fc7b80b0f50 2024-09-13T18:45:06.183 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:06.181+0000 7f99e3523040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:45:06.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.203+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3411189726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b3adb7e9-f0fd-4244-a0f1-468ccddc384d", "id": 0} v 0) v1 -- 0x7fc7b80b3cf0 con 0x7fc7b80b0f50 2024-09-13T18:45:06.208 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:06.206+0000 7f0533216040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:45:06.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.208+0000 7fc7b57fa640 1 -- 172.21.15.96:0/3411189726 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b3adb7e9-f0fd-4244-a0f1-468ccddc384d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc7a8012b30 con 0x7fc7b80b0f50 2024-09-13T18:45:06.211 INFO:teuthology.orchestra.run.smithi096.stdout:0 2024-09-13T18:45:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.209+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3411189726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7b80b0f50 msgr2=0x7fc7b81dc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.209+0000 7fc7be2b1640 1 --2- 172.21.15.96:0/3411189726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7b80b0f50 0x7fc7b81dc5a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800c530 tx=0x7fc7a800c9f0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.209+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3411189726 shutdown_connections 2024-09-13T18:45:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.209+0000 7fc7be2b1640 1 --2- 172.21.15.96:0/3411189726 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc7b814c0b0 0x7fc7b813eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.209+0000 7fc7be2b1640 1 --2- 172.21.15.96:0/3411189726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7b80b8dc0 0x7fc7b813e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.209+0000 7fc7be2b1640 1 --2- 172.21.15.96:0/3411189726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7b80b0f50 0x7fc7b81dc5a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.209+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3411189726 >> 172.21.15.96:0/3411189726 conn(0x7fc7b806b610 msgr2=0x7fc7b8139510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.209+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3411189726 shutdown_connections 2024-09-13T18:45:06.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.209+0000 7fc7be2b1640 1 -- 172.21.15.96:0/3411189726 wait complete. 2024-09-13T18:45:06.222 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 5d5ac46e-c9d1-4d68-a145-1338dc5d9143 1 2024-09-13T18:45:06.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.359+0000 7f35675d5640 1 Processor -- start 2024-09-13T18:45:06.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.359+0000 7f35675d5640 1 -- start start 2024-09-13T18:45:06.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f35675d5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f35600b8dc0 0x7f356006ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f35675d5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 0x7f3560071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f35675d5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35600b41b0 con 0x7f356013f890 2024-09-13T18:45:06.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f35675d5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3560070980 con 0x7f35600b8dc0 2024-09-13T18:45:06.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f35675d5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35600b91a0 con 0x7f3560071ae0 2024-09-13T18:45:06.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f3564b70640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 0x7f3560071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f3565b72640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f356013f890 0x7f356013fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:49166/0 (socket says 172.21.15.96:49166) 2024-09-13T18:45:06.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f3565b72640 1 -- 172.21.15.96:0/2524468898 learned_addr learned my addr 172.21.15.96:0/2524468898 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-13T18:45:06.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f3565371640 1 --2- 172.21.15.96:0/2524468898 >> v2:172.21.15.29:3300/0 conn(0x7f35600b8dc0 0x7f356006ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f3557fff640 1 -- 172.21.15.96:0/2524468898 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012813717 0 0) 0x7f35600b41b0 con 0x7f356013f890 2024-09-13T18:45:06.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f3564b70640 1 -- 172.21.15.96:0/2524468898 >> v2:172.21.15.29:3300/0 conn(0x7f35600b8dc0 msgr2=0x7f356006ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:06.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f3564b70640 1 --2- 172.21.15.96:0/2524468898 >> v2:172.21.15.29:3300/0 conn(0x7f35600b8dc0 0x7f356006ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f3564b70640 1 -- 172.21.15.96:0/2524468898 >> v1:172.21.15.96:6789/0 conn(0x7f356013f890 legacy=0x7f356013fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.360+0000 7f3564b70640 1 -- 172.21.15.96:0/2524468898 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35600b4d10 con 0x7f3560071ae0 2024-09-13T18:45:06.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.361+0000 7f3564b70640 1 --2- 172.21.15.96:0/2524468898 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 0x7f3560071f00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f355c0097a0 tx=0x7f355c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cab67d0a7abfe4f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.361+0000 7f3557fff640 1 -- 172.21.15.96:0/2524468898 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c032440 con 0x7f3560071ae0 2024-09-13T18:45:06.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.361+0000 7f3557fff640 1 -- 172.21.15.96:0/2524468898 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c0325a0 con 0x7f3560071ae0 2024-09-13T18:45:06.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.361+0000 7f3557fff640 1 -- 172.21.15.96:0/2524468898 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c032930 con 0x7f3560071ae0 2024-09-13T18:45:06.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.362+0000 7f35675d5640 1 -- 172.21.15.96:0/2524468898 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 msgr2=0x7f3560071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.362+0000 7f35675d5640 1 --2- 172.21.15.96:0/2524468898 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 0x7f3560071f00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f355c0097a0 tx=0x7f355c02a180 comp rx=0 tx=0).stop 2024-09-13T18:45:06.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.362+0000 7f35675d5640 1 -- 172.21.15.96:0/2524468898 shutdown_connections 2024-09-13T18:45:06.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.362+0000 7f35675d5640 1 --2- 172.21.15.96:0/2524468898 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 0x7f3560071f00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.362+0000 7f35675d5640 1 --2- 172.21.15.96:0/2524468898 >> v2:172.21.15.29:3300/0 conn(0x7f35600b8dc0 0x7f356006ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.362+0000 7f35675d5640 1 -- 172.21.15.96:0/2524468898 >> 172.21.15.96:0/2524468898 conn(0x7f356006b610 msgr2=0x7f35600b8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.362+0000 7f35675d5640 1 -- 172.21.15.96:0/2524468898 shutdown_connections 2024-09-13T18:45:06.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.362+0000 7f35675d5640 1 -- 172.21.15.96:0/2524468898 wait complete. 2024-09-13T18:45:06.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.363+0000 7f35675d5640 1 Processor -- start 2024-09-13T18:45:06.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.363+0000 7f35675d5640 1 -- start start 2024-09-13T18:45:06.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.363+0000 7f35675d5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 0x7f3560142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.363+0000 7f35675d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35600b8dc0 0x7f35601de7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.363+0000 7f35675d5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f356013f890 0x7f35601ded20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.363+0000 7f35675d5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600abd40 con 0x7f35600b8dc0 2024-09-13T18:45:06.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.363+0000 7f35675d5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600b2930 con 0x7f356013f890 2024-09-13T18:45:06.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.363+0000 7f35675d5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35600acb90 con 0x7f3560071ae0 2024-09-13T18:45:06.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.363+0000 7f3565371640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 0x7f3560142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3565371640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 0x7f3560142750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:42318/0 (socket says 172.21.15.96:42318) 2024-09-13T18:45:06.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3565371640 1 -- 172.21.15.96:0/2050729463 learned_addr learned my addr 172.21.15.96:0/2050729463 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-13T18:45:06.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3565b72640 1 --2- 172.21.15.96:0/2050729463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f356013f890 0x7f35601ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3564b70640 1 --2- 172.21.15.96:0/2050729463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35600b8dc0 0x7f35601de7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3565371640 1 -- 172.21.15.96:0/2050729463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f356013f890 msgr2=0x7f35601ded20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3565371640 1 --2- 172.21.15.96:0/2050729463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f356013f890 0x7f35601ded20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3565371640 1 -- 172.21.15.96:0/2050729463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35600b8dc0 msgr2=0x7f35601de7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3565371640 1 --2- 172.21.15.96:0/2050729463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35600b8dc0 0x7f35601de7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3565371640 1 -- 172.21.15.96:0/2050729463 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c009400 con 0x7f3560071ae0 2024-09-13T18:45:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3564b70640 1 --2- 172.21.15.96:0/2050729463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35600b8dc0 0x7f35601de7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3565371640 1 --2- 172.21.15.96:0/2050729463 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 0x7f3560142750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f355000d830 tx=0x7f355000dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3555ffb640 1 -- 172.21.15.96:0/2050729463 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000b6c0 con 0x7f3560071ae0 2024-09-13T18:45:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3555ffb640 1 -- 172.21.15.96:0/2050729463 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000b820 con 0x7f3560071ae0 2024-09-13T18:45:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f35675d5640 1 -- 172.21.15.96:0/2050729463 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35600ab9d0 con 0x7f3560071ae0 2024-09-13T18:45:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3555ffb640 1 -- 172.21.15.96:0/2050729463 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000bbb0 con 0x7f3560071ae0 2024-09-13T18:45:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f35675d5640 1 -- 172.21.15.96:0/2050729463 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35600b24a0 con 0x7f3560071ae0 2024-09-13T18:45:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3555ffb640 1 -- 172.21.15.96:0/2050729463 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f355001e760 con 0x7f3560071ae0 2024-09-13T18:45:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.364+0000 7f3555ffb640 1 -- 172.21.15.96:0/2050729463 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f355001edc0 con 0x7f3560071ae0 2024-09-13T18:45:06.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.365+0000 7f35675d5640 1 -- 172.21.15.96:0/2050729463 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3560071f00 con 0x7f3560071ae0 2024-09-13T18:45:06.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.367+0000 7f3555ffb640 1 -- 172.21.15.96:0/2050729463 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f355000bd70 con 0x7f3560071ae0 2024-09-13T18:45:06.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.435+0000 7f35675d5640 1 -- 172.21.15.96:0/2050729463 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5d5ac46e-c9d1-4d68-a145-1338dc5d9143", "id": 1} v 0) v1 -- 0x7f35600b81e0 con 0x7f3560071ae0 2024-09-13T18:45:06.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.438+0000 7f3555ffb640 1 -- 172.21.15.96:0/2050729463 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5d5ac46e-c9d1-4d68-a145-1338dc5d9143", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f355002c0b0 con 0x7f3560071ae0 2024-09-13T18:45:06.441 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-09-13T18:45:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.439+0000 7f35675d5640 1 -- 172.21.15.96:0/2050729463 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 msgr2=0x7f3560142750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.439+0000 7f35675d5640 1 --2- 172.21.15.96:0/2050729463 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 0x7f3560142750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f355000d830 tx=0x7f355000dcf0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.439+0000 7f35675d5640 1 -- 172.21.15.96:0/2050729463 shutdown_connections 2024-09-13T18:45:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.439+0000 7f35675d5640 1 --2- 172.21.15.96:0/2050729463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f356013f890 0x7f35601ded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.439+0000 7f35675d5640 1 --2- 172.21.15.96:0/2050729463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35600b8dc0 0x7f35601de7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.439+0000 7f35675d5640 1 --2- 172.21.15.96:0/2050729463 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3560071ae0 0x7f3560142750 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.439+0000 7f35675d5640 1 -- 172.21.15.96:0/2050729463 >> 172.21.15.96:0/2050729463 conn(0x7f356006b610 msgr2=0x7f356013e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.439+0000 7f35675d5640 1 -- 172.21.15.96:0/2050729463 shutdown_connections 2024-09-13T18:45:06.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.439+0000 7f35675d5640 1 -- 172.21.15.96:0/2050729463 wait complete. 2024-09-13T18:45:06.452 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new ef27cd51-cf7b-4f49-9277-75d870bc33d3 2 2024-09-13T18:45:06.505 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:06.502+0000 7f99e3523040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:45:06.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.547+0000 7f929d85a640 1 Processor -- start 2024-09-13T18:45:06.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.547+0000 7f929d85a640 1 -- start start 2024-09-13T18:45:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.547+0000 7f929d85a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f929813c570 0x7f92981463b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.547+0000 7f929d85a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f92980b5eb0 0x7f92980b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.547+0000 7f929d85a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b3140 0x7f9298149000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.547+0000 7f929d85a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929813c950 con 0x7f929813c570 2024-09-13T18:45:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.547+0000 7f929d85a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980b5990 con 0x7f92980b5eb0 2024-09-13T18:45:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.547+0000 7f929d85a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92980b36b0 con 0x7f92980b3140 2024-09-13T18:45:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.548+0000 7f92967fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f92980b5eb0 0x7f92980b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.548+0000 7f92977fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b3140 0x7f9298149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.548+0000 7f92977fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b3140 0x7f9298149000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:42330/0 (socket says 172.21.15.96:42330) 2024-09-13T18:45:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.548+0000 7f92967fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f92980b5eb0 0x7f92980b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35396/0 (socket says 172.21.15.96:35396) 2024-09-13T18:45:06.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.548+0000 7f92977fe640 1 -- 172.21.15.96:0/471364250 learned_addr learned my addr 172.21.15.96:0/471364250 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-13T18:45:06.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.548+0000 7f9296ffd640 1 --2- 172.21.15.96:0/471364250 >> v2:172.21.15.29:3300/0 conn(0x7f929813c570 0x7f92981463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.548+0000 7f92977fe640 1 -- 172.21.15.96:0/471364250 >> v2:172.21.15.96:3300/0 conn(0x7f92980b5eb0 msgr2=0x7f92980b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:06.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.548+0000 7f92977fe640 1 --2- 172.21.15.96:0/471364250 >> v2:172.21.15.96:3300/0 conn(0x7f92980b5eb0 0x7f92980b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.548+0000 7f92977fe640 1 -- 172.21.15.96:0/471364250 >> v2:172.21.15.29:3300/0 conn(0x7f929813c570 msgr2=0x7f92981463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:06.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.548+0000 7f92977fe640 1 --2- 172.21.15.96:0/471364250 >> v2:172.21.15.29:3300/0 conn(0x7f929813c570 0x7f92981463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.548+0000 7f92977fe640 1 -- 172.21.15.96:0/471364250 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298145bb0 con 0x7f92980b3140 2024-09-13T18:45:06.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.548+0000 7f92967fc640 1 --2- 172.21.15.96:0/471364250 >> v2:172.21.15.96:3300/0 conn(0x7f92980b5eb0 0x7f92980b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:06.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.549+0000 7f92977fe640 1 --2- 172.21.15.96:0/471364250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b3140 0x7f9298149000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f92980b6290 tx=0x7f929002a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e53a6f3d29de1c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.550+0000 7f9295ffb640 1 -- 172.21.15.96:0/471364250 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290031600 con 0x7f92980b3140 2024-09-13T18:45:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.550+0000 7f9295ffb640 1 -- 172.21.15.96:0/471364250 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929002d050 con 0x7f92980b3140 2024-09-13T18:45:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.550+0000 7f9295ffb640 1 -- 172.21.15.96:0/471364250 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290031980 con 0x7f92980b3140 2024-09-13T18:45:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.550+0000 7f929d85a640 1 -- 172.21.15.96:0/471364250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b3140 msgr2=0x7f9298149000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.550+0000 7f929d85a640 1 --2- 172.21.15.96:0/471364250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b3140 0x7f9298149000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f92980b6290 tx=0x7f929002a610 comp rx=0 tx=0).stop 2024-09-13T18:45:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.550+0000 7f929d85a640 1 -- 172.21.15.96:0/471364250 shutdown_connections 2024-09-13T18:45:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.550+0000 7f929d85a640 1 --2- 172.21.15.96:0/471364250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b3140 0x7f9298149000 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.550+0000 7f929d85a640 1 --2- 172.21.15.96:0/471364250 >> v2:172.21.15.96:3300/0 conn(0x7f92980b5eb0 0x7f92980b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.550+0000 7f929d85a640 1 --2- 172.21.15.96:0/471364250 >> v2:172.21.15.29:3300/0 conn(0x7f929813c570 0x7f92981463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.550+0000 7f929d85a640 1 -- 172.21.15.96:0/471364250 >> 172.21.15.96:0/471364250 conn(0x7f9298071e70 msgr2=0x7f92980bb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.550+0000 7f929d85a640 1 -- 172.21.15.96:0/471364250 shutdown_connections 2024-09-13T18:45:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.551+0000 7f929d85a640 1 -- 172.21.15.96:0/471364250 wait complete. 2024-09-13T18:45:06.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f929d85a640 1 Processor -- start 2024-09-13T18:45:06.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f929d85a640 1 -- start start 2024-09-13T18:45:06.555 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f99e3523040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:45:06.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f929d85a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92980b3140 0x7f9298149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f929d85a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b5eb0 0x7f929813ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f929d85a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f929813c570 0x7f929813f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f929d85a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929813fe50 con 0x7f929813c570 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f929d85a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92981dada0 con 0x7f92980b3140 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f929d85a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92981db080 con 0x7f92980b5eb0 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f92967fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b5eb0 0x7f929813ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f9296ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92980b3140 0x7f9298149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f92967fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b5eb0 0x7f929813ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:42332/0 (socket says 172.21.15.96:42332) 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.552+0000 7f92967fc640 1 -- 172.21.15.96:0/2511699041 learned_addr learned my addr 172.21.15.96:0/2511699041 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f92977fe640 1 --2- 172.21.15.96:0/2511699041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f929813c570 0x7f929813f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f92967fc640 1 -- 172.21.15.96:0/2511699041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92980b3140 msgr2=0x7f9298149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f92967fc640 1 --2- 172.21.15.96:0/2511699041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92980b3140 0x7f9298149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f92967fc640 1 -- 172.21.15.96:0/2511699041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f929813c570 msgr2=0x7f929813f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f92967fc640 1 --2- 172.21.15.96:0/2511699041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f929813c570 0x7f929813f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f92967fc640 1 -- 172.21.15.96:0/2511699041 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c009400 con 0x7f92980b5eb0 2024-09-13T18:45:06.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f9296ffd640 1 --2- 172.21.15.96:0/2511699041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92980b3140 0x7f9298149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:06.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f92967fc640 1 --2- 172.21.15.96:0/2511699041 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b5eb0 0x7f929813ca90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f928c00e900 tx=0x7f928c00edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f927ffff640 1 -- 172.21.15.96:0/2511699041 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c00ca00 con 0x7f92980b5eb0 2024-09-13T18:45:06.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f927ffff640 1 -- 172.21.15.96:0/2511699041 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c00cb60 con 0x7f92980b5eb0 2024-09-13T18:45:06.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f929d85a640 1 -- 172.21.15.96:0/2511699041 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9290009b30 con 0x7f92980b5eb0 2024-09-13T18:45:06.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f927ffff640 1 -- 172.21.15.96:0/2511699041 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c013470 con 0x7f92980b5eb0 2024-09-13T18:45:06.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f929d85a640 1 -- 172.21.15.96:0/2511699041 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9298140170 con 0x7f92980b5eb0 2024-09-13T18:45:06.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f927ffff640 1 -- 172.21.15.96:0/2511699041 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f928c005c90 con 0x7f92980b5eb0 2024-09-13T18:45:06.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.553+0000 7f927ffff640 1 -- 172.21.15.96:0/2511699041 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f928c0067f0 con 0x7f92980b5eb0 2024-09-13T18:45:06.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.554+0000 7f929d85a640 1 -- 172.21.15.96:0/2511699041 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92980b5640 con 0x7f92980b5eb0 2024-09-13T18:45:06.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.556+0000 7f927ffff640 1 -- 172.21.15.96:0/2511699041 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f928c021060 con 0x7f92980b5eb0 2024-09-13T18:45:06.564 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:06.562+0000 7f0533216040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:45:06.617 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:06.614+0000 7f0533216040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:45:06.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.623+0000 7f929d85a640 1 -- 172.21.15.96:0/2511699041 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ef27cd51-cf7b-4f49-9277-75d870bc33d3", "id": 2} v 0) v1 -- 0x7f92981daee0 con 0x7f92980b5eb0 2024-09-13T18:45:06.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.627+0000 7f927ffff640 1 -- 172.21.15.96:0/2511699041 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef27cd51-cf7b-4f49-9277-75d870bc33d3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f92981daee0 con 0x7f92980b5eb0 2024-09-13T18:45:06.629 INFO:teuthology.orchestra.run.smithi096.stdout:2 2024-09-13T18:45:06.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.628+0000 7f929d85a640 1 -- 172.21.15.96:0/2511699041 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b5eb0 msgr2=0x7f929813ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.628+0000 7f929d85a640 1 --2- 172.21.15.96:0/2511699041 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b5eb0 0x7f929813ca90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f928c00e900 tx=0x7f928c00edc0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.628+0000 7f929d85a640 1 -- 172.21.15.96:0/2511699041 shutdown_connections 2024-09-13T18:45:06.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.628+0000 7f929d85a640 1 --2- 172.21.15.96:0/2511699041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f929813c570 0x7f929813f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.628+0000 7f929d85a640 1 --2- 172.21.15.96:0/2511699041 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f92980b5eb0 0x7f929813ca90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.628+0000 7f929d85a640 1 --2- 172.21.15.96:0/2511699041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92980b3140 0x7f9298149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.628+0000 7f929d85a640 1 -- 172.21.15.96:0/2511699041 >> 172.21.15.96:0/2511699041 conn(0x7f9298071e70 msgr2=0x7f92980ba510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.628+0000 7f929d85a640 1 -- 172.21.15.96:0/2511699041 shutdown_connections 2024-09-13T18:45:06.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.628+0000 7f929d85a640 1 -- 172.21.15.96:0/2511699041 wait complete. 2024-09-13T18:45:06.640 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 72fefc5d-f071-4dbe-a47a-6070df5d9ebc 3 2024-09-13T18:45:06.708 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:06.706+0000 7f99e3523040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:45:06.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.735+0000 7fed28627640 1 Processor -- start 2024-09-13T18:45:06.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.735+0000 7fed28627640 1 -- start start 2024-09-13T18:45:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed28627640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fed2006a140 0x7fed20143b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed28627640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2014a8e0 0x7fed201440a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed28627640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed200713b0 con 0x7fed20071b20 2024-09-13T18:45:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed28627640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed200711b0 con 0x7fed2006a140 2024-09-13T18:45:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed28627640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2006a520 con 0x7fed2014a8e0 2024-09-13T18:45:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed26bc4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2014a8e0 0x7fed201440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed26bc4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2014a8e0 0x7fed201440a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:42344/0 (socket says 172.21.15.96:42344) 2024-09-13T18:45:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed26bc4640 1 -- 172.21.15.96:0/2986378365 learned_addr learned my addr 172.21.15.96:0/2986378365 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-13T18:45:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed263c3640 1 --2- 172.21.15.96:0/2986378365 >> v2:172.21.15.29:3300/0 conn(0x7fed2006a140 0x7fed20143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed26bc4640 1 -- 172.21.15.96:0/2986378365 >> v2:172.21.15.29:3300/0 conn(0x7fed2006a140 msgr2=0x7fed20143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed26bc4640 1 --2- 172.21.15.96:0/2986378365 >> v2:172.21.15.29:3300/0 conn(0x7fed2006a140 0x7fed20143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed26bc4640 1 -- 172.21.15.96:0/2986378365 >> v1:172.21.15.29:6789/0 conn(0x7fed20071b20 legacy=0x7fed2014a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.736+0000 7fed26bc4640 1 -- 172.21.15.96:0/2986378365 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20149cd0 con 0x7fed2014a8e0 2024-09-13T18:45:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.737+0000 7fed26bc4640 1 --2- 172.21.15.96:0/2986378365 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2014a8e0 0x7fed201440a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fed10009e50 tx=0x7fed1002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cb99e6849b9b003 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.737+0000 7fed253c1640 1 -- 172.21.15.96:0/2986378365 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1002aea0 con 0x7fed2014a8e0 2024-09-13T18:45:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.737+0000 7fed253c1640 1 -- 172.21.15.96:0/2986378365 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1002d050 con 0x7fed2014a8e0 2024-09-13T18:45:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.737+0000 7fed253c1640 1 -- 172.21.15.96:0/2986378365 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10031820 con 0x7fed2014a8e0 2024-09-13T18:45:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.738+0000 7fed28627640 1 -- 172.21.15.96:0/2986378365 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2014a8e0 msgr2=0x7fed201440a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.738+0000 7fed28627640 1 --2- 172.21.15.96:0/2986378365 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2014a8e0 0x7fed201440a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fed10009e50 tx=0x7fed1002a680 comp rx=0 tx=0).stop 2024-09-13T18:45:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.738+0000 7fed28627640 1 -- 172.21.15.96:0/2986378365 shutdown_connections 2024-09-13T18:45:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.738+0000 7fed28627640 1 --2- 172.21.15.96:0/2986378365 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2014a8e0 0x7fed201440a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.738+0000 7fed28627640 1 --2- 172.21.15.96:0/2986378365 >> v2:172.21.15.29:3300/0 conn(0x7fed2006a140 0x7fed20143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.738+0000 7fed28627640 1 -- 172.21.15.96:0/2986378365 >> 172.21.15.96:0/2986378365 conn(0x7fed200b84b0 msgr2=0x7fed200b88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.738+0000 7fed28627640 1 -- 172.21.15.96:0/2986378365 shutdown_connections 2024-09-13T18:45:06.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.738+0000 7fed28627640 1 -- 172.21.15.96:0/2986378365 wait complete. 2024-09-13T18:45:06.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.740+0000 7fed28627640 1 Processor -- start 2024-09-13T18:45:06.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.740+0000 7fed28627640 1 -- start start 2024-09-13T18:45:06.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.740+0000 7fed28627640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2006a140 0x7fed200b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.740+0000 7fed28627640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed20071b20 0x7fed201e2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed28627640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed2014a8e0 0x7fed201e2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed28627640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed20147600 con 0x7fed20071b20 2024-09-13T18:45:06.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed28627640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed201400e0 con 0x7fed2014a8e0 2024-09-13T18:45:06.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed28627640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed20146e40 con 0x7fed2006a140 2024-09-13T18:45:06.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed263c3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2006a140 0x7fed200b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed263c3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2006a140 0x7fed200b78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:42348/0 (socket says 172.21.15.96:42348) 2024-09-13T18:45:06.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed263c3640 1 -- 172.21.15.96:0/318836054 learned_addr learned my addr 172.21.15.96:0/318836054 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-13T18:45:06.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed25bc2640 1 --2- 172.21.15.96:0/318836054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed20071b20 0x7fed201e2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed26bc4640 1 --2- 172.21.15.96:0/318836054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed2014a8e0 0x7fed201e2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed263c3640 1 -- 172.21.15.96:0/318836054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed2014a8e0 msgr2=0x7fed201e2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed263c3640 1 --2- 172.21.15.96:0/318836054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed2014a8e0 0x7fed201e2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed263c3640 1 -- 172.21.15.96:0/318836054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed20071b20 msgr2=0x7fed201e2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed263c3640 1 --2- 172.21.15.96:0/318836054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed20071b20 0x7fed201e2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed263c3640 1 -- 172.21.15.96:0/318836054 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009b30 con 0x7fed2006a140 2024-09-13T18:45:06.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed263c3640 1 --2- 172.21.15.96:0/318836054 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2006a140 0x7fed200b78b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fed1800e9b0 tx=0x7fed1800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed1effd640 1 -- 172.21.15.96:0/318836054 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18009670 con 0x7fed2006a140 2024-09-13T18:45:06.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed1effd640 1 -- 172.21.15.96:0/318836054 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1800c9a0 con 0x7fed2006a140 2024-09-13T18:45:06.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed28627640 1 -- 172.21.15.96:0/318836054 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2013fd70 con 0x7fed2006a140 2024-09-13T18:45:06.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed1effd640 1 -- 172.21.15.96:0/318836054 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1800cd50 con 0x7fed2006a140 2024-09-13T18:45:06.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed28627640 1 -- 172.21.15.96:0/318836054 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed201472d0 con 0x7fed2006a140 2024-09-13T18:45:06.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed1effd640 1 -- 172.21.15.96:0/318836054 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fed18005c90 con 0x7fed2006a140 2024-09-13T18:45:06.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.741+0000 7fed1effd640 1 -- 172.21.15.96:0/318836054 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fed18013900 con 0x7fed2006a140 2024-09-13T18:45:06.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.742+0000 7fed28627640 1 -- 172.21.15.96:0/318836054 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2013fbd0 con 0x7fed2006a140 2024-09-13T18:45:06.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.744+0000 7fed1effd640 1 -- 172.21.15.96:0/318836054 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fed2013fbd0 con 0x7fed2006a140 2024-09-13T18:45:06.773 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:06.770+0000 7f0533216040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:45:06.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.812+0000 7fed28627640 1 -- 172.21.15.96:0/318836054 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd new", "uuid": "72fefc5d-f071-4dbe-a47a-6070df5d9ebc", "id": 3} v 0) v1 -- 0x7fed2014a1d0 con 0x7fed2006a140 2024-09-13T18:45:06.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.815+0000 7fed1effd640 1 -- 172.21.15.96:0/318836054 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "72fefc5d-f071-4dbe-a47a-6070df5d9ebc", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fed18021060 con 0x7fed2006a140 2024-09-13T18:45:06.818 INFO:teuthology.orchestra.run.smithi096.stdout:3 2024-09-13T18:45:06.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.816+0000 7fed28627640 1 -- 172.21.15.96:0/318836054 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2006a140 msgr2=0x7fed200b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.816+0000 7fed28627640 1 --2- 172.21.15.96:0/318836054 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2006a140 0x7fed200b78b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fed1800e9b0 tx=0x7fed1800ee70 comp rx=0 tx=0).stop 2024-09-13T18:45:06.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.816+0000 7fed28627640 1 -- 172.21.15.96:0/318836054 shutdown_connections 2024-09-13T18:45:06.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.816+0000 7fed28627640 1 --2- 172.21.15.96:0/318836054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed2014a8e0 0x7fed201e2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.816+0000 7fed28627640 1 --2- 172.21.15.96:0/318836054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed20071b20 0x7fed201e2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.816+0000 7fed28627640 1 --2- 172.21.15.96:0/318836054 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed2006a140 0x7fed200b78b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.816+0000 7fed28627640 1 -- 172.21.15.96:0/318836054 >> 172.21.15.96:0/318836054 conn(0x7fed200b84b0 msgr2=0x7fed20142710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.816+0000 7fed28627640 1 -- 172.21.15.96:0/318836054 shutdown_connections 2024-09-13T18:45:06.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.816+0000 7fed28627640 1 -- 172.21.15.96:0/318836054 wait complete. 2024-09-13T18:45:06.830 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 89da78eb-01be-4cbe-ab06-6bd8c319b5c0 4 2024-09-13T18:45:06.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.924+0000 7fe47213e640 1 Processor -- start 2024-09-13T18:45:06.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.924+0000 7fe47213e640 1 -- start start 2024-09-13T18:45:06.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.925+0000 7fe47213e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe46c13c570 0x7fe46c1463b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.925+0000 7fe47213e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46c13c950 con 0x7fe46c0b3140 2024-09-13T18:45:06.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.925+0000 7fe47213e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46c0b5990 con 0x7fe46c0b5eb0 2024-09-13T18:45:06.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.925+0000 7fe47213e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe46c0b47a0 con 0x7fe46c13c570 2024-09-13T18:45:06.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.925+0000 7fe46b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe46c13c570 0x7fe46c1463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.925+0000 7fe463fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe46c0b5eb0 0x7fe46c0b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:49182/0 (socket says 172.21.15.96:49182) 2024-09-13T18:45:06.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.925+0000 7fe46b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe46c13c570 0x7fe46c1463b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35432/0 (socket says 172.21.15.96:35432) 2024-09-13T18:45:06.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.925+0000 7fe463fff640 1 -- 172.21.15.96:0/2567010183 learned_addr learned my addr 172.21.15.96:0/2567010183 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-13T18:45:06.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.925+0000 7fe46b7fe640 1 -- 172.21.15.96:0/2567010183 >> v1:172.21.15.96:6789/0 conn(0x7fe46c0b5eb0 legacy=0x7fe46c0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.925+0000 7fe46b7fe640 1 -- 172.21.15.96:0/2567010183 >> v1:172.21.15.29:6789/0 conn(0x7fe46c0b3140 legacy=0x7fe46c150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.925+0000 7fe46affd640 1 -- 172.21.15.96:0/2567010183 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604314153 0 0) 0x7fe46c0b5990 con 0x7fe46c0b5eb0 2024-09-13T18:45:06.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.925+0000 7fe46b7fe640 1 -- 172.21.15.96:0/2567010183 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c0b36b0 con 0x7fe46c13c570 2024-09-13T18:45:06.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.926+0000 7fe46b7fe640 1 --2- 172.21.15.96:0/2567010183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe46c13c570 0x7fe46c1463b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0097a0 tx=0x7fe45c02a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ee94c9d51a51f63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.926+0000 7fe46affd640 1 -- 172.21.15.96:0/2567010183 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c02ad30 con 0x7fe46c13c570 2024-09-13T18:45:06.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.926+0000 7fe46affd640 1 -- 172.21.15.96:0/2567010183 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45c02ae90 con 0x7fe46c13c570 2024-09-13T18:45:06.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.926+0000 7fe46affd640 1 -- 172.21.15.96:0/2567010183 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c032660 con 0x7fe46c13c570 2024-09-13T18:45:06.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.927+0000 7fe47213e640 1 -- 172.21.15.96:0/2567010183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe46c13c570 msgr2=0x7fe46c1463b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.927+0000 7fe47213e640 1 --2- 172.21.15.96:0/2567010183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe46c13c570 0x7fe46c1463b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0097a0 tx=0x7fe45c02a0a0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.927+0000 7fe47213e640 1 -- 172.21.15.96:0/2567010183 shutdown_connections 2024-09-13T18:45:06.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.927+0000 7fe47213e640 1 --2- 172.21.15.96:0/2567010183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe46c13c570 0x7fe46c1463b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.927+0000 7fe47213e640 1 -- 172.21.15.96:0/2567010183 >> 172.21.15.96:0/2567010183 conn(0x7fe46c071e70 msgr2=0x7fe46c0bb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.927+0000 7fe47213e640 1 -- 172.21.15.96:0/2567010183 shutdown_connections 2024-09-13T18:45:06.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.927+0000 7fe47213e640 1 -- 172.21.15.96:0/2567010183 wait complete. 2024-09-13T18:45:06.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.928+0000 7fe47213e640 1 Processor -- start 2024-09-13T18:45:06.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.928+0000 7fe47213e640 1 -- start start 2024-09-13T18:45:06.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe47213e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe46c0b3140 0x7fe46c1de9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe47213e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe46c0b5eb0 0x7fe46c1405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe47213e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46c13c570 0x7fe46c0b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe47213e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c149630 con 0x7fe46c13c570 2024-09-13T18:45:06.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe47213e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c1df040 con 0x7fe46c0b5eb0 2024-09-13T18:45:06.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe47213e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c1425a0 con 0x7fe46c0b3140 2024-09-13T18:45:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe463fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe46c0b5eb0 0x7fe46c1405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe46b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe46c0b3140 0x7fe46c1de9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe463fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe46c0b5eb0 0x7fe46c1405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35442/0 (socket says 172.21.15.96:35442) 2024-09-13T18:45:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe463fff640 1 -- 172.21.15.96:0/2966157938 learned_addr learned my addr 172.21.15.96:0/2966157938 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-13T18:45:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe46bfff640 1 --2- 172.21.15.96:0/2966157938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46c13c570 0x7fe46c0b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe463fff640 1 -- 172.21.15.96:0/2966157938 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe46c0b3140 msgr2=0x7fe46c1de9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe463fff640 1 --2- 172.21.15.96:0/2966157938 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe46c0b3140 0x7fe46c1de9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe463fff640 1 -- 172.21.15.96:0/2966157938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46c13c570 msgr2=0x7fe46c0b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe463fff640 1 --2- 172.21.15.96:0/2966157938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46c13c570 0x7fe46c0b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe463fff640 1 -- 172.21.15.96:0/2966157938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c009400 con 0x7fe46c0b5eb0 2024-09-13T18:45:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe463fff640 1 --2- 172.21.15.96:0/2966157938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe46c0b5eb0 0x7fe46c1405c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe45400c430 tx=0x7fe45400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe468ff9640 1 -- 172.21.15.96:0/2966157938 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4540074e0 con 0x7fe46c0b5eb0 2024-09-13T18:45:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe468ff9640 1 -- 172.21.15.96:0/2966157938 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe454007640 con 0x7fe46c0b5eb0 2024-09-13T18:45:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe47213e640 1 -- 172.21.15.96:0/2966157938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46c149840 con 0x7fe46c0b5eb0 2024-09-13T18:45:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe468ff9640 1 -- 172.21.15.96:0/2966157938 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454004a00 con 0x7fe46c0b5eb0 2024-09-13T18:45:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.929+0000 7fe47213e640 1 -- 172.21.15.96:0/2966157938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46c143280 con 0x7fe46c0b5eb0 2024-09-13T18:45:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.930+0000 7fe468ff9640 1 -- 172.21.15.96:0/2966157938 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe45401d3f0 con 0x7fe46c0b5eb0 2024-09-13T18:45:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.930+0000 7fe468ff9640 1 -- 172.21.15.96:0/2966157938 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe4540138d0 con 0x7fe46c0b5eb0 2024-09-13T18:45:06.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.930+0000 7fe47213e640 1 -- 172.21.15.96:0/2966157938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46c143b60 con 0x7fe46c0b5eb0 2024-09-13T18:45:06.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:06.932+0000 7fe468ff9640 1 -- 172.21.15.96:0/2966157938 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe454013bb0 con 0x7fe46c0b5eb0 2024-09-13T18:45:07.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.000+0000 7fe47213e640 1 -- 172.21.15.96:0/2966157938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "89da78eb-01be-4cbe-ab06-6bd8c319b5c0", "id": 4} v 0) v1 -- 0x7fe46c0b9fc0 con 0x7fe46c0b5eb0 2024-09-13T18:45:07.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.003+0000 7fe468ff9640 1 -- 172.21.15.96:0/2966157938 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89da78eb-01be-4cbe-ab06-6bd8c319b5c0", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe454013e20 con 0x7fe46c0b5eb0 2024-09-13T18:45:07.006 INFO:teuthology.orchestra.run.smithi096.stdout:4 2024-09-13T18:45:07.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.004+0000 7fe47213e640 1 -- 172.21.15.96:0/2966157938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe46c0b5eb0 msgr2=0x7fe46c1405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.004+0000 7fe47213e640 1 --2- 172.21.15.96:0/2966157938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe46c0b5eb0 0x7fe46c1405c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe45400c430 tx=0x7fe45400c8f0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.004+0000 7fe47213e640 1 -- 172.21.15.96:0/2966157938 shutdown_connections 2024-09-13T18:45:07.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.004+0000 7fe47213e640 1 --2- 172.21.15.96:0/2966157938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46c13c570 0x7fe46c0b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.004+0000 7fe47213e640 1 --2- 172.21.15.96:0/2966157938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe46c0b5eb0 0x7fe46c1405c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.004+0000 7fe47213e640 1 --2- 172.21.15.96:0/2966157938 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe46c0b3140 0x7fe46c1de9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.004+0000 7fe47213e640 1 -- 172.21.15.96:0/2966157938 >> 172.21.15.96:0/2966157938 conn(0x7fe46c071e70 msgr2=0x7fe46c0bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.004+0000 7fe47213e640 1 -- 172.21.15.96:0/2966157938 shutdown_connections 2024-09-13T18:45:07.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.004+0000 7fe47213e640 1 -- 172.21.15.96:0/2966157938 wait complete. 2024-09-13T18:45:07.017 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 3335c111-d168-4325-acfb-a5ba644be4fc 5 2024-09-13T18:45:07.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.112+0000 7f43a8e19640 1 Processor -- start 2024-09-13T18:45:07.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.112+0000 7f43a8e19640 1 -- start start 2024-09-13T18:45:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.113+0000 7f43a8e19640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 0x7f43a41474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.113+0000 7f43a8e19640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a40b4440 con 0x7f43a40b9fd0 2024-09-13T18:45:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.113+0000 7f43a8e19640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a40b5e40 con 0x7f43a414c170 2024-09-13T18:45:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.113+0000 7f43a8e19640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a40ba3b0 con 0x7f43a4147090 2024-09-13T18:45:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.113+0000 7f43a2d9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f43a414c170 0x7f43a414e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:49196/0 (socket says 172.21.15.96:49196) 2024-09-13T18:45:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.113+0000 7f43a2d9d640 1 -- 172.21.15.96:0/4105609886 learned_addr learned my addr 172.21.15.96:0/4105609886 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-13T18:45:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.113+0000 7f43a1d9b640 1 --2- 172.21.15.96:0/4105609886 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 0x7f43a41474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.114+0000 7f43a1d9b640 1 -- 172.21.15.96:0/4105609886 >> v1:172.21.15.96:6789/0 conn(0x7f43a414c170 legacy=0x7f43a414e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.114+0000 7f43a159a640 1 -- 172.21.15.96:0/4105609886 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558239071 0 0) 0x7f43a40b5e40 con 0x7f43a414c170 2024-09-13T18:45:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.114+0000 7f43a1d9b640 1 -- 172.21.15.96:0/4105609886 >> v1:172.21.15.29:6789/0 conn(0x7f43a40b9fd0 legacy=0x7f43a4140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.114+0000 7f43a1d9b640 1 -- 172.21.15.96:0/4105609886 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4147a10 con 0x7f43a4147090 2024-09-13T18:45:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.114+0000 7f43a1d9b640 1 --2- 172.21.15.96:0/4105609886 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 0x7f43a41474d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43980097d0 tx=0x7f439802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f37f8352a3181a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.115+0000 7f43a159a640 1 -- 172.21.15.96:0/4105609886 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398032440 con 0x7f43a4147090 2024-09-13T18:45:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.115+0000 7f43a159a640 1 -- 172.21.15.96:0/4105609886 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43980325a0 con 0x7f43a4147090 2024-09-13T18:45:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.115+0000 7f43a159a640 1 -- 172.21.15.96:0/4105609886 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398032930 con 0x7f43a4147090 2024-09-13T18:45:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.115+0000 7f43a8e19640 1 -- 172.21.15.96:0/4105609886 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 msgr2=0x7f43a41474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.115+0000 7f43a8e19640 1 --2- 172.21.15.96:0/4105609886 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 0x7f43a41474d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43980097d0 tx=0x7f439802a180 comp rx=0 tx=0).stop 2024-09-13T18:45:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.115+0000 7f43a8e19640 1 -- 172.21.15.96:0/4105609886 shutdown_connections 2024-09-13T18:45:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.115+0000 7f43a8e19640 1 --2- 172.21.15.96:0/4105609886 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 0x7f43a41474d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.115+0000 7f43a8e19640 1 -- 172.21.15.96:0/4105609886 >> 172.21.15.96:0/4105609886 conn(0x7f43a406a5f0 msgr2=0x7f43a40b95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.115+0000 7f43a8e19640 1 -- 172.21.15.96:0/4105609886 shutdown_connections 2024-09-13T18:45:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.115+0000 7f43a8e19640 1 -- 172.21.15.96:0/4105609886 wait complete. 2024-09-13T18:45:07.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.116+0000 7f43a8e19640 1 Processor -- start 2024-09-13T18:45:07.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.116+0000 7f43a8e19640 1 -- start start 2024-09-13T18:45:07.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a8e19640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43a40b9fd0 0x7f43a41dd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a8e19640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 0x7f43a41dce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a8e19640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43a414c170 0x7f43a41d9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a8e19640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a40a79d0 con 0x7f43a414c170 2024-09-13T18:45:07.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a8e19640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a414bc60 con 0x7f43a40b9fd0 2024-09-13T18:45:07.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a8e19640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a414bf20 con 0x7f43a4147090 2024-09-13T18:45:07.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43a40b9fd0 0x7f43a41dd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a1d9b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 0x7f43a41dce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a1d9b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 0x7f43a41dce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:42382/0 (socket says 172.21.15.96:42382) 2024-09-13T18:45:07.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a1d9b640 1 -- 172.21.15.96:0/1445903031 learned_addr learned my addr 172.21.15.96:0/1445903031 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-13T18:45:07.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43a40b9fd0 0x7f43a41dd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35448/0 (socket says 172.21.15.96:35448) 2024-09-13T18:45:07.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a2d9d640 1 --2- 172.21.15.96:0/1445903031 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43a414c170 0x7f43a41d9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a1d9b640 1 -- 172.21.15.96:0/1445903031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43a40b9fd0 msgr2=0x7f43a41dd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a1d9b640 1 --2- 172.21.15.96:0/1445903031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43a40b9fd0 0x7f43a41dd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a1d9b640 1 -- 172.21.15.96:0/1445903031 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43a414c170 msgr2=0x7f43a41d9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a1d9b640 1 --2- 172.21.15.96:0/1445903031 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43a414c170 0x7f43a41d9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a1d9b640 1 -- 172.21.15.96:0/1445903031 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4398009400 con 0x7f43a4147090 2024-09-13T18:45:07.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.117+0000 7f43a259c640 1 --2- 172.21.15.96:0/1445903031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43a40b9fd0 0x7f43a41dd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:07.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.118+0000 7f43a1d9b640 1 --2- 172.21.15.96:0/1445903031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 0x7f43a41dce40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4398000c00 tx=0x7f43980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.118+0000 7f4392ffd640 1 -- 172.21.15.96:0/1445903031 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398030b80 con 0x7f43a4147090 2024-09-13T18:45:07.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.118+0000 7f4392ffd640 1 -- 172.21.15.96:0/1445903031 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4398030ce0 con 0x7f43a4147090 2024-09-13T18:45:07.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.118+0000 7f43a8e19640 1 -- 172.21.15.96:0/1445903031 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a40a8710 con 0x7f43a4147090 2024-09-13T18:45:07.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.118+0000 7f4392ffd640 1 -- 172.21.15.96:0/1445903031 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439803b640 con 0x7f43a4147090 2024-09-13T18:45:07.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.118+0000 7f43a8e19640 1 -- 172.21.15.96:0/1445903031 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a40a8310 con 0x7f43a4147090 2024-09-13T18:45:07.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.118+0000 7f4392ffd640 1 -- 172.21.15.96:0/1445903031 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4398039040 con 0x7f43a4147090 2024-09-13T18:45:07.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.118+0000 7f4392ffd640 1 -- 172.21.15.96:0/1445903031 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f4398047b50 con 0x7f43a4147090 2024-09-13T18:45:07.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.119+0000 7f43a8e19640 1 -- 172.21.15.96:0/1445903031 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a41dd430 con 0x7f43a4147090 2024-09-13T18:45:07.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.121+0000 7f4392ffd640 1 -- 172.21.15.96:0/1445903031 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f43a41dd430 con 0x7f43a4147090 2024-09-13T18:45:07.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.188+0000 7f43a8e19640 1 -- 172.21.15.96:0/1445903031 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3335c111-d168-4325-acfb-a5ba644be4fc", "id": 5} v 0) v1 -- 0x7f43a40b1740 con 0x7f43a4147090 2024-09-13T18:45:07.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.191+0000 7f4392ffd640 1 -- 172.21.15.96:0/1445903031 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3335c111-d168-4325-acfb-a5ba644be4fc", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f439804c060 con 0x7f43a4147090 2024-09-13T18:45:07.193 INFO:teuthology.orchestra.run.smithi096.stdout:5 2024-09-13T18:45:07.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.192+0000 7f43a8e19640 1 -- 172.21.15.96:0/1445903031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 msgr2=0x7f43a41dce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.192+0000 7f43a8e19640 1 --2- 172.21.15.96:0/1445903031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 0x7f43a41dce40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4398000c00 tx=0x7f43980046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.192+0000 7f43a8e19640 1 -- 172.21.15.96:0/1445903031 shutdown_connections 2024-09-13T18:45:07.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.192+0000 7f43a8e19640 1 --2- 172.21.15.96:0/1445903031 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43a414c170 0x7f43a41d9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.192+0000 7f43a8e19640 1 --2- 172.21.15.96:0/1445903031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43a4147090 0x7f43a41dce40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.192+0000 7f43a8e19640 1 --2- 172.21.15.96:0/1445903031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f43a40b9fd0 0x7f43a41dd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.192+0000 7f43a8e19640 1 -- 172.21.15.96:0/1445903031 >> 172.21.15.96:0/1445903031 conn(0x7f43a406a5f0 msgr2=0x7f43a4142200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.192+0000 7f43a8e19640 1 -- 172.21.15.96:0/1445903031 shutdown_connections 2024-09-13T18:45:07.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.192+0000 7f43a8e19640 1 -- 172.21.15.96:0/1445903031 wait complete. 2024-09-13T18:45:07.204 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 1dff2d03-b474-4166-9296-56f38623b932 6 2024-09-13T18:45:07.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.300+0000 7fe1c442b640 1 Processor -- start 2024-09-13T18:45:07.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.300+0000 7fe1c442b640 1 -- start start 2024-09-13T18:45:07.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c442b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 0x7fe1bc13bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c442b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe1bc146170 0x7fe1bc13c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c442b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1bc13c7d0 con 0x7fe1bc0b9f20 2024-09-13T18:45:07.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c442b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1bc06b520 con 0x7fe1bc146170 2024-09-13T18:45:07.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c442b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc06c1a0 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c29c8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe1bc146170 0x7fe1bc13c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c19c6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 0x7fe1bc13bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c29c8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe1bc146170 0x7fe1bc13c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35462/0 (socket says 172.21.15.96:35462) 2024-09-13T18:45:07.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c19c6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 0x7fe1bc13bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:42386/0 (socket says 172.21.15.96:42386) 2024-09-13T18:45:07.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c19c6640 1 -- 172.21.15.96:0/4157361456 learned_addr learned my addr 172.21.15.96:0/4157361456 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-13T18:45:07.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c21c7640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe1bc0b9f20 0x7fe1bc145a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:49208/0 (socket says 172.21.15.96:49208) 2024-09-13T18:45:07.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c29c8640 1 -- 172.21.15.96:0/4157361456 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 msgr2=0x7fe1bc13bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:07.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c29c8640 1 --2- 172.21.15.96:0/4157361456 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 0x7fe1bc13bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c29c8640 1 -- 172.21.15.96:0/4157361456 >> v1:172.21.15.96:6789/0 conn(0x7fe1bc0b9f20 legacy=0x7fe1bc145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c29c8640 1 -- 172.21.15.96:0/4157361456 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc0ba300 con 0x7fe1bc146170 2024-09-13T18:45:07.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c11c5640 1 -- 172.21.15.96:0/4157361456 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565131035 0 0) 0x7fe1bc13c7d0 con 0x7fe1bc0b9f20 2024-09-13T18:45:07.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.301+0000 7fe1c19c6640 1 --2- 172.21.15.96:0/4157361456 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 0x7fe1bc13bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:07.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.302+0000 7fe1c29c8640 1 --2- 172.21.15.96:0/4157361456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1bc146170 0x7fe1bc13c290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009d90 tx=0x7fe1b402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dadcce42c163595b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.302+0000 7fe1c11c5640 1 -- 172.21.15.96:0/4157361456 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4007740 con 0x7fe1bc146170 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.302+0000 7fe1c11c5640 1 -- 172.21.15.96:0/4157361456 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b402d050 con 0x7fe1bc146170 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.302+0000 7fe1c11c5640 1 -- 172.21.15.96:0/4157361456 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4007ac0 con 0x7fe1bc146170 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.303+0000 7fe1c442b640 1 -- 172.21.15.96:0/4157361456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1bc146170 msgr2=0x7fe1bc13c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.303+0000 7fe1c442b640 1 --2- 172.21.15.96:0/4157361456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1bc146170 0x7fe1bc13c290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009d90 tx=0x7fe1b402a660 comp rx=0 tx=0).stop 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.303+0000 7fe1c442b640 1 -- 172.21.15.96:0/4157361456 shutdown_connections 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.303+0000 7fe1c442b640 1 --2- 172.21.15.96:0/4157361456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1bc146170 0x7fe1bc13c290 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.303+0000 7fe1c442b640 1 --2- 172.21.15.96:0/4157361456 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 0x7fe1bc13bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.303+0000 7fe1c442b640 1 -- 172.21.15.96:0/4157361456 >> 172.21.15.96:0/4157361456 conn(0x7fe1bc06a500 msgr2=0x7fe1bc0b95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.303+0000 7fe1c442b640 1 -- 172.21.15.96:0/4157361456 shutdown_connections 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.303+0000 7fe1c442b640 1 -- 172.21.15.96:0/4157361456 wait complete. 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.304+0000 7fe1c442b640 1 Processor -- start 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.304+0000 7fe1c442b640 1 -- start start 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.304+0000 7fe1c442b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 0x7fe1bc141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.304+0000 7fe1c442b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1bc0b9f20 0x7fe1bc141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.304+0000 7fe1c442b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1bc146170 0x7fe1bc1db9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.304+0000 7fe1c442b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc1401e0 con 0x7fe1bc0b9f20 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.304+0000 7fe1c442b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc1407a0 con 0x7fe1bc146170 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.304+0000 7fe1c442b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc142ce0 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c29c8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1bc146170 0x7fe1bc1db9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c21c7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 0x7fe1bc141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c29c8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1bc146170 0x7fe1bc1db9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35464/0 (socket says 172.21.15.96:35464) 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c29c8640 1 -- 172.21.15.96:0/901236969 learned_addr learned my addr 172.21.15.96:0/901236969 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c19c6640 1 --2- 172.21.15.96:0/901236969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1bc0b9f20 0x7fe1bc141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c21c7640 1 -- 172.21.15.96:0/901236969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1bc146170 msgr2=0x7fe1bc1db9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c21c7640 1 --2- 172.21.15.96:0/901236969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1bc146170 0x7fe1bc1db9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c21c7640 1 -- 172.21.15.96:0/901236969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1bc0b9f20 msgr2=0x7fe1bc141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c21c7640 1 --2- 172.21.15.96:0/901236969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1bc0b9f20 0x7fe1bc141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c21c7640 1 -- 172.21.15.96:0/901236969 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac0094d0 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c29c8640 1 --2- 172.21.15.96:0/901236969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1bc146170 0x7fe1bc1db9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c21c7640 1 --2- 172.21.15.96:0/901236969 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 0x7fe1bc141940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c480 tx=0x7fe1b800c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1b2ffd640 1 -- 172.21.15.96:0/901236969 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80074e0 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1b2ffd640 1 -- 172.21.15.96:0/901236969 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b8007640 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c442b640 1 -- 172.21.15.96:0/901236969 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b4009a70 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1b2ffd640 1 -- 172.21.15.96:0/901236969 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8004a20 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.305+0000 7fe1c442b640 1 -- 172.21.15.96:0/901236969 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1bc140430 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.306+0000 7fe1b2ffd640 1 -- 172.21.15.96:0/901236969 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe1b801d440 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.306+0000 7fe1b2ffd640 1 -- 172.21.15.96:0/901236969 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fe1b80129f0 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.306+0000 7fe1c442b640 1 -- 172.21.15.96:0/901236969 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1bc145a60 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.308+0000 7fe1b2ffd640 1 -- 172.21.15.96:0/901236969 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe1b8018070 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.376+0000 7fe1c442b640 1 -- 172.21.15.96:0/901236969 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1dff2d03-b474-4166-9296-56f38623b932", "id": 6} v 0) v1 -- 0x7fe1bc136ff0 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.379+0000 7fe1b2ffd640 1 -- 172.21.15.96:0/901236969 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1dff2d03-b474-4166-9296-56f38623b932", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe1b8012530 con 0x7fe1bc0b5c20 2024-09-13T18:45:07.381 INFO:teuthology.orchestra.run.smithi096.stdout:6 2024-09-13T18:45:07.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.380+0000 7fe1c442b640 1 -- 172.21.15.96:0/901236969 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 msgr2=0x7fe1bc141940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.380+0000 7fe1c442b640 1 --2- 172.21.15.96:0/901236969 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 0x7fe1bc141940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c480 tx=0x7fe1b800c940 comp rx=0 tx=0).stop 2024-09-13T18:45:07.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.380+0000 7fe1c442b640 1 -- 172.21.15.96:0/901236969 shutdown_connections 2024-09-13T18:45:07.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.380+0000 7fe1c442b640 1 --2- 172.21.15.96:0/901236969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1bc146170 0x7fe1bc1db9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.380+0000 7fe1c442b640 1 --2- 172.21.15.96:0/901236969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1bc0b9f20 0x7fe1bc141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.380+0000 7fe1c442b640 1 --2- 172.21.15.96:0/901236969 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe1bc0b5c20 0x7fe1bc141940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.380+0000 7fe1c442b640 1 -- 172.21.15.96:0/901236969 >> 172.21.15.96:0/901236969 conn(0x7fe1bc06a500 msgr2=0x7fe1bc1383f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.380+0000 7fe1c442b640 1 -- 172.21.15.96:0/901236969 shutdown_connections 2024-09-13T18:45:07.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.380+0000 7fe1c442b640 1 -- 172.21.15.96:0/901236969 wait complete. 2024-09-13T18:45:07.392 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new ca44193d-15b6-4bf0-be72-be3664f790b8 7 2024-09-13T18:45:07.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.488+0000 7fd775ae9640 1 Processor -- start 2024-09-13T18:45:07.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.488+0000 7fd775ae9640 1 -- start start 2024-09-13T18:45:07.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.488+0000 7fd775ae9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd770070eb0 0x7fd77013c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.488+0000 7fd775ae9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd770071290 0x7fd7701429f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.488+0000 7fd775ae9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd770072460 con 0x7fd77013c790 2024-09-13T18:45:07.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.488+0000 7fd775ae9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7701425c0 con 0x7fd770070eb0 2024-09-13T18:45:07.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.488+0000 7fd775ae9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77006fd50 con 0x7fd770071290 2024-09-13T18:45:07.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.489+0000 7fd76effd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd770071290 0x7fd7701429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.489+0000 7fd76f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd770070eb0 0x7fd77013c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.489+0000 7fd76effd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd770071290 0x7fd7701429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:42408/0 (socket says 172.21.15.96:42408) 2024-09-13T18:45:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.489+0000 7fd76effd640 1 -- 172.21.15.96:0/1882389308 learned_addr learned my addr 172.21.15.96:0/1882389308 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-13T18:45:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.489+0000 7fd76effd640 1 -- 172.21.15.96:0/1882389308 >> v2:172.21.15.96:3300/0 conn(0x7fd770070eb0 msgr2=0x7fd77013c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.489+0000 7fd76effd640 1 --2- 172.21.15.96:0/1882389308 >> v2:172.21.15.96:3300/0 conn(0x7fd770070eb0 0x7fd77013c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.489+0000 7fd76effd640 1 -- 172.21.15.96:0/1882389308 >> v1:172.21.15.96:6789/0 conn(0x7fd77013c790 legacy=0x7fd770145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.489+0000 7fd76effd640 1 -- 172.21.15.96:0/1882389308 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd770072180 con 0x7fd770071290 2024-09-13T18:45:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.489+0000 7fd76f7fe640 1 --2- 172.21.15.96:0/1882389308 >> v2:172.21.15.96:3300/0 conn(0x7fd770070eb0 0x7fd77013c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.489+0000 7fd76e7fc640 1 -- 172.21.15.96:0/1882389308 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421567354 0 0) 0x7fd770072460 con 0x7fd77013c790 2024-09-13T18:45:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.490+0000 7fd76effd640 1 --2- 172.21.15.96:0/1882389308 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd770071290 0x7fd7701429f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd764009870 tx=0x7fd76402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc646e31d96e3ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.490+0000 7fd76e7fc640 1 -- 172.21.15.96:0/1882389308 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76402ae80 con 0x7fd770071290 2024-09-13T18:45:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.490+0000 7fd76e7fc640 1 -- 172.21.15.96:0/1882389308 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd764032440 con 0x7fd770071290 2024-09-13T18:45:07.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.490+0000 7fd76e7fc640 1 -- 172.21.15.96:0/1882389308 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640327b0 con 0x7fd770071290 2024-09-13T18:45:07.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.490+0000 7fd775ae9640 1 -- 172.21.15.96:0/1882389308 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd770071290 msgr2=0x7fd7701429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.490+0000 7fd775ae9640 1 --2- 172.21.15.96:0/1882389308 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd770071290 0x7fd7701429f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd764009870 tx=0x7fd76402a130 comp rx=0 tx=0).stop 2024-09-13T18:45:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.490+0000 7fd775ae9640 1 -- 172.21.15.96:0/1882389308 shutdown_connections 2024-09-13T18:45:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.490+0000 7fd775ae9640 1 --2- 172.21.15.96:0/1882389308 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd770071290 0x7fd7701429f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.490+0000 7fd775ae9640 1 --2- 172.21.15.96:0/1882389308 >> v2:172.21.15.96:3300/0 conn(0x7fd770070eb0 0x7fd77013c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.490+0000 7fd775ae9640 1 -- 172.21.15.96:0/1882389308 >> 172.21.15.96:0/1882389308 conn(0x7fd7700b84b0 msgr2=0x7fd7700b88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.490+0000 7fd775ae9640 1 -- 172.21.15.96:0/1882389308 shutdown_connections 2024-09-13T18:45:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.490+0000 7fd775ae9640 1 -- 172.21.15.96:0/1882389308 wait complete. 2024-09-13T18:45:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.491+0000 7fd775ae9640 1 Processor -- start 2024-09-13T18:45:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.492+0000 7fd775ae9640 1 -- start start 2024-09-13T18:45:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.492+0000 7fd775ae9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd770070eb0 0x7fd7701de120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.492+0000 7fd775ae9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd770071290 0x7fd77013f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.492+0000 7fd775ae9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd77013c790 0x7fd7700ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.492+0000 7fd775ae9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700abb70 con 0x7fd770070eb0 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.492+0000 7fd775ae9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700ac7e0 con 0x7fd770071290 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.492+0000 7fd775ae9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700ab8c0 con 0x7fd77013c790 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.492+0000 7fd76effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd770071290 0x7fd77013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.492+0000 7fd76effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd770071290 0x7fd77013f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35482/0 (socket says 172.21.15.96:35482) 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.492+0000 7fd76effd640 1 -- 172.21.15.96:0/73430435 learned_addr learned my addr 172.21.15.96:0/73430435 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.492+0000 7fd76ffff640 1 --2- 172.21.15.96:0/73430435 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd77013c790 0x7fd7700ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.492+0000 7fd76f7fe640 1 --2- 172.21.15.96:0/73430435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd770070eb0 0x7fd7701de120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd76effd640 1 -- 172.21.15.96:0/73430435 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd77013c790 msgr2=0x7fd7700ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd76effd640 1 --2- 172.21.15.96:0/73430435 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd77013c790 0x7fd7700ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd76effd640 1 -- 172.21.15.96:0/73430435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd770070eb0 msgr2=0x7fd7701de120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd76effd640 1 --2- 172.21.15.96:0/73430435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd770070eb0 0x7fd7701de120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd76effd640 1 -- 172.21.15.96:0/73430435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760009400 con 0x7fd770071290 2024-09-13T18:45:07.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd76effd640 1 --2- 172.21.15.96:0/73430435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd770071290 0x7fd77013f660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd764000c00 tx=0x7fd7640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd757fff640 1 -- 172.21.15.96:0/73430435 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76403d830 con 0x7fd770071290 2024-09-13T18:45:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd757fff640 1 -- 172.21.15.96:0/73430435 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76403d990 con 0x7fd770071290 2024-09-13T18:45:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd775ae9640 1 -- 172.21.15.96:0/73430435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7640094d0 con 0x7fd770071290 2024-09-13T18:45:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd757fff640 1 -- 172.21.15.96:0/73430435 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76403dd40 con 0x7fd770071290 2024-09-13T18:45:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd775ae9640 1 -- 172.21.15.96:0/73430435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7700abd80 con 0x7fd770071290 2024-09-13T18:45:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd757fff640 1 -- 172.21.15.96:0/73430435 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd764039040 con 0x7fd770071290 2024-09-13T18:45:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.493+0000 7fd757fff640 1 -- 172.21.15.96:0/73430435 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fd76403baa0 con 0x7fd770071290 2024-09-13T18:45:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.494+0000 7fd775ae9640 1 -- 172.21.15.96:0/73430435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7701456b0 con 0x7fd770071290 2024-09-13T18:45:07.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.496+0000 7fd757fff640 1 -- 172.21.15.96:0/73430435 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd7701456b0 con 0x7fd770071290 2024-09-13T18:45:07.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.565+0000 7fd775ae9640 1 -- 172.21.15.96:0/73430435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ca44193d-15b6-4bf0-be72-be3664f790b8", "id": 7} v 0) v1 -- 0x7fd77013c250 con 0x7fd770071290 2024-09-13T18:45:07.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.569+0000 7fd757fff640 1 -- 172.21.15.96:0/73430435 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca44193d-15b6-4bf0-be72-be3664f790b8", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd76404b060 con 0x7fd770071290 2024-09-13T18:45:07.571 INFO:teuthology.orchestra.run.smithi096.stdout:7 2024-09-13T18:45:07.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.569+0000 7fd775ae9640 1 -- 172.21.15.96:0/73430435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd770071290 msgr2=0x7fd77013f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.569+0000 7fd775ae9640 1 --2- 172.21.15.96:0/73430435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd770071290 0x7fd77013f660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd764000c00 tx=0x7fd7640046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.569+0000 7fd775ae9640 1 -- 172.21.15.96:0/73430435 shutdown_connections 2024-09-13T18:45:07.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.569+0000 7fd775ae9640 1 --2- 172.21.15.96:0/73430435 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd77013c790 0x7fd7700ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.569+0000 7fd775ae9640 1 --2- 172.21.15.96:0/73430435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd770071290 0x7fd77013f660 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.569+0000 7fd775ae9640 1 --2- 172.21.15.96:0/73430435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd770070eb0 0x7fd7701de120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.569+0000 7fd775ae9640 1 -- 172.21.15.96:0/73430435 >> 172.21.15.96:0/73430435 conn(0x7fd7700b84b0 msgr2=0x7fd770069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.570+0000 7fd775ae9640 1 -- 172.21.15.96:0/73430435 shutdown_connections 2024-09-13T18:45:07.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-13T18:45:07.570+0000 7fd775ae9640 1 -- 172.21.15.96:0/73430435 wait complete. 2024-09-13T18:45:07.582 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T18:45:07.582 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T18:45:07.585 INFO:tasks.ceph.osd.0:Started 2024-09-13T18:45:07.585 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T18:45:07.585 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T18:45:07.587 INFO:tasks.ceph.osd.1:Started 2024-09-13T18:45:07.587 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T18:45:07.587 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T18:45:07.589 INFO:tasks.ceph.osd.2:Started 2024-09-13T18:45:07.589 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T18:45:07.589 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T18:45:07.591 INFO:tasks.ceph.osd.3:Started 2024-09-13T18:45:07.591 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T18:45:07.592 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T18:45:07.593 INFO:tasks.ceph.osd.4:Started 2024-09-13T18:45:07.594 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T18:45:07.594 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T18:45:07.596 INFO:tasks.ceph.osd.5:Started 2024-09-13T18:45:07.596 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T18:45:07.596 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T18:45:07.598 INFO:tasks.ceph.osd.6:Started 2024-09-13T18:45:07.598 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T18:45:07.598 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T18:45:07.600 INFO:tasks.ceph.osd.7:Started 2024-09-13T18:45:07.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:07.715 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:07.713+0000 7f99e3523040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:45:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.719+0000 7f9325f0f640 1 Processor -- start 2024-09-13T18:45:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.719+0000 7f9325f0f640 1 -- start start 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.719+0000 7f9325f0f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f932013f3a0 0x7f932013f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.719+0000 7f9325f0f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f932013fd70 0x7f932014d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.719+0000 7f9325f0f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932006faa0 con 0x7f93200b8e30 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.719+0000 7f9325f0f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9320071f80 con 0x7f932013fd70 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.719+0000 7f9325f0f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9320071790 con 0x7f932013f3a0 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.720+0000 7f9316ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f932013f3a0 0x7f932013f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.720+0000 7f9316ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f932013f3a0 0x7f932013f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:57858/0 (socket says 172.21.15.29:57858) 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.720+0000 7f9316ffd640 1 -- 172.21.15.29:0/3886117105 learned_addr learned my addr 172.21.15.29:0/3886117105 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.720+0000 7f931ffff640 1 --2- 172.21.15.29:0/3886117105 >> v2:172.21.15.29:3300/0 conn(0x7f932013fd70 0x7f932014d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.720+0000 7f9316ffd640 1 -- 172.21.15.29:0/3886117105 >> v2:172.21.15.29:3300/0 conn(0x7f932013fd70 msgr2=0x7f932014d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.720+0000 7f9316ffd640 1 --2- 172.21.15.29:0/3886117105 >> v2:172.21.15.29:3300/0 conn(0x7f932013fd70 0x7f932014d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.720+0000 7f9316ffd640 1 -- 172.21.15.29:0/3886117105 >> v1:172.21.15.96:6789/0 conn(0x7f93200b8e30 legacy=0x7f932006ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.720+0000 7f9316ffd640 1 -- 172.21.15.29:0/3886117105 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9320070640 con 0x7f932013f3a0 2024-09-13T18:45:07.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.721+0000 7f9316ffd640 1 --2- 172.21.15.29:0/3886117105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f932013f3a0 0x7f932013f830 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f93200b4dd0 tx=0x7f930802a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8e406856143a20e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.721+0000 7f931effd640 1 -- 172.21.15.29:0/3886117105 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308032440 con 0x7f932013f3a0 2024-09-13T18:45:07.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.721+0000 7f931effd640 1 -- 172.21.15.29:0/3886117105 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93080325a0 con 0x7f932013f3a0 2024-09-13T18:45:07.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.721+0000 7f931effd640 1 -- 172.21.15.29:0/3886117105 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308032930 con 0x7f932013f3a0 2024-09-13T18:45:07.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.721+0000 7f9325f0f640 1 -- 172.21.15.29:0/3886117105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f932013f3a0 msgr2=0x7f932013f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.721+0000 7f9325f0f640 1 --2- 172.21.15.29:0/3886117105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f932013f3a0 0x7f932013f830 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f93200b4dd0 tx=0x7f930802a1f0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.722+0000 7f9325f0f640 1 -- 172.21.15.29:0/3886117105 shutdown_connections 2024-09-13T18:45:07.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.722+0000 7f9325f0f640 1 --2- 172.21.15.29:0/3886117105 >> v2:172.21.15.29:3300/0 conn(0x7f932013fd70 0x7f932014d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.722+0000 7f9325f0f640 1 --2- 172.21.15.29:0/3886117105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f932013f3a0 0x7f932013f830 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.722+0000 7f9325f0f640 1 -- 172.21.15.29:0/3886117105 >> 172.21.15.29:0/3886117105 conn(0x7f932006b610 msgr2=0x7f93200b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.722+0000 7f9325f0f640 1 -- 172.21.15.29:0/3886117105 shutdown_connections 2024-09-13T18:45:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.722+0000 7f9325f0f640 1 -- 172.21.15.29:0/3886117105 wait complete. 2024-09-13T18:45:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.723+0000 7f9325f0f640 1 Processor -- start 2024-09-13T18:45:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.723+0000 7f9325f0f640 1 -- start start 2024-09-13T18:45:07.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.723+0000 7f9325f0f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93200b8e30 0x7f93200b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.723+0000 7f9325f0f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f932013f3a0 0x7f9320141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.723+0000 7f9325f0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f932013fd70 0x7f9320135430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f9325f0f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9320142750 con 0x7f932013fd70 2024-09-13T18:45:07.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f9325f0f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9320140770 con 0x7f93200b8e30 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93200b8e30 0x7f93200b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f932013fd70 0x7f9320135430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f9325f0f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9320140a50 con 0x7f932013f3a0 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f932013fd70 0x7f9320135430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37552/0 (socket says 172.21.15.29:37552) 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93200b8e30 0x7f93200b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:57860/0 (socket says 172.21.15.29:57860) 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931ffff640 1 -- 172.21.15.29:0/405302066 learned_addr learned my addr 172.21.15.29:0/405302066 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f9316ffd640 1 --2- 172.21.15.29:0/405302066 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f932013f3a0 0x7f9320141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931ffff640 1 -- 172.21.15.29:0/405302066 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f932013f3a0 msgr2=0x7f9320141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931ffff640 1 --2- 172.21.15.29:0/405302066 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f932013f3a0 0x7f9320141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931ffff640 1 -- 172.21.15.29:0/405302066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93200b8e30 msgr2=0x7f93200b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931ffff640 1 --2- 172.21.15.29:0/405302066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93200b8e30 0x7f93200b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931ffff640 1 -- 172.21.15.29:0/405302066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93080094d0 con 0x7f932013fd70 2024-09-13T18:45:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f9316ffd640 1 --2- 172.21.15.29:0/405302066 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f932013f3a0 0x7f9320141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:07.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931ffff640 1 --2- 172.21.15.29:0/405302066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f932013fd70 0x7f9320135430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f931800efc0 tx=0x7f931800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931cff9640 1 -- 172.21.15.29:0/405302066 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318009ba0 con 0x7f932013fd70 2024-09-13T18:45:07.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f931cff9640 1 -- 172.21.15.29:0/405302066 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931800f040 con 0x7f932013fd70 2024-09-13T18:45:07.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.724+0000 7f9325f0f640 1 -- 172.21.15.29:0/405302066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9320140d30 con 0x7f932013fd70 2024-09-13T18:45:07.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.725+0000 7f931cff9640 1 -- 172.21.15.29:0/405302066 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93180146c0 con 0x7f932013fd70 2024-09-13T18:45:07.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.725+0000 7f9325f0f640 1 -- 172.21.15.29:0/405302066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9320145690 con 0x7f932013fd70 2024-09-13T18:45:07.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.725+0000 7f931cff9640 1 -- 172.21.15.29:0/405302066 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9318014b20 con 0x7f932013fd70 2024-09-13T18:45:07.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.725+0000 7f931cff9640 1 -- 172.21.15.29:0/405302066 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9318013ab0 con 0x7f932013fd70 2024-09-13T18:45:07.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.726+0000 7f9325f0f640 1 -- 172.21.15.29:0/405302066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93201405d0 con 0x7f932013fd70 2024-09-13T18:45:07.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.728+0000 7f931cff9640 1 -- 172.21.15.29:0/405302066 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f93201405d0 con 0x7f932013fd70 2024-09-13T18:45:07.767 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:07.765+0000 7f99e3523040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:45:07.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.787+0000 7f9325f0f640 1 -- 172.21.15.29:0/405302066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9320140f70 con 0x7f932013fd70 2024-09-13T18:45:07.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.787+0000 7f931cff9640 1 -- 172.21.15.29:0/405302066 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9320140f70 con 0x7f932013fd70 2024-09-13T18:45:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:07.790 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":10,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:07.566943+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:07.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.788+0000 7f9325f0f640 1 -- 172.21.15.29:0/405302066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f932013fd70 msgr2=0x7f9320135430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.788+0000 7f9325f0f640 1 --2- 172.21.15.29:0/405302066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f932013fd70 0x7f9320135430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f931800efc0 tx=0x7f931800c490 comp rx=0 tx=0).stop 2024-09-13T18:45:07.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.788+0000 7f9325f0f640 1 -- 172.21.15.29:0/405302066 shutdown_connections 2024-09-13T18:45:07.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.788+0000 7f9325f0f640 1 --2- 172.21.15.29:0/405302066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f932013fd70 0x7f9320135430 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.788+0000 7f9325f0f640 1 --2- 172.21.15.29:0/405302066 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f932013f3a0 0x7f9320141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.788+0000 7f9325f0f640 1 --2- 172.21.15.29:0/405302066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93200b8e30 0x7f93200b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.788+0000 7f9325f0f640 1 -- 172.21.15.29:0/405302066 >> 172.21.15.29:0/405302066 conn(0x7f932006b610 msgr2=0x7f9320069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.788+0000 7f9325f0f640 1 -- 172.21.15.29:0/405302066 shutdown_connections 2024-09-13T18:45:07.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:07.789+0000 7f9325f0f640 1 -- 172.21.15.29:0/405302066 wait complete. 2024-09-13T18:45:07.801 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T18:45:07.801 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T18:45:07.833 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:07.831+0000 7f0533216040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:45:07.887 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:07.885+0000 7f0533216040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:45:08.130 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.128+0000 7f99e3523040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:45:08.191 INFO:tasks.ceph.osd.6.smithi096.stderr:2024-09-13T18:45:08.189+0000 7f8c3b00d640 -1 Falling back to public interface 2024-09-13T18:45:08.192 INFO:tasks.ceph.osd.4.smithi096.stderr:2024-09-13T18:45:08.190+0000 7fdc5b1dd640 -1 Falling back to public interface 2024-09-13T18:45:08.195 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-09-13T18:45:08.193+0000 7f0942017640 -1 Falling back to public interface 2024-09-13T18:45:08.207 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-09-13T18:45:08.204+0000 7fdaf6d45640 -1 Falling back to public interface 2024-09-13T18:45:08.211 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-09-13T18:45:08.208+0000 7f67f00ef640 -1 Falling back to public interface 2024-09-13T18:45:08.215 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.213+0000 7f99e3523040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:45:08.219 INFO:tasks.ceph.osd.7.smithi096.stderr:2024-09-13T18:45:08.217+0000 7f59f0611640 -1 Falling back to public interface 2024-09-13T18:45:08.220 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-09-13T18:45:08.218+0000 7f47a2da4640 -1 Falling back to public interface 2024-09-13T18:45:08.229 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-09-13T18:45:08.227+0000 7ff902487640 -1 Falling back to public interface 2024-09-13T18:45:08.276 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:08.273+0000 7f0533216040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:45:08.325 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.322+0000 7f99e3523040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:45:08.364 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:08.362+0000 7f0533216040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:45:08.370 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.368+0000 7f99e3523040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:45:08.474 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:08.472+0000 7f0533216040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:45:08.481 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.479+0000 7f99e3523040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:45:08.523 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:08.520+0000 7f0533216040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:45:08.534 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.532+0000 7f99e3523040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:45:08.580 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.577+0000 7f99e3523040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:45:08.607 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:08.641 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:08.638+0000 7f0533216040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:45:08.687 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.685+0000 7f99e3523040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:45:08.697 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:08.695+0000 7f0533216040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:45:08.700 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.697+0000 7fc8d6703640 1 Processor -- start 2024-09-13T18:45:08.700 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.697+0000 7fc8d6703640 1 -- start start 2024-09-13T18:45:08.702 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.698+0000 7fc8d6703640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc8d00b36a0 0x7fc8d00b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:08.702 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.698+0000 7fc8d6703640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc8d00ba200 0x7fc8d013d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:08.702 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8d6703640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d00b2400 con 0x7fc8d00b0b30 2024-09-13T18:45:08.702 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8d6703640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d00b5ca0 con 0x7fc8d00b36a0 2024-09-13T18:45:08.702 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8d6703640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d00b3a80 con 0x7fc8d00ba200 2024-09-13T18:45:08.702 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8cffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc8d00b36a0 0x7fc8d00b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.702 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8d4ca0640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc8d00b0b30 0x7fc8d0070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36570/0 (socket says 172.21.15.29:36570) 2024-09-13T18:45:08.702 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8d4ca0640 1 -- 172.21.15.29:0/3465514011 learned_addr learned my addr 172.21.15.29:0/3465514011 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:08.702 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8cffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc8d00b36a0 0x7fc8d00b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37560/0 (socket says 172.21.15.29:37560) 2024-09-13T18:45:08.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8cf7fe640 1 --2- 172.21.15.29:0/3465514011 >> v2:172.21.15.96:3300/0 conn(0x7fc8d00ba200 0x7fc8d013d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8cffff640 1 -- 172.21.15.29:0/3465514011 >> v2:172.21.15.96:3300/0 conn(0x7fc8d00ba200 msgr2=0x7fc8d013d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:08.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8cffff640 1 --2- 172.21.15.29:0/3465514011 >> v2:172.21.15.96:3300/0 conn(0x7fc8d00ba200 0x7fc8d013d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8cffff640 1 -- 172.21.15.29:0/3465514011 >> v1:172.21.15.29:6789/0 conn(0x7fc8d00b0b30 legacy=0x7fc8d0070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:08.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8ceffd640 1 -- 172.21.15.29:0/3465514011 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684383083 0 0) 0x7fc8d00b2400 con 0x7fc8d00b0b30 2024-09-13T18:45:08.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.699+0000 7fc8cffff640 1 -- 172.21.15.29:0/3465514011 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d00b1b60 con 0x7fc8d00b36a0 2024-09-13T18:45:08.704 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.700+0000 7fc8cffff640 1 --2- 172.21.15.29:0/3465514011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d00b36a0 0x7fc8d00b2bc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0070a50 tx=0x7fc8c002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dcc8bcfa8e34c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:08.704 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.700+0000 7fc8ceffd640 1 -- 172.21.15.29:0/3465514011 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c002ae60 con 0x7fc8d00b36a0 2024-09-13T18:45:08.704 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.700+0000 7fc8ceffd640 1 -- 172.21.15.29:0/3465514011 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c0032440 con 0x7fc8d00b36a0 2024-09-13T18:45:08.704 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.700+0000 7fc8ceffd640 1 -- 172.21.15.29:0/3465514011 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00327d0 con 0x7fc8d00b36a0 2024-09-13T18:45:08.704 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.701+0000 7fc8d6703640 1 -- 172.21.15.29:0/3465514011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d00b36a0 msgr2=0x7fc8d00b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:08.704 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.701+0000 7fc8d6703640 1 --2- 172.21.15.29:0/3465514011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d00b36a0 0x7fc8d00b2bc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0070a50 tx=0x7fc8c002a110 comp rx=0 tx=0).stop 2024-09-13T18:45:08.705 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.701+0000 7fc8d6703640 1 -- 172.21.15.29:0/3465514011 shutdown_connections 2024-09-13T18:45:08.705 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.701+0000 7fc8d6703640 1 --2- 172.21.15.29:0/3465514011 >> v2:172.21.15.96:3300/0 conn(0x7fc8d00ba200 0x7fc8d013d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.705 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.701+0000 7fc8d6703640 1 --2- 172.21.15.29:0/3465514011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d00b36a0 0x7fc8d00b2bc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.705 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.701+0000 7fc8d6703640 1 -- 172.21.15.29:0/3465514011 >> 172.21.15.29:0/3465514011 conn(0x7fc8d006a500 msgr2=0x7fc8d00b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:08.705 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.701+0000 7fc8d6703640 1 -- 172.21.15.29:0/3465514011 shutdown_connections 2024-09-13T18:45:08.705 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.701+0000 7fc8d6703640 1 -- 172.21.15.29:0/3465514011 wait complete. 2024-09-13T18:45:08.705 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.703+0000 7fc8d6703640 1 Processor -- start 2024-09-13T18:45:08.705 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.703+0000 7fc8d6703640 1 -- start start 2024-09-13T18:45:08.708 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.704+0000 7fc8d6703640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8d00b0b30 0x7fc8d0140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:08.708 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.704+0000 7fc8d6703640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d00b36a0 0x7fc8d01d9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:08.708 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.704+0000 7fc8d6703640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc8d00ba200 0x7fc8d01d9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:08.708 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.704+0000 7fc8d6703640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d01d92c0 con 0x7fc8d00b36a0 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.704+0000 7fc8d6703640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d00a7700 con 0x7fc8d00b0b30 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.704+0000 7fc8d6703640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d013fb40 con 0x7fc8d00ba200 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.704+0000 7fc8cf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d00b36a0 0x7fc8d01d9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.704+0000 7fc8cf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d00b36a0 0x7fc8d01d9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37568/0 (socket says 172.21.15.29:37568) 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.704+0000 7fc8cf7fe640 1 -- 172.21.15.29:0/1162644168 learned_addr learned my addr 172.21.15.29:0/1162644168 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.704+0000 7fc8cffff640 1 --2- 172.21.15.29:0/1162644168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8d00b0b30 0x7fc8d0140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.704+0000 7fc8d4ca0640 1 --2- 172.21.15.29:0/1162644168 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc8d00ba200 0x7fc8d01d9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8cf7fe640 1 -- 172.21.15.29:0/1162644168 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc8d00ba200 msgr2=0x7fc8d01d9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8cf7fe640 1 --2- 172.21.15.29:0/1162644168 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc8d00ba200 0x7fc8d01d9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8cf7fe640 1 -- 172.21.15.29:0/1162644168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8d00b0b30 msgr2=0x7fc8d0140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8cf7fe640 1 --2- 172.21.15.29:0/1162644168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8d00b0b30 0x7fc8d0140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8cf7fe640 1 -- 172.21.15.29:0/1162644168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0009400 con 0x7fc8d00b36a0 2024-09-13T18:45:08.709 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8cf7fe640 1 --2- 172.21.15.29:0/1162644168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d00b36a0 0x7fc8d01d9710 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800e960 tx=0x7fc8b800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:08.710 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8ccff9640 1 -- 172.21.15.29:0/1162644168 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8009690 con 0x7fc8d00b36a0 2024-09-13T18:45:08.710 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8ccff9640 1 -- 172.21.15.29:0/1162644168 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b800ca00 con 0x7fc8d00b36a0 2024-09-13T18:45:08.710 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8d6703640 1 -- 172.21.15.29:0/1162644168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d013eb60 con 0x7fc8d00b36a0 2024-09-13T18:45:08.710 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8ccff9640 1 -- 172.21.15.29:0/1162644168 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800cdb0 con 0x7fc8d00b36a0 2024-09-13T18:45:08.710 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8d6703640 1 -- 172.21.15.29:0/1162644168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d00a7930 con 0x7fc8d00b36a0 2024-09-13T18:45:08.710 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8ccff9640 1 -- 172.21.15.29:0/1162644168 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc8b8005c90 con 0x7fc8d00b36a0 2024-09-13T18:45:08.710 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.705+0000 7fc8ccff9640 1 -- 172.21.15.29:0/1162644168 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc8b8013470 con 0x7fc8d00b36a0 2024-09-13T18:45:08.710 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.706+0000 7fc8d6703640 1 -- 172.21.15.29:0/1162644168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d01d9430 con 0x7fc8d00b36a0 2024-09-13T18:45:08.710 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.708+0000 7fc8ccff9640 1 -- 172.21.15.29:0/1162644168 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fc8d01d9430 con 0x7fc8d00b36a0 2024-09-13T18:45:08.738 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.735+0000 7f99e3523040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:45:08.748 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:08.745+0000 7f0533216040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:45:08.769 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.767+0000 7fc8d6703640 1 -- 172.21.15.29:0/1162644168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8d00b2bc0 con 0x7fc8d00b36a0 2024-09-13T18:45:08.770 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.767+0000 7fc8ccff9640 1 -- 172.21.15.29:0/1162644168 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc8b8029020 con 0x7fc8d00b36a0 2024-09-13T18:45:08.770 INFO:teuthology.misc.health.smithi029.stdout: 2024-09-13T18:45:08.770 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:07.566943+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:08.771 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.768+0000 7fc8d6703640 1 -- 172.21.15.29:0/1162644168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d00b36a0 msgr2=0x7fc8d01d9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:08.771 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.768+0000 7fc8d6703640 1 --2- 172.21.15.29:0/1162644168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d00b36a0 0x7fc8d01d9710 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800e960 tx=0x7fc8b800ee20 comp rx=0 tx=0).stop 2024-09-13T18:45:08.771 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.768+0000 7fc8d6703640 1 -- 172.21.15.29:0/1162644168 shutdown_connections 2024-09-13T18:45:08.771 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.768+0000 7fc8d6703640 1 --2- 172.21.15.29:0/1162644168 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc8d00ba200 0x7fc8d01d9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.771 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.768+0000 7fc8d6703640 1 --2- 172.21.15.29:0/1162644168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d00b36a0 0x7fc8d01d9710 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.771 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.768+0000 7fc8d6703640 1 --2- 172.21.15.29:0/1162644168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8d00b0b30 0x7fc8d0140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.772 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.768+0000 7fc8d6703640 1 -- 172.21.15.29:0/1162644168 >> 172.21.15.29:0/1162644168 conn(0x7fc8d006a500 msgr2=0x7fc8d0141c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:08.772 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.768+0000 7fc8d6703640 1 -- 172.21.15.29:0/1162644168 shutdown_connections 2024-09-13T18:45:08.772 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:08.769+0000 7fc8d6703640 1 -- 172.21.15.29:0/1162644168 wait complete. 2024-09-13T18:45:08.780 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:45:08.790 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.788+0000 7f99e3523040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:45:08.856 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.854+0000 7f99e3523040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:45:08.865 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:08.863+0000 7f0533216040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:45:08.899 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.897+0000 7f99e3523040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:45:08.917 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:08.915+0000 7f0533216040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:45:08.942 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:08.939+0000 7f99e3523040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:45:08.971 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:08.968+0000 7f0533216040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:45:09.041 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:09.039+0000 7f0533216040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:45:09.088 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:09.085+0000 7f0533216040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:45:09.134 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:09.131+0000 7f0533216040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:45:09.576 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:09.574+0000 7f99e3523040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:45:09.812 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-09-13T18:45:09.810+0000 7f0533216040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:45:10.591 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:10.589+0000 7f9983f07640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T18:45:10.591 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-13T18:45:10.589+0000 7f9983f07640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T18:45:11.711 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-09-13T18:45:11.709+0000 7f67f00ef640 -1 osd.3 0 log_to_monitors true 2024-09-13T18:45:11.714 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-09-13T18:45:11.712+0000 7fdaf6d45640 -1 osd.0 0 log_to_monitors true 2024-09-13T18:45:11.719 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-09-13T18:45:11.716+0000 7f0942017640 -1 osd.2 0 log_to_monitors true 2024-09-13T18:45:11.733 INFO:tasks.ceph.osd.6.smithi096.stderr:2024-09-13T18:45:11.731+0000 7f8c3b00d640 -1 osd.6 0 log_to_monitors true 2024-09-13T18:45:11.742 INFO:tasks.ceph.osd.4.smithi096.stderr:2024-09-13T18:45:11.740+0000 7fdc5b1dd640 -1 osd.4 0 log_to_monitors true 2024-09-13T18:45:11.743 INFO:tasks.ceph.osd.7.smithi096.stderr:2024-09-13T18:45:11.741+0000 7f59f0611640 -1 osd.7 0 log_to_monitors true 2024-09-13T18:45:11.745 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-09-13T18:45:11.743+0000 7f47a2da4640 -1 osd.1 0 log_to_monitors true 2024-09-13T18:45:11.748 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-09-13T18:45:11.745+0000 7ff902487640 -1 osd.5 0 log_to_monitors true 2024-09-13T18:45:14.591 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-09-13T18:45:14.588+0000 7ff8fe414640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T18:45:14.596 INFO:tasks.ceph.osd.6.smithi096.stderr:2024-09-13T18:45:14.593+0000 7f8c368eb640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T18:45:14.603 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-09-13T18:45:14.601+0000 7ff8f6235640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:45:14.610 INFO:tasks.ceph.osd.7.smithi096.stderr:2024-09-13T18:45:14.606+0000 7f59ebe84640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T18:45:14.615 INFO:tasks.ceph.osd.6.smithi096.stderr:2024-09-13T18:45:14.612+0000 7f8c2e70c640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:45:14.626 INFO:tasks.ceph.osd.7.smithi096.stderr:2024-09-13T18:45:14.624+0000 7f59e3ca5640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:45:14.628 INFO:tasks.ceph.osd.4.smithi096.stderr:2024-09-13T18:45:14.626+0000 7fdc5716a640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T18:45:14.632 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-09-13T18:45:14.627+0000 7fdaf2cd2640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T18:45:14.637 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-09-13T18:45:14.635+0000 7f67ec07c640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T18:45:14.645 INFO:tasks.ceph.osd.4.smithi096.stderr:2024-09-13T18:45:14.643+0000 7fdc4ef8b640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:45:14.647 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-09-13T18:45:14.645+0000 7fdaeaaf3640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:45:14.653 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-09-13T18:45:14.651+0000 7f479ed31640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T18:45:14.659 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-09-13T18:45:14.657+0000 7f67e3e9d640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:45:14.660 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-09-13T18:45:14.658+0000 7f093d9fe640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T18:45:14.665 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-09-13T18:45:14.663+0000 7f4796b52640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:45:14.678 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-09-13T18:45:14.676+0000 7f093581f640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:45:15.587 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:15.698 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.696+0000 7f45df9ef640 1 Processor -- start 2024-09-13T18:45:15.698 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.696+0000 7f45df9ef640 1 -- start start 2024-09-13T18:45:15.700 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45df9ef640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f45d806f5b0 0x7f45d813fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:15.700 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45df9ef640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f45d814e340 0x7f45d8150730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:15.700 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45df9ef640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d806a3e0 con 0x7f45d80b3330 2024-09-13T18:45:15.700 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45df9ef640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d8148fc0 con 0x7f45d814e340 2024-09-13T18:45:15.700 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45df9ef640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80b40b0 con 0x7f45d806f5b0 2024-09-13T18:45:15.700 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45dd78b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f45d806f5b0 0x7f45d813fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:15.700 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45dd78b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f45d806f5b0 0x7f45d813fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44970/0 (socket says 172.21.15.29:44970) 2024-09-13T18:45:15.700 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45dd78b640 1 -- 172.21.15.29:0/410996449 learned_addr learned my addr 172.21.15.29:0/410996449 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:15.701 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45dcf8a640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f45d80b3330 0x7f45d8070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:44268/0 (socket says 172.21.15.29:44268) 2024-09-13T18:45:15.701 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45ddf8c640 1 --2- 172.21.15.29:0/410996449 >> v2:172.21.15.96:3300/0 conn(0x7f45d814e340 0x7f45d8150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:15.701 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45cffff640 1 -- 172.21.15.29:0/410996449 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681860055 0 0) 0x7f45d806a3e0 con 0x7f45d80b3330 2024-09-13T18:45:15.701 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45cffff640 1 -- 172.21.15.29:0/410996449 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45c4003520 con 0x7f45d80b3330 2024-09-13T18:45:15.701 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45ddf8c640 1 -- 172.21.15.29:0/410996449 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f45d806f5b0 msgr2=0x7f45d813fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:15.701 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45ddf8c640 1 --2- 172.21.15.29:0/410996449 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f45d806f5b0 0x7f45d813fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.701 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45ddf8c640 1 -- 172.21.15.29:0/410996449 >> v1:172.21.15.96:6789/0 conn(0x7f45d80b3330 legacy=0x7f45d8070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:15.701 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45ddf8c640 1 -- 172.21.15.29:0/410996449 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d806f990 con 0x7f45d814e340 2024-09-13T18:45:15.701 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.697+0000 7f45dd78b640 1 --2- 172.21.15.29:0/410996449 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f45d806f5b0 0x7f45d813fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:15.702 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.698+0000 7f45ddf8c640 1 --2- 172.21.15.29:0/410996449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d814e340 0x7f45d8150730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009d90 tx=0x7f45d002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9bd8a090e6f3ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.698+0000 7f45cffff640 1 -- 172.21.15.29:0/410996449 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0031600 con 0x7f45d814e340 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.698+0000 7f45cffff640 1 -- 172.21.15.29:0/410996449 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d002d050 con 0x7f45d814e340 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.698+0000 7f45cffff640 1 -- 172.21.15.29:0/410996449 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0031960 con 0x7f45d814e340 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.699+0000 7f45df9ef640 1 -- 172.21.15.29:0/410996449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d814e340 msgr2=0x7f45d8150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.699+0000 7f45df9ef640 1 --2- 172.21.15.29:0/410996449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d814e340 0x7f45d8150730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009d90 tx=0x7f45d002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.699+0000 7f45df9ef640 1 -- 172.21.15.29:0/410996449 shutdown_connections 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.699+0000 7f45df9ef640 1 --2- 172.21.15.29:0/410996449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d814e340 0x7f45d8150730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.699+0000 7f45df9ef640 1 --2- 172.21.15.29:0/410996449 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f45d806f5b0 0x7f45d813fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.699+0000 7f45df9ef640 1 -- 172.21.15.29:0/410996449 >> 172.21.15.29:0/410996449 conn(0x7f45d80b7710 msgr2=0x7f45d80b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.699+0000 7f45df9ef640 1 -- 172.21.15.29:0/410996449 shutdown_connections 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.699+0000 7f45df9ef640 1 -- 172.21.15.29:0/410996449 wait complete. 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.700+0000 7f45df9ef640 1 Processor -- start 2024-09-13T18:45:15.703 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.700+0000 7f45df9ef640 1 -- start start 2024-09-13T18:45:15.705 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45df9ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d806f5b0 0x7f45d80b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:15.705 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45df9ef640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f45d80b3330 0x7f45d80ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:15.705 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45df9ef640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d814e340 0x7f45d80abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45df9ef640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80ad0b0 con 0x7f45d806f5b0 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45df9ef640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d8141640 con 0x7f45d814e340 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45df9ef640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d81406a0 con 0x7f45d80b3330 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45dd78b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d806f5b0 0x7f45d80b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45dd78b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d806f5b0 0x7f45d80b67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33290/0 (socket says 172.21.15.29:33290) 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45dd78b640 1 -- 172.21.15.29:0/1624461652 learned_addr learned my addr 172.21.15.29:0/1624461652 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45dcf8a640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f45d80b3330 0x7f45d80ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45ddf8c640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d814e340 0x7f45d80abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45dd78b640 1 -- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f45d80b3330 msgr2=0x7f45d80ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45dd78b640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f45d80b3330 0x7f45d80ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45dd78b640 1 -- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d814e340 msgr2=0x7f45d80abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45dd78b640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d814e340 0x7f45d80abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.706 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.701+0000 7f45dd78b640 1 -- 172.21.15.29:0/1624461652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d40094d0 con 0x7f45d806f5b0 2024-09-13T18:45:15.707 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.702+0000 7f45dd78b640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d806f5b0 0x7f45d80b67d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45d400e9d0 tx=0x7f45d400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:15.707 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.702+0000 7f45cdffb640 1 -- 172.21.15.29:0/1624461652 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d400ca60 con 0x7f45d806f5b0 2024-09-13T18:45:15.707 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.702+0000 7f45cdffb640 1 -- 172.21.15.29:0/1624461652 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d400cbc0 con 0x7f45d806f5b0 2024-09-13T18:45:15.707 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.702+0000 7f45df9ef640 1 -- 172.21.15.29:0/1624461652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d0009a70 con 0x7f45d806f5b0 2024-09-13T18:45:15.707 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.702+0000 7f45cdffb640 1 -- 172.21.15.29:0/1624461652 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4013470 con 0x7f45d806f5b0 2024-09-13T18:45:15.707 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.702+0000 7f45df9ef640 1 -- 172.21.15.29:0/1624461652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d80b72c0 con 0x7f45d806f5b0 2024-09-13T18:45:15.707 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.703+0000 7f45df9ef640 1 -- 172.21.15.29:0/1624461652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d806ef70 con 0x7f45d806f5b0 2024-09-13T18:45:15.708 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.703+0000 7f45cdffb640 1 -- 172.21.15.29:0/1624461652 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f45d40135d0 con 0x7f45d806f5b0 2024-09-13T18:45:15.708 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.704+0000 7f45cdffb640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f45bc06ab70 0x7f45bc06d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:15.708 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.704+0000 7f45cdffb640 1 -- 172.21.15.29:0/1624461652 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f45d4088ff0 con 0x7f45d806f5b0 2024-09-13T18:45:15.708 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.704+0000 7f45dcf8a640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f45bc06ab70 0x7f45bc06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:15.708 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.704+0000 7f45dcf8a640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f45bc06ab70 0x7f45bc06d030 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f45d80ad040 tx=0x7f45c8007cf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:15.711 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.708+0000 7f45cdffb640 1 -- 172.21.15.29:0/1624461652 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f45d4054840 con 0x7f45d806f5b0 2024-09-13T18:45:15.887 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.884+0000 7f45df9ef640 1 -- 172.21.15.29:0/1624461652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45d81433f0 con 0x7f45d806f5b0 2024-09-13T18:45:15.887 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.885+0000 7f45cdffb640 1 -- 172.21.15.29:0/1624461652 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10860 (secure 0 0 0) 0x7f45d4017090 con 0x7f45d806f5b0 2024-09-13T18:45:15.888 INFO:teuthology.misc.health.smithi029.stdout: 2024-09-13T18:45:15.888 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":13,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:15.604097+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:15.891 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.887+0000 7f45df9ef640 1 -- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f45bc06ab70 msgr2=0x7f45bc06d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:15.891 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.887+0000 7f45df9ef640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f45bc06ab70 0x7f45bc06d030 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f45d80ad040 tx=0x7f45c8007cf0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.891 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.887+0000 7f45df9ef640 1 -- 172.21.15.29:0/1624461652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d806f5b0 msgr2=0x7f45d80b67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:15.891 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.887+0000 7f45df9ef640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d806f5b0 0x7f45d80b67d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45d400e9d0 tx=0x7f45d400ee90 comp rx=0 tx=0).stop 2024-09-13T18:45:15.891 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.887+0000 7f45df9ef640 1 -- 172.21.15.29:0/1624461652 shutdown_connections 2024-09-13T18:45:15.891 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.887+0000 7f45df9ef640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f45bc06ab70 0x7f45bc06d030 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.891 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.887+0000 7f45df9ef640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d814e340 0x7f45d80abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.891 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.887+0000 7f45df9ef640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f45d80b3330 0x7f45d80ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.891 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.887+0000 7f45df9ef640 1 --2- 172.21.15.29:0/1624461652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d806f5b0 0x7f45d80b67d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.892 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.888+0000 7f45df9ef640 1 -- 172.21.15.29:0/1624461652 >> 172.21.15.29:0/1624461652 conn(0x7f45d80b7710 msgr2=0x7f45d80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:15.892 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.888+0000 7f45df9ef640 1 -- 172.21.15.29:0/1624461652 shutdown_connections 2024-09-13T18:45:15.892 INFO:teuthology.misc.health.smithi029.stderr:2024-09-13T18:45:15.888+0000 7f45df9ef640 1 -- 172.21.15.29:0/1624461652 wait complete. 2024-09-13T18:45:15.899 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T18:45:15.899 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T18:45:15.899 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:45:15.900 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:45:15.902 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:45:15.902 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:45:15.902 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:45:15.904 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:45:15.904 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T18:45:15.905 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:15.977 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-09-13T18:45:15.986 INFO:tasks.ceph.mds.b.smithi096.stdout:starting mds.b at 2024-09-13T18:45:16.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.004+0000 7fcc412b8640 1 Processor -- start 2024-09-13T18:45:16.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.004+0000 7fcc412b8640 1 -- start start 2024-09-13T18:45:16.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc412b8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcc3c0b04a0 0x7fcc3c145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc412b8640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcc3c146130 0x7fcc3c14cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc412b8640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3c06f230 con 0x7fcc3c0b1fc0 2024-09-13T18:45:16.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc412b8640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3c0b08d0 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc412b8640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c0b23a0 con 0x7fcc3c146130 2024-09-13T18:45:16.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc3affd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcc3c0b1fc0 0x7fcc3c13c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52010/0 (socket says 172.21.15.29:52010) 2024-09-13T18:45:16.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc3affd640 1 -- 172.21.15.29:0/2681727998 learned_addr learned my addr 172.21.15.29:0/2681727998 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:16.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc3a7fc640 1 --2- 172.21.15.29:0/2681727998 >> v2:172.21.15.96:3300/0 conn(0x7fcc3c0b04a0 0x7fcc3c145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc3b7fe640 1 --2- 172.21.15.29:0/2681727998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcc3c146130 0x7fcc3c14cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc39ffb640 1 -- 172.21.15.29:0/2681727998 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140623477 0 0) 0x7fcc3c06f230 con 0x7fcc3c0b1fc0 2024-09-13T18:45:16.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc39ffb640 1 -- 172.21.15.29:0/2681727998 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc24005730 con 0x7fcc3c0b1fc0 2024-09-13T18:45:16.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc3a7fc640 1 -- 172.21.15.29:0/2681727998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcc3c146130 msgr2=0x7fcc3c14cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:16.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc39ffb640 1 -- 172.21.15.29:0/2681727998 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 760141794 0 0) 0x7fcc24005730 con 0x7fcc3c0b1fc0 2024-09-13T18:45:16.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc3a7fc640 1 --2- 172.21.15.29:0/2681727998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcc3c146130 0x7fcc3c14cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc3a7fc640 1 -- 172.21.15.29:0/2681727998 >> v1:172.21.15.29:6789/0 conn(0x7fcc3c0b1fc0 legacy=0x7fcc3c13c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc3a7fc640 1 -- 172.21.15.29:0/2681727998 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c0b0d70 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.005+0000 7fcc3b7fe640 1 --2- 172.21.15.29:0/2681727998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcc3c146130 0x7fcc3c14cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:16.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.006+0000 7fcc3a7fc640 1 --2- 172.21.15.29:0/2681727998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc3c0b04a0 0x7fcc3c145bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc300097a0 tx=0x7fcc3002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6758cb8bcfd4eb13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.006+0000 7fcc39ffb640 1 -- 172.21.15.29:0/2681727998 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c001670 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.006+0000 7fcc39ffb640 1 -- 172.21.15.29:0/2681727998 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3002aba0 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.006+0000 7fcc39ffb640 1 -- 172.21.15.29:0/2681727998 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30032440 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.007+0000 7fcc412b8640 1 -- 172.21.15.29:0/2681727998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc3c0b04a0 msgr2=0x7fcc3c145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.007+0000 7fcc412b8640 1 --2- 172.21.15.29:0/2681727998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc3c0b04a0 0x7fcc3c145bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc300097a0 tx=0x7fcc3002a110 comp rx=0 tx=0).stop 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.007+0000 7fcc412b8640 1 -- 172.21.15.29:0/2681727998 shutdown_connections 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.007+0000 7fcc412b8640 1 --2- 172.21.15.29:0/2681727998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcc3c146130 0x7fcc3c14cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.007+0000 7fcc412b8640 1 --2- 172.21.15.29:0/2681727998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc3c0b04a0 0x7fcc3c145bf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.007+0000 7fcc412b8640 1 -- 172.21.15.29:0/2681727998 >> 172.21.15.29:0/2681727998 conn(0x7fcc3c06a890 msgr2=0x7fcc3c0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.007+0000 7fcc412b8640 1 -- 172.21.15.29:0/2681727998 shutdown_connections 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.007+0000 7fcc412b8640 1 -- 172.21.15.29:0/2681727998 wait complete. 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.008+0000 7fcc412b8640 1 Processor -- start 2024-09-13T18:45:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.008+0000 7fcc412b8640 1 -- start start 2024-09-13T18:45:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc412b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc3c0b04a0 0x7fcc3c1da6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc412b8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc3c0b1fc0 0x7fcc3c1dae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc412b8640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcc3c146130 0x7fcc3c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc412b8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c1db380 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc412b8640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c143130 con 0x7fcc3c0b1fc0 2024-09-13T18:45:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc412b8640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c13f460 con 0x7fcc3c146130 2024-09-13T18:45:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc3affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc3c0b04a0 0x7fcc3c1da6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc3affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc3c0b04a0 0x7fcc3c1da6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33304/0 (socket says 172.21.15.29:33304) 2024-09-13T18:45:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc3affd640 1 -- 172.21.15.29:0/933295297 learned_addr learned my addr 172.21.15.29:0/933295297 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc3a7fc640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc3c0b1fc0 0x7fcc3c1dae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc3b7fe640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcc3c146130 0x7fcc3c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc3affd640 1 -- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcc3c146130 msgr2=0x7fcc3c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc3affd640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcc3c146130 0x7fcc3c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc3affd640 1 -- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc3c0b1fc0 msgr2=0x7fcc3c1dae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc3affd640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc3c0b1fc0 0x7fcc3c1dae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc3affd640 1 -- 172.21.15.29:0/933295297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc34009a70 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc3affd640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc3c0b04a0 0x7fcc3c1da6a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0011e0 tx=0x7fcc2c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc237fe640 1 -- 172.21.15.29:0/933295297 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c005ad0 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc237fe640 1 -- 172.21.15.29:0/933295297 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c005c50 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc237fe640 1 -- 172.21.15.29:0/933295297 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c00ce80 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.009+0000 7fcc412b8640 1 -- 172.21.15.29:0/933295297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc30009400 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.010+0000 7fcc412b8640 1 -- 172.21.15.29:0/933295297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3c143380 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.011+0000 7fcc412b8640 1 -- 172.21.15.29:0/933295297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3c0b81b0 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.011+0000 7fcc237fe640 1 -- 172.21.15.29:0/933295297 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fcc2c007070 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.011+0000 7fcc237fe640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fcc2806ab70 0x7fcc2806d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.011+0000 7fcc237fe640 1 -- 172.21.15.29:0/933295297 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fcc2c088340 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.011+0000 7fcc3a7fc640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fcc2806ab70 0x7fcc2806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.012+0000 7fcc3a7fc640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fcc2806ab70 0x7fcc2806d030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcc30034000 tx=0x7fcc3002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.016+0000 7fcc237fe640 1 -- 172.21.15.29:0/933295297 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcc2c053c10 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.189+0000 7fcc412b8640 1 -- 172.21.15.29:0/933295297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc3c1435f0 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.189+0000 7fcc237fe640 1 -- 172.21.15.29:0/933295297 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10860 (secure 0 0 0) 0x7fcc2c017090 con 0x7fcc3c0b04a0 2024-09-13T18:45:16.192 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:16.192 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:15.604097+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:16.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.191+0000 7fcc412b8640 1 -- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fcc2806ab70 msgr2=0x7fcc2806d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.191+0000 7fcc412b8640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fcc2806ab70 0x7fcc2806d030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcc30034000 tx=0x7fcc3002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:16.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.191+0000 7fcc412b8640 1 -- 172.21.15.29:0/933295297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc3c0b04a0 msgr2=0x7fcc3c1da6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.191+0000 7fcc412b8640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc3c0b04a0 0x7fcc3c1da6a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0011e0 tx=0x7fcc2c00cb40 comp rx=0 tx=0).stop 2024-09-13T18:45:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.191+0000 7fcc412b8640 1 -- 172.21.15.29:0/933295297 shutdown_connections 2024-09-13T18:45:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.191+0000 7fcc412b8640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fcc2806ab70 0x7fcc2806d030 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.191+0000 7fcc412b8640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcc3c146130 0x7fcc3c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.191+0000 7fcc412b8640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc3c0b1fc0 0x7fcc3c1dae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.191+0000 7fcc412b8640 1 --2- 172.21.15.29:0/933295297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc3c0b04a0 0x7fcc3c1da6a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.192+0000 7fcc412b8640 1 -- 172.21.15.29:0/933295297 >> 172.21.15.29:0/933295297 conn(0x7fcc3c06a890 msgr2=0x7fcc3c070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.192+0000 7fcc412b8640 1 -- 172.21.15.29:0/933295297 shutdown_connections 2024-09-13T18:45:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.192+0000 7fcc412b8640 1 -- 172.21.15.29:0/933295297 wait complete. 2024-09-13T18:45:16.205 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-09-13T18:45:16.205 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:16.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.303+0000 7fd38c7e9640 1 Processor -- start 2024-09-13T18:45:16.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.304+0000 7fd38c7e9640 1 -- start start 2024-09-13T18:45:16.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.304+0000 7fd38c7e9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3840b4470 0x7fd384145e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.304+0000 7fd38c7e9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd3840b3840 0x7fd3840b7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.304+0000 7fd38c7e9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3840b5940 con 0x7fd3840b4850 2024-09-13T18:45:16.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.304+0000 7fd38c7e9640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38413c940 con 0x7fd3840b3840 2024-09-13T18:45:16.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.304+0000 7fd38c7e9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd384146590 con 0x7fd3840b4470 2024-09-13T18:45:16.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.304+0000 7fd38ad86640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd3840b3840 0x7fd3840b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.305+0000 7fd38ad86640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd3840b3840 0x7fd3840b7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33312/0 (socket says 172.21.15.29:33312) 2024-09-13T18:45:16.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.305+0000 7fd38ad86640 1 -- 172.21.15.29:0/1908862483 learned_addr learned my addr 172.21.15.29:0/1908862483 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:16.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.305+0000 7fd38a585640 1 --2- 172.21.15.29:0/1908862483 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3840b4470 0x7fd384145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.305+0000 7fd38ad86640 1 -- 172.21.15.29:0/1908862483 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3840b4470 msgr2=0x7fd384145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:16.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.305+0000 7fd38ad86640 1 --2- 172.21.15.29:0/1908862483 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3840b4470 0x7fd384145e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.305+0000 7fd38ad86640 1 -- 172.21.15.29:0/1908862483 >> v1:172.21.15.96:6789/0 conn(0x7fd3840b4850 legacy=0x7fd3840b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:16.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.305+0000 7fd38ad86640 1 -- 172.21.15.29:0/1908862483 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384146870 con 0x7fd3840b3840 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.305+0000 7fd38ad86640 1 --2- 172.21.15.29:0/1908862483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840b3840 0x7fd3840b7420 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009e50 tx=0x7fd37c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593a106c8131a6fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.306+0000 7fd389583640 1 -- 172.21.15.29:0/1908862483 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c02aea0 con 0x7fd3840b3840 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.306+0000 7fd389583640 1 -- 172.21.15.29:0/1908862483 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c02d050 con 0x7fd3840b3840 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.306+0000 7fd389583640 1 -- 172.21.15.29:0/1908862483 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c031820 con 0x7fd3840b3840 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.306+0000 7fd38c7e9640 1 -- 172.21.15.29:0/1908862483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840b3840 msgr2=0x7fd3840b7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.306+0000 7fd38c7e9640 1 --2- 172.21.15.29:0/1908862483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840b3840 0x7fd3840b7420 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009e50 tx=0x7fd37c02a6c0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.306+0000 7fd38c7e9640 1 -- 172.21.15.29:0/1908862483 shutdown_connections 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.306+0000 7fd38c7e9640 1 --2- 172.21.15.29:0/1908862483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840b3840 0x7fd3840b7420 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.306+0000 7fd38c7e9640 1 --2- 172.21.15.29:0/1908862483 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3840b4470 0x7fd384145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.306+0000 7fd38c7e9640 1 -- 172.21.15.29:0/1908862483 >> 172.21.15.29:0/1908862483 conn(0x7fd3840b80c0 msgr2=0x7fd3840b84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.306+0000 7fd38c7e9640 1 -- 172.21.15.29:0/1908862483 shutdown_connections 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.306+0000 7fd38c7e9640 1 -- 172.21.15.29:0/1908862483 wait complete. 2024-09-13T18:45:16.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.307+0000 7fd38c7e9640 1 Processor -- start 2024-09-13T18:45:16.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.307+0000 7fd38c7e9640 1 -- start start 2024-09-13T18:45:16.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd38c7e9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3840b3840 0x7fd3840bb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd38c7e9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840b4470 0x7fd384141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd38c7e9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3840b4850 0x7fd384146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd38c7e9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3841dedf0 con 0x7fd3840b4470 2024-09-13T18:45:16.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd38c7e9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840bb820 con 0x7fd3840b3840 2024-09-13T18:45:16.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd38c7e9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd384140eb0 con 0x7fd3840b4850 2024-09-13T18:45:16.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd389d84640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840b4470 0x7fd384141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd389d84640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840b4470 0x7fd384141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33316/0 (socket says 172.21.15.29:33316) 2024-09-13T18:45:16.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd389d84640 1 -- 172.21.15.29:0/2585546435 learned_addr learned my addr 172.21.15.29:0/2585546435 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:16.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd38a585640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3840b3840 0x7fd3840bb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd38ad86640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3840b4850 0x7fd384146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd389d84640 1 -- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3840b4850 msgr2=0x7fd384146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd389d84640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3840b4850 0x7fd384146b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd389d84640 1 -- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3840b3840 msgr2=0x7fd3840bb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd389d84640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3840b3840 0x7fd3840bb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd389d84640 1 -- 172.21.15.29:0/2585546435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c009b30 con 0x7fd3840b4470 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.308+0000 7fd38a585640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3840b3840 0x7fd3840bb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.309+0000 7fd389d84640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840b4470 0x7fd384141620 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd37400b3c0 tx=0x7fd37400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.309+0000 7fd37affd640 1 -- 172.21.15.29:0/2585546435 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374011830 con 0x7fd3840b4470 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.309+0000 7fd37affd640 1 -- 172.21.15.29:0/2585546435 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd374011990 con 0x7fd3840b4470 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.309+0000 7fd37affd640 1 -- 172.21.15.29:0/2585546435 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374011d80 con 0x7fd3840b4470 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.309+0000 7fd38c7e9640 1 -- 172.21.15.29:0/2585546435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd384141190 con 0x7fd3840b4470 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.309+0000 7fd38c7e9640 1 -- 172.21.15.29:0/2585546435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3841dea10 con 0x7fd3840b4470 2024-09-13T18:45:16.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.310+0000 7fd38c7e9640 1 -- 172.21.15.29:0/2585546435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3841def30 con 0x7fd3840b4470 2024-09-13T18:45:16.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.310+0000 7fd37affd640 1 -- 172.21.15.29:0/2585546435 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fd37401b460 con 0x7fd3840b4470 2024-09-13T18:45:16.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.311+0000 7fd37affd640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd36806ab70 0x7fd36806d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.311+0000 7fd37affd640 1 -- 172.21.15.29:0/2585546435 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fd3740888b0 con 0x7fd3840b4470 2024-09-13T18:45:16.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.311+0000 7fd38a585640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd36806ab70 0x7fd36806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.312+0000 7fd38a585640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd36806ab70 0x7fd36806d030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd3840738e0 tx=0x7fd380008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.315+0000 7fd37affd640 1 -- 172.21.15.29:0/2585546435 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd3841def30 con 0x7fd3840b4470 2024-09-13T18:45:16.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.524+0000 7fd38c7e9640 1 -- 172.21.15.29:0/2585546435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3841def30 con 0x7fd3840b4470 2024-09-13T18:45:16.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.524+0000 7fd37affd640 1 -- 172.21.15.29:0/2585546435 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1253 (secure 0 0 0) 0x7fd3841def30 con 0x7fd3840b4470 2024-09-13T18:45:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:16.527 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/175129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":175129703},{"type":"v1","addr":"172.21.15.29:6833","nonce":175129703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:45:16.527 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 2 2024-09-13T18:45:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.526+0000 7fd38c7e9640 1 -- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd36806ab70 msgr2=0x7fd36806d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.526+0000 7fd38c7e9640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd36806ab70 0x7fd36806d030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd3840738e0 tx=0x7fd380008040 comp rx=0 tx=0).stop 2024-09-13T18:45:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.526+0000 7fd38c7e9640 1 -- 172.21.15.29:0/2585546435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840b4470 msgr2=0x7fd384141620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.526+0000 7fd38c7e9640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840b4470 0x7fd384141620 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd37400b3c0 tx=0x7fd37400b880 comp rx=0 tx=0).stop 2024-09-13T18:45:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.526+0000 7fd38c7e9640 1 -- 172.21.15.29:0/2585546435 shutdown_connections 2024-09-13T18:45:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.526+0000 7fd38c7e9640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd36806ab70 0x7fd36806d030 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.526+0000 7fd38c7e9640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3840b4850 0x7fd384146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.526+0000 7fd38c7e9640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840b4470 0x7fd384141620 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.526+0000 7fd38c7e9640 1 --2- 172.21.15.29:0/2585546435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3840b3840 0x7fd3840bb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.526+0000 7fd38c7e9640 1 -- 172.21.15.29:0/2585546435 >> 172.21.15.29:0/2585546435 conn(0x7fd3840b80c0 msgr2=0x7fd3841d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.526+0000 7fd38c7e9640 1 -- 172.21.15.29:0/2585546435 shutdown_connections 2024-09-13T18:45:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:16.526+0000 7fd38c7e9640 1 -- 172.21.15.29:0/2585546435 wait complete. 2024-09-13T18:45:18.540 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:18.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.652+0000 7f74b96e9640 1 Processor -- start 2024-09-13T18:45:18.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.652+0000 7f74b96e9640 1 -- start start 2024-09-13T18:45:18.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b96e9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f74b40b9fb0 0x7f74b4149430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b96e9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f74b406c660 0x7f74b4149970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b96e9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b40ba390 con 0x7f74b413f4c0 2024-09-13T18:45:18.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b96e9640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b406bcf0 con 0x7f74b406c660 2024-09-13T18:45:18.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b96e9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b4148fe0 con 0x7f74b40b9fb0 2024-09-13T18:45:18.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b27fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f74b406c660 0x7f74b4149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b37fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f74b413f4c0 0x7f74b413f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52014/0 (socket says 172.21.15.29:52014) 2024-09-13T18:45:18.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b37fe640 1 -- 172.21.15.29:0/2063535582 learned_addr learned my addr 172.21.15.29:0/2063535582 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:18.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b2ffd640 1 --2- 172.21.15.29:0/2063535582 >> v2:172.21.15.96:3300/0 conn(0x7f74b40b9fb0 0x7f74b4149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b27fc640 1 -- 172.21.15.29:0/2063535582 >> v2:172.21.15.96:3300/0 conn(0x7f74b40b9fb0 msgr2=0x7f74b4149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:18.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b27fc640 1 --2- 172.21.15.29:0/2063535582 >> v2:172.21.15.96:3300/0 conn(0x7f74b40b9fb0 0x7f74b4149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b27fc640 1 -- 172.21.15.29:0/2063535582 >> v1:172.21.15.29:6789/0 conn(0x7f74b413f4c0 legacy=0x7f74b413f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b27fc640 1 -- 172.21.15.29:0/2063535582 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b406c1d0 con 0x7f74b406c660 2024-09-13T18:45:18.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.653+0000 7f74b1ffb640 1 -- 172.21.15.29:0/2063535582 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140150539 0 0) 0x7f74b40ba390 con 0x7f74b413f4c0 2024-09-13T18:45:18.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.654+0000 7f74b27fc640 1 --2- 172.21.15.29:0/2063535582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b406c660 0x7f74b4149970 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f74b406ae40 tx=0x7f74a802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61da6e390f8cb418 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:18.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.654+0000 7f74b1ffb640 1 -- 172.21.15.29:0/2063535582 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8032440 con 0x7f74b406c660 2024-09-13T18:45:18.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.654+0000 7f74b1ffb640 1 -- 172.21.15.29:0/2063535582 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a80325a0 con 0x7f74b406c660 2024-09-13T18:45:18.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.654+0000 7f74b1ffb640 1 -- 172.21.15.29:0/2063535582 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8032930 con 0x7f74b406c660 2024-09-13T18:45:18.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.655+0000 7f74b96e9640 1 -- 172.21.15.29:0/2063535582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b406c660 msgr2=0x7f74b4149970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.655+0000 7f74b96e9640 1 --2- 172.21.15.29:0/2063535582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b406c660 0x7f74b4149970 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f74b406ae40 tx=0x7f74a802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.655+0000 7f74b96e9640 1 -- 172.21.15.29:0/2063535582 shutdown_connections 2024-09-13T18:45:18.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.655+0000 7f74b96e9640 1 --2- 172.21.15.29:0/2063535582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b406c660 0x7f74b4149970 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.655+0000 7f74b96e9640 1 --2- 172.21.15.29:0/2063535582 >> v2:172.21.15.96:3300/0 conn(0x7f74b40b9fb0 0x7f74b4149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.655+0000 7f74b96e9640 1 -- 172.21.15.29:0/2063535582 >> 172.21.15.29:0/2063535582 conn(0x7f74b406a500 msgr2=0x7f74b40b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:18.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.655+0000 7f74b96e9640 1 -- 172.21.15.29:0/2063535582 shutdown_connections 2024-09-13T18:45:18.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.655+0000 7f74b96e9640 1 -- 172.21.15.29:0/2063535582 wait complete. 2024-09-13T18:45:18.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.656+0000 7f74b96e9640 1 Processor -- start 2024-09-13T18:45:18.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.656+0000 7f74b96e9640 1 -- start start 2024-09-13T18:45:18.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.657+0000 7f74b96e9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74b406c660 0x7f74b41419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.657+0000 7f74b96e9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f74b40b9fb0 0x7f74b40b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.657+0000 7f74b96e9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b413f4c0 0x7f74b4144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.657+0000 7f74b96e9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b41416d0 con 0x7f74b413f4c0 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.657+0000 7f74b96e9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4143060 con 0x7f74b406c660 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.657+0000 7f74b96e9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4141080 con 0x7f74b40b9fb0 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.657+0000 7f74b37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b413f4c0 0x7f74b4144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.657+0000 7f74b37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b413f4c0 0x7f74b4144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33324/0 (socket says 172.21.15.29:33324) 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.657+0000 7f74b37fe640 1 -- 172.21.15.29:0/2118206716 learned_addr learned my addr 172.21.15.29:0/2118206716 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.657+0000 7f74b2ffd640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74b406c660 0x7f74b41419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.657+0000 7f74b27fc640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f74b40b9fb0 0x7f74b40b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.658+0000 7f74b37fe640 1 -- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f74b40b9fb0 msgr2=0x7f74b40b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.658+0000 7f74b37fe640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f74b40b9fb0 0x7f74b40b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.658+0000 7f74b37fe640 1 -- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74b406c660 msgr2=0x7f74b41419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.658+0000 7f74b37fe640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74b406c660 0x7f74b41419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.658+0000 7f74b37fe640 1 -- 172.21.15.29:0/2118206716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8009400 con 0x7f74b413f4c0 2024-09-13T18:45:18.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.658+0000 7f74b27fc640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f74b40b9fb0 0x7f74b40b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:18.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.658+0000 7f74b37fe640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b413f4c0 0x7f74b4144770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00c780 tx=0x7f74ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:18.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.658+0000 7f749b7fe640 1 -- 172.21.15.29:0/2118206716 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00ce90 con 0x7f74b413f4c0 2024-09-13T18:45:18.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.658+0000 7f749b7fe640 1 -- 172.21.15.29:0/2118206716 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac00a640 con 0x7f74b413f4c0 2024-09-13T18:45:18.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.658+0000 7f749b7fe640 1 -- 172.21.15.29:0/2118206716 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00a9d0 con 0x7f74b413f4c0 2024-09-13T18:45:18.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.658+0000 7f74b96e9640 1 -- 172.21.15.29:0/2118206716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b4141360 con 0x7f74b413f4c0 2024-09-13T18:45:18.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.658+0000 7f74b96e9640 1 -- 172.21.15.29:0/2118206716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b4146370 con 0x7f74b413f4c0 2024-09-13T18:45:18.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.659+0000 7f74b96e9640 1 -- 172.21.15.29:0/2118206716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b413f910 con 0x7f74b413f4c0 2024-09-13T18:45:18.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.660+0000 7f749b7fe640 1 -- 172.21.15.29:0/2118206716 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f74ac00ab30 con 0x7f74b413f4c0 2024-09-13T18:45:18.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.660+0000 7f749b7fe640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f74a006ab70 0x7f74a006d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.660+0000 7f749b7fe640 1 -- 172.21.15.29:0/2118206716 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f74ac0883c0 con 0x7f74b413f4c0 2024-09-13T18:45:18.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.660+0000 7f74b2ffd640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f74a006ab70 0x7f74a006d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.661+0000 7f74b2ffd640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f74a006ab70 0x7f74a006d030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009b40 tx=0x7f74a4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:18.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.665+0000 7f749b7fe640 1 -- 172.21.15.29:0/2118206716 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f74ac053a90 con 0x7f74b413f4c0 2024-09-13T18:45:18.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.872+0000 7f74b96e9640 1 -- 172.21.15.29:0/2118206716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74b4141810 con 0x7f74b413f4c0 2024-09-13T18:45:18.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.872+0000 7f749b7fe640 1 -- 172.21.15.29:0/2118206716 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2009 (secure 0 0 0) 0x7f74b4141810 con 0x7f74b413f4c0 2024-09-13T18:45:18.875 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:18.875 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/3867151553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3867151553},{"type":"v1","addr":"172.21.15.96:6835","nonce":3867151553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/175129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":175129703},{"type":"v1","addr":"172.21.15.29:6833","nonce":175129703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:45:18.875 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 3 2024-09-13T18:45:18.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.874+0000 7f74b96e9640 1 -- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f74a006ab70 msgr2=0x7f74a006d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.874+0000 7f74b96e9640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f74a006ab70 0x7f74a006d030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009b40 tx=0x7f74a4009190 comp rx=0 tx=0).stop 2024-09-13T18:45:18.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.874+0000 7f74b96e9640 1 -- 172.21.15.29:0/2118206716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b413f4c0 msgr2=0x7f74b4144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.874+0000 7f74b96e9640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b413f4c0 0x7f74b4144770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00c780 tx=0x7f74ac00cc40 comp rx=0 tx=0).stop 2024-09-13T18:45:18.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.874+0000 7f74b96e9640 1 -- 172.21.15.29:0/2118206716 shutdown_connections 2024-09-13T18:45:18.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.874+0000 7f74b96e9640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f74a006ab70 0x7f74a006d030 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.874+0000 7f74b96e9640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b413f4c0 0x7f74b4144770 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.874+0000 7f74b96e9640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f74b40b9fb0 0x7f74b40b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.874+0000 7f74b96e9640 1 --2- 172.21.15.29:0/2118206716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74b406c660 0x7f74b41419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.874+0000 7f74b96e9640 1 -- 172.21.15.29:0/2118206716 >> 172.21.15.29:0/2118206716 conn(0x7f74b406a500 msgr2=0x7f74b40b4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:18.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.874+0000 7f74b96e9640 1 -- 172.21.15.29:0/2118206716 shutdown_connections 2024-09-13T18:45:18.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.874+0000 7f74b96e9640 1 -- 172.21.15.29:0/2118206716 wait complete. 2024-09-13T18:45:18.887 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:18.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.985+0000 7f60f154c640 1 Processor -- start 2024-09-13T18:45:18.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.986+0000 7f60f154c640 1 -- start start 2024-09-13T18:45:18.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.986+0000 7f60f154c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f60ec0b9e20 0x7f60ec13f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.986+0000 7f60f154c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60ec0b4fa0 0x7f60ec13fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.986+0000 7f60f154c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ec0b45a0 con 0x7f60ec0b5930 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.986+0000 7f60f154c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ec06b500 con 0x7f60ec0b9e20 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.986+0000 7f60f154c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec06c1d0 con 0x7f60ec0b4fa0 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.987+0000 7f60eaffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f60ec0b9e20 0x7f60ec13f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.987+0000 7f60eb7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f60ec0b5930 0x7f60ec06c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52030/0 (socket says 172.21.15.29:52030) 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.987+0000 7f60eb7fe640 1 -- 172.21.15.29:0/4125962152 learned_addr learned my addr 172.21.15.29:0/4125962152 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.987+0000 7f60eaffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f60ec0b9e20 0x7f60ec13f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33330/0 (socket says 172.21.15.29:33330) 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.987+0000 7f60ea7fc640 1 --2- 172.21.15.29:0/4125962152 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60ec0b4fa0 0x7f60ec13fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.987+0000 7f60eaffd640 1 -- 172.21.15.29:0/4125962152 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60ec0b4fa0 msgr2=0x7f60ec13fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.987+0000 7f60eaffd640 1 --2- 172.21.15.29:0/4125962152 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60ec0b4fa0 0x7f60ec13fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.987+0000 7f60eaffd640 1 -- 172.21.15.29:0/4125962152 >> v1:172.21.15.29:6789/0 conn(0x7f60ec0b5930 legacy=0x7f60ec06c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.987+0000 7f60eaffd640 1 -- 172.21.15.29:0/4125962152 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec0ba200 con 0x7f60ec0b9e20 2024-09-13T18:45:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.987+0000 7f60e9ffb640 1 -- 172.21.15.29:0/4125962152 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867366798 0 0) 0x7f60ec0b45a0 con 0x7f60ec0b5930 2024-09-13T18:45:18.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.988+0000 7f60eaffd640 1 --2- 172.21.15.29:0/4125962152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60ec0b9e20 0x7f60ec13f9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0097a0 tx=0x7f60dc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccd96ef07ac5a78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:18.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.989+0000 7f60e9ffb640 1 -- 172.21.15.29:0/4125962152 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc02ae50 con 0x7f60ec0b9e20 2024-09-13T18:45:18.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.989+0000 7f60e9ffb640 1 -- 172.21.15.29:0/4125962152 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc032440 con 0x7f60ec0b9e20 2024-09-13T18:45:18.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.989+0000 7f60e9ffb640 1 -- 172.21.15.29:0/4125962152 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0327d0 con 0x7f60ec0b9e20 2024-09-13T18:45:18.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.990+0000 7f60f154c640 1 -- 172.21.15.29:0/4125962152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60ec0b9e20 msgr2=0x7f60ec13f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.990+0000 7f60f154c640 1 --2- 172.21.15.29:0/4125962152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60ec0b9e20 0x7f60ec13f9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0097a0 tx=0x7f60dc02a100 comp rx=0 tx=0).stop 2024-09-13T18:45:18.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.990+0000 7f60f154c640 1 -- 172.21.15.29:0/4125962152 shutdown_connections 2024-09-13T18:45:18.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.990+0000 7f60f154c640 1 --2- 172.21.15.29:0/4125962152 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60ec0b4fa0 0x7f60ec13fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.990+0000 7f60f154c640 1 --2- 172.21.15.29:0/4125962152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60ec0b9e20 0x7f60ec13f9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.990+0000 7f60f154c640 1 -- 172.21.15.29:0/4125962152 >> 172.21.15.29:0/4125962152 conn(0x7f60ec06a5c0 msgr2=0x7f60ec0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:18.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.990+0000 7f60f154c640 1 -- 172.21.15.29:0/4125962152 shutdown_connections 2024-09-13T18:45:18.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.990+0000 7f60f154c640 1 -- 172.21.15.29:0/4125962152 wait complete. 2024-09-13T18:45:18.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.991+0000 7f60f154c640 1 Processor -- start 2024-09-13T18:45:18.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.991+0000 7f60f154c640 1 -- start start 2024-09-13T18:45:18.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60f154c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60ec0b4fa0 0x7f60ec1deeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60f154c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60ec0b5930 0x7f60ec0b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60f154c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60ec0b9e20 0x7f60ec13c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60f154c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec0b1aa0 con 0x7f60ec0b4fa0 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60f154c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec0ac5f0 con 0x7f60ec0b5930 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60f154c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec142740 con 0x7f60ec0b9e20 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60eaffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60ec0b4fa0 0x7f60ec1deeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60eaffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60ec0b4fa0 0x7f60ec1deeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33338/0 (socket says 172.21.15.29:33338) 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60eaffd640 1 -- 172.21.15.29:0/2489381925 learned_addr learned my addr 172.21.15.29:0/2489381925 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60eb7fe640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60ec0b9e20 0x7f60ec13c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60ea7fc640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60ec0b5930 0x7f60ec0b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60eaffd640 1 -- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60ec0b9e20 msgr2=0x7f60ec13c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60eaffd640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60ec0b9e20 0x7f60ec13c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60eaffd640 1 -- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60ec0b5930 msgr2=0x7f60ec0b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60eaffd640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60ec0b5930 0x7f60ec0b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.992+0000 7f60eaffd640 1 -- 172.21.15.29:0/2489381925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc009400 con 0x7f60ec0b4fa0 2024-09-13T18:45:18.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.993+0000 7f60eaffd640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60ec0b4fa0 0x7f60ec1deeb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0098c0 tx=0x7f60dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:18.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.993+0000 7f60d37fe640 1 -- 172.21.15.29:0/2489381925 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc004230 con 0x7f60ec0b4fa0 2024-09-13T18:45:18.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.993+0000 7f60d37fe640 1 -- 172.21.15.29:0/2489381925 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc004390 con 0x7f60ec0b4fa0 2024-09-13T18:45:18.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.993+0000 7f60f154c640 1 -- 172.21.15.29:0/2489381925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ec1429c0 con 0x7f60ec0b4fa0 2024-09-13T18:45:18.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.993+0000 7f60d37fe640 1 -- 172.21.15.29:0/2489381925 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc003850 con 0x7f60ec0b4fa0 2024-09-13T18:45:18.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.993+0000 7f60f154c640 1 -- 172.21.15.29:0/2489381925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ec1de740 con 0x7f60ec0b4fa0 2024-09-13T18:45:18.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.994+0000 7f60f154c640 1 -- 172.21.15.29:0/2489381925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ec06c5f0 con 0x7f60ec0b4fa0 2024-09-13T18:45:18.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.994+0000 7f60d37fe640 1 -- 172.21.15.29:0/2489381925 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f60dc0039b0 con 0x7f60ec0b4fa0 2024-09-13T18:45:18.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.995+0000 7f60d37fe640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f60d806ab70 0x7f60d806d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.995+0000 7f60d37fe640 1 -- 172.21.15.29:0/2489381925 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60dc0a9c60 con 0x7f60ec0b4fa0 2024-09-13T18:45:18.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.995+0000 7f60ea7fc640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f60d806ab70 0x7f60d806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.995+0000 7f60ea7fc640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f60d806ab70 0x7f60d806d030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f60e0006fd0 tx=0x7f60e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:18.999+0000 7f60d37fe640 1 -- 172.21.15.29:0/2489381925 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f60dc0754d0 con 0x7f60ec0b4fa0 2024-09-13T18:45:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.171+0000 7f60f154c640 1 -- 172.21.15.29:0/2489381925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60ec1450d0 con 0x7f60ec0b4fa0 2024-09-13T18:45:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.172+0000 7f60d37fe640 1 -- 172.21.15.29:0/2489381925 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12815 (secure 0 0 0) 0x7f60dc037090 con 0x7f60ec0b4fa0 2024-09-13T18:45:19.175 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:19.175 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":16,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:18.987345+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:19.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.174+0000 7f60f154c640 1 -- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f60d806ab70 msgr2=0x7f60d806d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.174+0000 7f60f154c640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f60d806ab70 0x7f60d806d030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f60e0006fd0 tx=0x7f60e0008040 comp rx=0 tx=0).stop 2024-09-13T18:45:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.174+0000 7f60f154c640 1 -- 172.21.15.29:0/2489381925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60ec0b4fa0 msgr2=0x7f60ec1deeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.174+0000 7f60f154c640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60ec0b4fa0 0x7f60ec1deeb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0098c0 tx=0x7f60dc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.174+0000 7f60f154c640 1 -- 172.21.15.29:0/2489381925 shutdown_connections 2024-09-13T18:45:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.174+0000 7f60f154c640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f60d806ab70 0x7f60d806d030 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.174+0000 7f60f154c640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60ec0b9e20 0x7f60ec13c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.174+0000 7f60f154c640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60ec0b5930 0x7f60ec0b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.174+0000 7f60f154c640 1 --2- 172.21.15.29:0/2489381925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60ec0b4fa0 0x7f60ec1deeb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.174+0000 7f60f154c640 1 -- 172.21.15.29:0/2489381925 >> 172.21.15.29:0/2489381925 conn(0x7f60ec06a5c0 msgr2=0x7f60ec0afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.174+0000 7f60f154c640 1 -- 172.21.15.29:0/2489381925 shutdown_connections 2024-09-13T18:45:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.174+0000 7f60f154c640 1 -- 172.21.15.29:0/2489381925 wait complete. 2024-09-13T18:45:19.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:45:17.630827+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:45:19.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:19.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.290+0000 7f6d7de90640 1 Processor -- start 2024-09-13T18:45:19.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.290+0000 7f6d7de90640 1 -- start start 2024-09-13T18:45:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d7de90640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6d7809c100 0x7f6d78071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d7de90640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d780721b0 0x7f6d78145da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d7de90640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7809c4e0 con 0x7f6d780b39a0 2024-09-13T18:45:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d7de90640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d780b2b90 con 0x7f6d7809c100 2024-09-13T18:45:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d7de90640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780b79d0 con 0x7f6d780721b0 2024-09-13T18:45:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d77fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6d780b39a0 0x7f6d780b3f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52044/0 (socket says 172.21.15.29:52044) 2024-09-13T18:45:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d77fff640 1 -- 172.21.15.29:0/970113425 learned_addr learned my addr 172.21.15.29:0/970113425 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d777fe640 1 --2- 172.21.15.29:0/970113425 >> v2:172.21.15.96:3300/0 conn(0x7f6d7809c100 0x7f6d78071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d76ffd640 1 --2- 172.21.15.29:0/970113425 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d780721b0 0x7f6d78145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d767fc640 1 -- 172.21.15.29:0/970113425 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256818648 0 0) 0x7f6d7809c4e0 con 0x7f6d780b39a0 2024-09-13T18:45:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d767fc640 1 -- 172.21.15.29:0/970113425 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d60003520 con 0x7f6d780b39a0 2024-09-13T18:45:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d777fe640 1 -- 172.21.15.29:0/970113425 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d780721b0 msgr2=0x7f6d78145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d777fe640 1 --2- 172.21.15.29:0/970113425 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d780721b0 0x7f6d78145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d777fe640 1 -- 172.21.15.29:0/970113425 >> v1:172.21.15.29:6789/0 conn(0x7f6d780b39a0 legacy=0x7f6d780b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.291+0000 7f6d777fe640 1 -- 172.21.15.29:0/970113425 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d780b7c90 con 0x7f6d7809c100 2024-09-13T18:45:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.292+0000 7f6d777fe640 1 --2- 172.21.15.29:0/970113425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d7809c100 0x7f6d78071c70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6d680097a0 tx=0x7f6d6802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac3dcf536af86681 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.292+0000 7f6d767fc640 1 -- 172.21.15.29:0/970113425 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6802ae50 con 0x7f6d7809c100 2024-09-13T18:45:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.292+0000 7f6d767fc640 1 -- 172.21.15.29:0/970113425 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d68032440 con 0x7f6d7809c100 2024-09-13T18:45:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.292+0000 7f6d767fc640 1 -- 172.21.15.29:0/970113425 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d680327b0 con 0x7f6d7809c100 2024-09-13T18:45:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.293+0000 7f6d7de90640 1 -- 172.21.15.29:0/970113425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d7809c100 msgr2=0x7f6d78071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.293+0000 7f6d7de90640 1 --2- 172.21.15.29:0/970113425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d7809c100 0x7f6d78071c70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6d680097a0 tx=0x7f6d6802a100 comp rx=0 tx=0).stop 2024-09-13T18:45:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.293+0000 7f6d7de90640 1 -- 172.21.15.29:0/970113425 shutdown_connections 2024-09-13T18:45:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.293+0000 7f6d7de90640 1 --2- 172.21.15.29:0/970113425 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d780721b0 0x7f6d78145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.293+0000 7f6d7de90640 1 --2- 172.21.15.29:0/970113425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d7809c100 0x7f6d78071c70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.293+0000 7f6d7de90640 1 -- 172.21.15.29:0/970113425 >> 172.21.15.29:0/970113425 conn(0x7f6d7806a2f0 msgr2=0x7f6d7806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.293+0000 7f6d7de90640 1 -- 172.21.15.29:0/970113425 shutdown_connections 2024-09-13T18:45:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.293+0000 7f6d7de90640 1 -- 172.21.15.29:0/970113425 wait complete. 2024-09-13T18:45:19.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.294+0000 7f6d7de90640 1 Processor -- start 2024-09-13T18:45:19.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.294+0000 7f6d7de90640 1 -- start start 2024-09-13T18:45:19.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d7de90640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d780721b0 0x7f6d781df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d7de90640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d7809c100 0x7f6d780b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d7de90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d780b39a0 0x7f6d781db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d7de90640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d781df180 con 0x7f6d780b39a0 2024-09-13T18:45:19.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d7de90640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d781db9f0 con 0x7f6d780721b0 2024-09-13T18:45:19.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d7de90640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d781deac0 con 0x7f6d7809c100 2024-09-13T18:45:19.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d77fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d780b39a0 0x7f6d781db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d77fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d780b39a0 0x7f6d781db4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33340/0 (socket says 172.21.15.29:33340) 2024-09-13T18:45:19.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d77fff640 1 -- 172.21.15.29:0/3742372886 learned_addr learned my addr 172.21.15.29:0/3742372886 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:19.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d777fe640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d780721b0 0x7f6d781df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d76ffd640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d7809c100 0x7f6d780b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d77fff640 1 -- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d7809c100 msgr2=0x7f6d780b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d77fff640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d7809c100 0x7f6d780b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d77fff640 1 -- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d780721b0 msgr2=0x7f6d781df5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d77fff640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d780721b0 0x7f6d781df5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d77fff640 1 -- 172.21.15.29:0/3742372886 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d68009400 con 0x7f6d780b39a0 2024-09-13T18:45:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d77fff640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d780b39a0 0x7f6d781db4b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000caa0 tx=0x7f6d7000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d5ffff640 1 -- 172.21.15.29:0/3742372886 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7000aba0 con 0x7f6d780b39a0 2024-09-13T18:45:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d5ffff640 1 -- 172.21.15.29:0/3742372886 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7000ad00 con 0x7f6d780b39a0 2024-09-13T18:45:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.295+0000 7f6d7de90640 1 -- 172.21.15.29:0/3742372886 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d781deda0 con 0x7f6d780b39a0 2024-09-13T18:45:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.296+0000 7f6d5ffff640 1 -- 172.21.15.29:0/3742372886 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70012640 con 0x7f6d780b39a0 2024-09-13T18:45:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.296+0000 7f6d7de90640 1 -- 172.21.15.29:0/3742372886 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d780b0db0 con 0x7f6d780b39a0 2024-09-13T18:45:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.297+0000 7f6d7de90640 1 -- 172.21.15.29:0/3742372886 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d781df2c0 con 0x7f6d780b39a0 2024-09-13T18:45:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.297+0000 7f6d5ffff640 1 -- 172.21.15.29:0/3742372886 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f6d70007070 con 0x7f6d780b39a0 2024-09-13T18:45:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.298+0000 7f6d5ffff640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6d6406ab70 0x7f6d6406d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.298+0000 7f6d5ffff640 1 -- 172.21.15.29:0/3742372886 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6d70088e30 con 0x7f6d780b39a0 2024-09-13T18:45:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.298+0000 7f6d777fe640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6d6406ab70 0x7f6d6406d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.298+0000 7f6d777fe640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6d6406ab70 0x7f6d6406d030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6d68034000 tx=0x7f6d6802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.302+0000 7f6d5ffff640 1 -- 172.21.15.29:0/3742372886 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6d781df2c0 con 0x7f6d780b39a0 2024-09-13T18:45:19.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.475+0000 7f6d7de90640 1 -- 172.21.15.29:0/3742372886 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d781df2c0 con 0x7f6d780b39a0 2024-09-13T18:45:19.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.475+0000 7f6d5ffff640 1 -- 172.21.15.29:0/3742372886 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d781df2c0 con 0x7f6d780b39a0 2024-09-13T18:45:19.478 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-09-13T18:45:19.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.477+0000 7f6d7de90640 1 -- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6d6406ab70 msgr2=0x7f6d6406d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.477+0000 7f6d7de90640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6d6406ab70 0x7f6d6406d030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6d68034000 tx=0x7f6d6802e000 comp rx=0 tx=0).stop 2024-09-13T18:45:19.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.477+0000 7f6d7de90640 1 -- 172.21.15.29:0/3742372886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d780b39a0 msgr2=0x7f6d781db4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.477+0000 7f6d7de90640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d780b39a0 0x7f6d781db4b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000caa0 tx=0x7f6d7000cf60 comp rx=0 tx=0).stop 2024-09-13T18:45:19.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.477+0000 7f6d7de90640 1 -- 172.21.15.29:0/3742372886 shutdown_connections 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.477+0000 7f6d7de90640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6d6406ab70 0x7f6d6406d030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.477+0000 7f6d7de90640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d780b39a0 0x7f6d781db4b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.477+0000 7f6d7de90640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d7809c100 0x7f6d780b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.477+0000 7f6d7de90640 1 --2- 172.21.15.29:0/3742372886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d780721b0 0x7f6d781df5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.477+0000 7f6d7de90640 1 -- 172.21.15.29:0/3742372886 >> 172.21.15.29:0/3742372886 conn(0x7f6d7806a2f0 msgr2=0x7f6d7813c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.477+0000 7f6d7de90640 1 -- 172.21.15.29:0/3742372886 shutdown_connections 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.478+0000 7f6d7de90640 1 -- 172.21.15.29:0/3742372886 wait complete. 2024-09-13T18:45:19.490 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:45:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.589+0000 7fc26afa0640 1 Processor -- start 2024-09-13T18:45:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.590+0000 7fc26afa0640 1 -- start start 2024-09-13T18:45:19.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.590+0000 7fc26afa0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc26406c770 0x7fc26406cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.590+0000 7fc26afa0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc2640b5b30 0x7fc264148d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.590+0000 7fc26afa0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26406bd00 con 0x7fc2640afbc0 2024-09-13T18:45:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.590+0000 7fc26afa0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26406bb00 con 0x7fc2640b5b30 2024-09-13T18:45:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.590+0000 7fc26afa0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26406bfe0 con 0x7fc26406c770 2024-09-13T18:45:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.590+0000 7fc26979d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc2640b5b30 0x7fc264148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.590+0000 7fc26979d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc2640b5b30 0x7fc264148d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33344/0 (socket says 172.21.15.29:33344) 2024-09-13T18:45:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.590+0000 7fc26979d640 1 -- 172.21.15.29:0/248970227 learned_addr learned my addr 172.21.15.29:0/248970227 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.591+0000 7fc269f9e640 1 --2- 172.21.15.29:0/248970227 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc26406c770 0x7fc26406cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.591+0000 7fc26979d640 1 -- 172.21.15.29:0/248970227 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc26406c770 msgr2=0x7fc26406cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.591+0000 7fc26979d640 1 --2- 172.21.15.29:0/248970227 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc26406c770 0x7fc26406cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.591+0000 7fc26979d640 1 -- 172.21.15.29:0/248970227 >> v1:172.21.15.96:6789/0 conn(0x7fc2640afbc0 legacy=0x7fc2640afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:19.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.591+0000 7fc26979d640 1 -- 172.21.15.29:0/248970227 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2640b3f00 con 0x7fc2640b5b30 2024-09-13T18:45:19.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.591+0000 7fc26979d640 1 --2- 172.21.15.29:0/248970227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2640b5b30 0x7fc264148d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc254009870 tx=0x7fc25402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc07bfffd1804e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.592+0000 7fc268f9c640 1 -- 172.21.15.29:0/248970227 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25402ae80 con 0x7fc2640b5b30 2024-09-13T18:45:19.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.592+0000 7fc268f9c640 1 -- 172.21.15.29:0/248970227 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc254032440 con 0x7fc2640b5b30 2024-09-13T18:45:19.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.592+0000 7fc268f9c640 1 -- 172.21.15.29:0/248970227 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2540327b0 con 0x7fc2640b5b30 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.592+0000 7fc26afa0640 1 -- 172.21.15.29:0/248970227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2640b5b30 msgr2=0x7fc264148d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.592+0000 7fc26afa0640 1 --2- 172.21.15.29:0/248970227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2640b5b30 0x7fc264148d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc254009870 tx=0x7fc25402a130 comp rx=0 tx=0).stop 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.592+0000 7fc26afa0640 1 -- 172.21.15.29:0/248970227 shutdown_connections 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.592+0000 7fc26afa0640 1 --2- 172.21.15.29:0/248970227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2640b5b30 0x7fc264148d40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.592+0000 7fc26afa0640 1 --2- 172.21.15.29:0/248970227 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc26406c770 0x7fc26406cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.592+0000 7fc26afa0640 1 -- 172.21.15.29:0/248970227 >> 172.21.15.29:0/248970227 conn(0x7fc2640b9450 msgr2=0x7fc2640b9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.592+0000 7fc26afa0640 1 -- 172.21.15.29:0/248970227 shutdown_connections 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.592+0000 7fc26afa0640 1 -- 172.21.15.29:0/248970227 wait complete. 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.593+0000 7fc26afa0640 1 Processor -- start 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.593+0000 7fc26afa0640 1 -- start start 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26afa0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26406c770 0x7fc26412ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26afa0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2640afbc0 0x7fc2641debc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26afa0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc2640b5b30 0x7fc26412b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26afa0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2641de3e0 con 0x7fc2640afbc0 2024-09-13T18:45:19.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26afa0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26413b1a0 con 0x7fc26406c770 2024-09-13T18:45:19.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26afa0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26413a280 con 0x7fc2640b5b30 2024-09-13T18:45:19.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26979d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2640afbc0 0x7fc2641debc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26979d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2640afbc0 0x7fc2641debc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33346/0 (socket says 172.21.15.29:33346) 2024-09-13T18:45:19.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26979d640 1 -- 172.21.15.29:0/3670045893 learned_addr learned my addr 172.21.15.29:0/3670045893 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:19.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc269f9e640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26406c770 0x7fc26412ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26a79f640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc2640b5b30 0x7fc26412b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26979d640 1 -- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc2640b5b30 msgr2=0x7fc26412b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26979d640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc2640b5b30 0x7fc26412b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26979d640 1 -- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26406c770 msgr2=0x7fc26412ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26979d640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26406c770 0x7fc26412ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc26979d640 1 -- 172.21.15.29:0/3670045893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2540094d0 con 0x7fc2640afbc0 2024-09-13T18:45:19.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.594+0000 7fc269f9e640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26406c770 0x7fc26412ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:19.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.595+0000 7fc26979d640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2640afbc0 0x7fc2641debc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc25402a170 tx=0x7fc2540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.595+0000 7fc25a7fc640 1 -- 172.21.15.29:0/3670045893 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2540308d0 con 0x7fc2640afbc0 2024-09-13T18:45:19.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.595+0000 7fc25a7fc640 1 -- 172.21.15.29:0/3670045893 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc254030a50 con 0x7fc2640afbc0 2024-09-13T18:45:19.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.595+0000 7fc26afa0640 1 -- 172.21.15.29:0/3670045893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2641de6a0 con 0x7fc2640afbc0 2024-09-13T18:45:19.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.595+0000 7fc25a7fc640 1 -- 172.21.15.29:0/3670045893 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254030e00 con 0x7fc2640afbc0 2024-09-13T18:45:19.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.595+0000 7fc26afa0640 1 -- 172.21.15.29:0/3670045893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2641317e0 con 0x7fc2640afbc0 2024-09-13T18:45:19.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.596+0000 7fc26afa0640 1 -- 172.21.15.29:0/3670045893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26406b1b0 con 0x7fc2640afbc0 2024-09-13T18:45:19.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.596+0000 7fc25a7fc640 1 -- 172.21.15.29:0/3670045893 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fc254039040 con 0x7fc2640afbc0 2024-09-13T18:45:19.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.597+0000 7fc25a7fc640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc24806ab70 0x7fc24806d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.597+0000 7fc25a7fc640 1 -- 172.21.15.29:0/3670045893 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc2540a9900 con 0x7fc2640afbc0 2024-09-13T18:45:19.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.597+0000 7fc269f9e640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc24806ab70 0x7fc24806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.597+0000 7fc269f9e640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc24806ab70 0x7fc24806d030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc260006fd0 tx=0x7fc260008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.601+0000 7fc25a7fc640 1 -- 172.21.15.29:0/3670045893 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc254074fa0 con 0x7fc2640afbc0 2024-09-13T18:45:19.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.772+0000 7fc26afa0640 1 -- 172.21.15.29:0/3670045893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc26413a490 con 0x7fc2640afbc0 2024-09-13T18:45:19.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.773+0000 7fc25a7fc640 1 -- 172.21.15.29:0/3670045893 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc2540785c0 con 0x7fc2640afbc0 2024-09-13T18:45:19.776 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:19.776 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-09-13T18:45:19.776 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-13T18:45:19.776 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-09-13T18:45:19.776 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-09-13T18:45:19.776 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-13T18:45:19.776 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-09-13T18:45:19.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.775+0000 7fc26afa0640 1 -- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc24806ab70 msgr2=0x7fc24806d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.775+0000 7fc26afa0640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc24806ab70 0x7fc24806d030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc260006fd0 tx=0x7fc260008040 comp rx=0 tx=0).stop 2024-09-13T18:45:19.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.775+0000 7fc26afa0640 1 -- 172.21.15.29:0/3670045893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2640afbc0 msgr2=0x7fc2641debc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.775+0000 7fc26afa0640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2640afbc0 0x7fc2641debc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc25402a170 tx=0x7fc2540046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.775+0000 7fc26afa0640 1 -- 172.21.15.29:0/3670045893 shutdown_connections 2024-09-13T18:45:19.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.775+0000 7fc26afa0640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc24806ab70 0x7fc24806d030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.775+0000 7fc26afa0640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc2640b5b30 0x7fc26412b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.775+0000 7fc26afa0640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2640afbc0 0x7fc2641debc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.775+0000 7fc26afa0640 1 --2- 172.21.15.29:0/3670045893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26406c770 0x7fc26412ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.775+0000 7fc26afa0640 1 -- 172.21.15.29:0/3670045893 >> 172.21.15.29:0/3670045893 conn(0x7fc2640b9450 msgr2=0x7fc2640b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:19.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.776+0000 7fc26afa0640 1 -- 172.21.15.29:0/3670045893 shutdown_connections 2024-09-13T18:45:19.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.776+0000 7fc26afa0640 1 -- 172.21.15.29:0/3670045893 wait complete. 2024-09-13T18:45:19.789 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:45:19.789 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:45:19.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.896+0000 7f758e69c640 1 Processor -- start 2024-09-13T18:45:19.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.896+0000 7f758e69c640 1 -- start start 2024-09-13T18:45:19.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f758e69c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f75880b6a40 0x7f758813f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f758e69c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f75880b4560 0x7f758813fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f758e69c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75880bc2c0 con 0x7f75880bbee0 2024-09-13T18:45:19.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f758e69c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75880b5f60 con 0x7f75880b6a40 2024-09-13T18:45:19.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f758e69c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75880b6240 con 0x7f75880b4560 2024-09-13T18:45:19.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f75877fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f75880b6a40 0x7f758813f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f75877fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f75880b6a40 0x7f758813f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33356/0 (socket says 172.21.15.29:33356) 2024-09-13T18:45:19.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f75877fe640 1 -- 172.21.15.29:0/3159545955 learned_addr learned my addr 172.21.15.29:0/3159545955 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:19.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f758cc39640 1 --2- 172.21.15.29:0/3159545955 >> v2:172.21.15.96:3300/0 conn(0x7f75880b4560 0x7f758813fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f75877fe640 1 -- 172.21.15.29:0/3159545955 >> v2:172.21.15.96:3300/0 conn(0x7f75880b4560 msgr2=0x7f758813fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:19.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f75877fe640 1 --2- 172.21.15.29:0/3159545955 >> v2:172.21.15.96:3300/0 conn(0x7f75880b4560 0x7f758813fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f75877fe640 1 -- 172.21.15.29:0/3159545955 >> v1:172.21.15.96:6789/0 conn(0x7f75880bbee0 legacy=0x7f7588149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.897+0000 7f75877fe640 1 -- 172.21.15.29:0/3159545955 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75880b6520 con 0x7f75880b6a40 2024-09-13T18:45:19.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.898+0000 7f75877fe640 1 --2- 172.21.15.29:0/3159545955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75880b6a40 0x7f758813f570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f75880b7dd0 tx=0x7f757c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140e8fefbfddc19a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.898+0000 7f7586ffd640 1 -- 172.21.15.29:0/3159545955 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c032440 con 0x7f75880b6a40 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.898+0000 7f7586ffd640 1 -- 172.21.15.29:0/3159545955 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c0325a0 con 0x7f75880b6a40 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.898+0000 7f7586ffd640 1 -- 172.21.15.29:0/3159545955 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c032930 con 0x7f75880b6a40 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.899+0000 7f758e69c640 1 -- 172.21.15.29:0/3159545955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75880b6a40 msgr2=0x7f758813f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.899+0000 7f758e69c640 1 --2- 172.21.15.29:0/3159545955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75880b6a40 0x7f758813f570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f75880b7dd0 tx=0x7f757c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.899+0000 7f758e69c640 1 -- 172.21.15.29:0/3159545955 shutdown_connections 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.899+0000 7f758e69c640 1 --2- 172.21.15.29:0/3159545955 >> v2:172.21.15.96:3300/0 conn(0x7f75880b4560 0x7f758813fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.899+0000 7f758e69c640 1 --2- 172.21.15.29:0/3159545955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75880b6a40 0x7f758813f570 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.899+0000 7f758e69c640 1 -- 172.21.15.29:0/3159545955 >> 172.21.15.29:0/3159545955 conn(0x7f7588071da0 msgr2=0x7f75880bb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.899+0000 7f758e69c640 1 -- 172.21.15.29:0/3159545955 shutdown_connections 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.899+0000 7f758e69c640 1 -- 172.21.15.29:0/3159545955 wait complete. 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.900+0000 7f758e69c640 1 Processor -- start 2024-09-13T18:45:19.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.900+0000 7f758e69c640 1 -- start start 2024-09-13T18:45:19.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758e69c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75880b4560 0x7f75881480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758e69c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75880b6a40 0x7f75881db180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758e69c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75880bbee0 0x7f75881db6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758e69c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7588141380 con 0x7f75880bbee0 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758e69c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7588140320 con 0x7f75880b6a40 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758e69c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7588140570 con 0x7f75880b4560 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758cc39640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75880bbee0 0x7f75881db6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f7587fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75880b4560 0x7f75881480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758cc39640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75880bbee0 0x7f75881db6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33358/0 (socket says 172.21.15.29:33358) 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f75877fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75880b6a40 0x7f75881db180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f7587fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75880b4560 0x7f75881480f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:45104/0 (socket says 172.21.15.29:45104) 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758cc39640 1 -- 172.21.15.29:0/2208797959 learned_addr learned my addr 172.21.15.29:0/2208797959 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758cc39640 1 -- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75880b4560 msgr2=0x7f75881480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758cc39640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75880b4560 0x7f75881480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758cc39640 1 -- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75880b6a40 msgr2=0x7f75881db180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758cc39640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75880b6a40 0x7f75881db180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f758cc39640 1 -- 172.21.15.29:0/2208797959 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c0094d0 con 0x7f75880bbee0 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.901+0000 7f75877fe640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75880b6a40 0x7f75881db180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.902+0000 7f758cc39640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75880bbee0 0x7f75881db6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f758000efc0 tx=0x7f758000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.902+0000 7f7584ff9640 1 -- 172.21.15.29:0/2208797959 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7580014480 con 0x7f75880bbee0 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.902+0000 7f7584ff9640 1 -- 172.21.15.29:0/2208797959 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758000f040 con 0x7f75880bbee0 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.902+0000 7f7584ff9640 1 -- 172.21.15.29:0/2208797959 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7580014820 con 0x7f75880bbee0 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.902+0000 7f758e69c640 1 -- 172.21.15.29:0/2208797959 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758813b150 con 0x7f75880bbee0 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.902+0000 7f758e69c640 1 -- 172.21.15.29:0/2208797959 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7588148c70 con 0x7f75880bbee0 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.903+0000 7f758e69c640 1 -- 172.21.15.29:0/2208797959 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7588140790 con 0x7f75880bbee0 2024-09-13T18:45:19.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.904+0000 7f7584ff9640 1 -- 172.21.15.29:0/2208797959 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f7580014980 con 0x7f75880bbee0 2024-09-13T18:45:19.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.905+0000 7f7584ff9640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f757406ab70 0x7f757406d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.905+0000 7f7584ff9640 1 -- 172.21.15.29:0/2208797959 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f75800898c0 con 0x7f75880bbee0 2024-09-13T18:45:19.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.905+0000 7f7587fff640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f757406ab70 0x7f757406d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.906+0000 7f7587fff640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f757406ab70 0x7f757406d030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7578000f60 tx=0x7f7578009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:19.909+0000 7f7584ff9640 1 -- 172.21.15.29:0/2208797959 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7580055010 con 0x7f75880bbee0 2024-09-13T18:45:20.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.082+0000 7f758e69c640 1 -- 172.21.15.29:0/2208797959 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7588149020 con 0x7f75880bbee0 2024-09-13T18:45:20.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.639+0000 7f7584ff9640 1 -- 172.21.15.29:0/2208797959 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f75800180b0 con 0x7f75880bbee0 2024-09-13T18:45:20.647 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2024-09-13T18:45:20.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.642+0000 7f758e69c640 1 -- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f757406ab70 msgr2=0x7f757406d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.642+0000 7f758e69c640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f757406ab70 0x7f757406d030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7578000f60 tx=0x7f7578009040 comp rx=0 tx=0).stop 2024-09-13T18:45:20.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.642+0000 7f758e69c640 1 -- 172.21.15.29:0/2208797959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75880bbee0 msgr2=0x7f75881db6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.642+0000 7f758e69c640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75880bbee0 0x7f75881db6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f758000efc0 tx=0x7f758000c490 comp rx=0 tx=0).stop 2024-09-13T18:45:20.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.642+0000 7f758e69c640 1 -- 172.21.15.29:0/2208797959 shutdown_connections 2024-09-13T18:45:20.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.642+0000 7f758e69c640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f757406ab70 0x7f757406d030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.642+0000 7f758e69c640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75880bbee0 0x7f75881db6c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.642+0000 7f758e69c640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75880b6a40 0x7f75881db180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.642+0000 7f758e69c640 1 --2- 172.21.15.29:0/2208797959 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75880b4560 0x7f75881480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.642+0000 7f758e69c640 1 -- 172.21.15.29:0/2208797959 >> 172.21.15.29:0/2208797959 conn(0x7f7588071da0 msgr2=0x7f75880b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:20.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.642+0000 7f758e69c640 1 -- 172.21.15.29:0/2208797959 shutdown_connections 2024-09-13T18:45:20.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.642+0000 7f758e69c640 1 -- 172.21.15.29:0/2208797959 wait complete. 2024-09-13T18:45:20.657 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T18:45:20.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.762+0000 7f4d60b6c640 1 Processor -- start 2024-09-13T18:45:20.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.762+0000 7f4d60b6c640 1 -- start start 2024-09-13T18:45:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.763+0000 7f4d60b6c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d5c0b5f50 0x7f4d5c13f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.763+0000 7f4d60b6c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5c0b3880 con 0x7f4d5c0b3320 2024-09-13T18:45:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.763+0000 7f4d60b6c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5c0b4890 con 0x7f4d5c0b44b0 2024-09-13T18:45:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.763+0000 7f4d60b6c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c0b5580 con 0x7f4d5c0b5f50 2024-09-13T18:45:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.763+0000 7f4d5a59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4d5c0b44b0 0x7f4d5c1462e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:44322/0 (socket says 172.21.15.29:44322) 2024-09-13T18:45:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.763+0000 7f4d5a59c640 1 -- 172.21.15.29:0/1042213060 learned_addr learned my addr 172.21.15.29:0/1042213060 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.763+0000 7f4d59d9b640 1 --2- 172.21.15.29:0/1042213060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d5c0b5f50 0x7f4d5c13f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.764+0000 7f4d59d9b640 1 -- 172.21.15.29:0/1042213060 >> v1:172.21.15.96:6789/0 conn(0x7f4d5c0b44b0 legacy=0x7f4d5c1462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.764+0000 7f4d59d9b640 1 -- 172.21.15.29:0/1042213060 >> v1:172.21.15.29:6789/0 conn(0x7f4d5c0b3320 legacy=0x7f4d5c13fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.764+0000 7f4d59d9b640 1 -- 172.21.15.29:0/1042213060 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c0b57f0 con 0x7f4d5c0b5f50 2024-09-13T18:45:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.764+0000 7f4d59d9b640 1 --2- 172.21.15.29:0/1042213060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d5c0b5f50 0x7f4d5c13f5f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4d500097d0 tx=0x7f4d5002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af27d4f3837ee9be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.764+0000 7f4d5959a640 1 -- 172.21.15.29:0/1042213060 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50032440 con 0x7f4d5c0b5f50 2024-09-13T18:45:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.765+0000 7f4d5959a640 1 -- 172.21.15.29:0/1042213060 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d500325a0 con 0x7f4d5c0b5f50 2024-09-13T18:45:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.765+0000 7f4d5959a640 1 -- 172.21.15.29:0/1042213060 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50032930 con 0x7f4d5c0b5f50 2024-09-13T18:45:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.765+0000 7f4d60b6c640 1 -- 172.21.15.29:0/1042213060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d5c0b5f50 msgr2=0x7f4d5c13f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.765+0000 7f4d60b6c640 1 --2- 172.21.15.29:0/1042213060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d5c0b5f50 0x7f4d5c13f5f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4d500097d0 tx=0x7f4d5002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.765+0000 7f4d60b6c640 1 -- 172.21.15.29:0/1042213060 shutdown_connections 2024-09-13T18:45:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.765+0000 7f4d60b6c640 1 --2- 172.21.15.29:0/1042213060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d5c0b5f50 0x7f4d5c13f5f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.765+0000 7f4d60b6c640 1 -- 172.21.15.29:0/1042213060 >> 172.21.15.29:0/1042213060 conn(0x7f4d5c0b8050 msgr2=0x7f4d5c0b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.765+0000 7f4d60b6c640 1 -- 172.21.15.29:0/1042213060 shutdown_connections 2024-09-13T18:45:20.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.765+0000 7f4d60b6c640 1 -- 172.21.15.29:0/1042213060 wait complete. 2024-09-13T18:45:20.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.767+0000 7f4d60b6c640 1 Processor -- start 2024-09-13T18:45:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.767+0000 7f4d60b6c640 1 -- start start 2024-09-13T18:45:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.767+0000 7f4d60b6c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d5c0b3320 0x7f4d5c0ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.767+0000 7f4d60b6c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d5c0b44b0 0x7f4d5c13c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.767+0000 7f4d60b6c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5c0b5f50 0x7f4d5c13cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.767+0000 7f4d60b6c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c13d2c0 con 0x7f4d5c0b5f50 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.767+0000 7f4d60b6c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c13bfc0 con 0x7f4d5c0b3320 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.767+0000 7f4d60b6c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c13bcd0 con 0x7f4d5c0b44b0 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.767+0000 7f4d5ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5c0b5f50 0x7f4d5c13cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.767+0000 7f4d5ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5c0b5f50 0x7f4d5c13cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33368/0 (socket says 172.21.15.29:33368) 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.767+0000 7f4d5ad9d640 1 -- 172.21.15.29:0/3667760857 learned_addr learned my addr 172.21.15.29:0/3667760857 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d5a59c640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d5c0b3320 0x7f4d5c0ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d59d9b640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d5c0b44b0 0x7f4d5c13c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d5a59c640 1 -- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d5c0b44b0 msgr2=0x7f4d5c13c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d5a59c640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d5c0b44b0 0x7f4d5c13c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d5a59c640 1 -- 172.21.15.29:0/3667760857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5c0b5f50 msgr2=0x7f4d5c13cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d5a59c640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5c0b5f50 0x7f4d5c13cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d5a59c640 1 -- 172.21.15.29:0/3667760857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d50009400 con 0x7f4d5c0b3320 2024-09-13T18:45:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d59d9b640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d5c0b44b0 0x7f4d5c13c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d5a59c640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d5c0b3320 0x7f4d5c0ba4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00c440 tx=0x7f4d4c001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d4affd640 1 -- 172.21.15.29:0/3667760857 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c005ce0 con 0x7f4d5c0b3320 2024-09-13T18:45:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d4affd640 1 -- 172.21.15.29:0/3667760857 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c005e40 con 0x7f4d5c0b3320 2024-09-13T18:45:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d60b6c640 1 -- 172.21.15.29:0/3667760857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5c13d4a0 con 0x7f4d5c0b3320 2024-09-13T18:45:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d4affd640 1 -- 172.21.15.29:0/3667760857 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0072d0 con 0x7f4d5c0b3320 2024-09-13T18:45:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.768+0000 7f4d60b6c640 1 -- 172.21.15.29:0/3667760857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5c138190 con 0x7f4d5c0b3320 2024-09-13T18:45:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.770+0000 7f4d60b6c640 1 -- 172.21.15.29:0/3667760857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5c0bc310 con 0x7f4d5c0b3320 2024-09-13T18:45:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.770+0000 7f4d4affd640 1 -- 172.21.15.29:0/3667760857 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f4d4c0074f0 con 0x7f4d5c0b3320 2024-09-13T18:45:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.770+0000 7f4d4affd640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f4d3c06ab70 0x7f4d3c06d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.770+0000 7f4d4affd640 1 -- 172.21.15.29:0/3667760857 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4d4c088520 con 0x7f4d5c0b3320 2024-09-13T18:45:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.771+0000 7f4d59d9b640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f4d3c06ab70 0x7f4d3c06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.771+0000 7f4d59d9b640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f4d3c06ab70 0x7f4d3c06d030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4d50034000 tx=0x7f4d5002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.775+0000 7f4d4affd640 1 -- 172.21.15.29:0/3667760857 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4d4c053a80 con 0x7f4d5c0b3320 2024-09-13T18:45:20.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:20.947+0000 7f4d60b6c640 1 -- 172.21.15.29:0/3667760857 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f4d5c1462e0 con 0x7f4d5c0b3320 2024-09-13T18:45:21.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.653+0000 7f4d4affd640 1 -- 172.21.15.29:0/3667760857 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4d4c053e50 con 0x7f4d5c0b3320 2024-09-13T18:45:21.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.653+0000 7f4d4affd640 1 -- 172.21.15.29:0/3667760857 <== mon.1 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f4d4c0840c0 con 0x7f4d5c0b3320 2024-09-13T18:45:21.656 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2024-09-13T18:45:21.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.658+0000 7f4d60b6c640 1 -- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f4d3c06ab70 msgr2=0x7f4d3c06d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:21.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.658+0000 7f4d60b6c640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f4d3c06ab70 0x7f4d3c06d030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4d50034000 tx=0x7f4d5002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:21.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.658+0000 7f4d60b6c640 1 -- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d5c0b3320 msgr2=0x7f4d5c0ba4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:21.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.658+0000 7f4d60b6c640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d5c0b3320 0x7f4d5c0ba4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00c440 tx=0x7f4d4c001e70 comp rx=0 tx=0).stop 2024-09-13T18:45:21.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.658+0000 7f4d60b6c640 1 -- 172.21.15.29:0/3667760857 shutdown_connections 2024-09-13T18:45:21.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.658+0000 7f4d60b6c640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f4d3c06ab70 0x7f4d3c06d030 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4d50034000 tx=0x7f4d5002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:21.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.658+0000 7f4d60b6c640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5c0b5f50 0x7f4d5c13cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.658+0000 7f4d60b6c640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d5c0b44b0 0x7f4d5c13c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.658+0000 7f4d60b6c640 1 --2- 172.21.15.29:0/3667760857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d5c0b3320 0x7f4d5c0ba4d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.658+0000 7f4d60b6c640 1 -- 172.21.15.29:0/3667760857 >> 172.21.15.29:0/3667760857 conn(0x7f4d5c0b8050 msgr2=0x7f4d5c1407a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:21.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.661+0000 7f4d60b6c640 1 -- 172.21.15.29:0/3667760857 shutdown_connections 2024-09-13T18:45:21.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.663+0000 7f4d60b6c640 1 -- 172.21.15.29:0/3667760857 wait complete. 2024-09-13T18:45:21.683 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:45:21.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.787+0000 7f2d9e85a640 1 Processor -- start 2024-09-13T18:45:21.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.787+0000 7f2d9e85a640 1 -- start start 2024-09-13T18:45:21.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.788+0000 7f2d9e85a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d98142ac0 0x7f2d98142f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:21.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.788+0000 7f2d9e85a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2d9814e2e0 0x7f2d981506d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:21.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.788+0000 7f2d9e85a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9806c2f0 con 0x7f2d980b4490 2024-09-13T18:45:21.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.788+0000 7f2d9e85a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d980ba420 con 0x7f2d9814e2e0 2024-09-13T18:45:21.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.788+0000 7f2d9e85a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980b4870 con 0x7f2d98142ac0 2024-09-13T18:45:21.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.788+0000 7f2d977fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d98142ac0 0x7f2d98142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:21.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.788+0000 7f2d9cdf7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2d9814e2e0 0x7f2d981506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.788+0000 7f2d977fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d98142ac0 0x7f2d98142f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:45130/0 (socket says 172.21.15.29:45130) 2024-09-13T18:45:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.788+0000 7f2d977fe640 1 -- 172.21.15.29:0/4278747728 learned_addr learned my addr 172.21.15.29:0/4278747728 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.788+0000 7f2d97fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2d980b4490 0x7f2d9806c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:44330/0 (socket says 172.21.15.29:44330) 2024-09-13T18:45:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.788+0000 7f2d9cdf7640 1 --2- 172.21.15.29:0/4278747728 >> v2:172.21.15.96:3300/0 conn(0x7f2d9814e2e0 0x7f2d981506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:53848/0 (socket says 172.21.15.29:53848) 2024-09-13T18:45:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.789+0000 7f2d977fe640 1 -- 172.21.15.29:0/4278747728 >> v2:172.21.15.96:3300/0 conn(0x7f2d9814e2e0 msgr2=0x7f2d981506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.789+0000 7f2d977fe640 1 --2- 172.21.15.29:0/4278747728 >> v2:172.21.15.96:3300/0 conn(0x7f2d9814e2e0 0x7f2d981506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.789+0000 7f2d977fe640 1 -- 172.21.15.29:0/4278747728 >> v1:172.21.15.96:6789/0 conn(0x7f2d980b4490 legacy=0x7f2d9806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.789+0000 7f2d977fe640 1 -- 172.21.15.29:0/4278747728 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d980b5c90 con 0x7f2d98142ac0 2024-09-13T18:45:21.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.789+0000 7f2d9cdf7640 1 --2- 172.21.15.29:0/4278747728 >> v2:172.21.15.96:3300/0 conn(0x7f2d9814e2e0 0x7f2d981506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:21.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.789+0000 7f2d977fe640 1 --2- 172.21.15.29:0/4278747728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d98142ac0 0x7f2d98142f00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009870 tx=0x7f2d8c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ff75aabf0e7f4d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:21.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.790+0000 7f2d96ffd640 1 -- 172.21.15.29:0/4278747728 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c032440 con 0x7f2d98142ac0 2024-09-13T18:45:21.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.790+0000 7f2d96ffd640 1 -- 172.21.15.29:0/4278747728 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c0325a0 con 0x7f2d98142ac0 2024-09-13T18:45:21.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.790+0000 7f2d96ffd640 1 -- 172.21.15.29:0/4278747728 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c032930 con 0x7f2d98142ac0 2024-09-13T18:45:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.790+0000 7f2d9e85a640 1 -- 172.21.15.29:0/4278747728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d98142ac0 msgr2=0x7f2d98142f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.790+0000 7f2d9e85a640 1 --2- 172.21.15.29:0/4278747728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d98142ac0 0x7f2d98142f00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009870 tx=0x7f2d8c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.790+0000 7f2d9e85a640 1 -- 172.21.15.29:0/4278747728 shutdown_connections 2024-09-13T18:45:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.790+0000 7f2d9e85a640 1 --2- 172.21.15.29:0/4278747728 >> v2:172.21.15.96:3300/0 conn(0x7f2d9814e2e0 0x7f2d981506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.790+0000 7f2d9e85a640 1 --2- 172.21.15.29:0/4278747728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d98142ac0 0x7f2d98142f00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.790+0000 7f2d9e85a640 1 -- 172.21.15.29:0/4278747728 >> 172.21.15.29:0/4278747728 conn(0x7f2d9806a5b0 msgr2=0x7f2d980b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.790+0000 7f2d9e85a640 1 -- 172.21.15.29:0/4278747728 shutdown_connections 2024-09-13T18:45:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.790+0000 7f2d9e85a640 1 -- 172.21.15.29:0/4278747728 wait complete. 2024-09-13T18:45:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.791+0000 7f2d9e85a640 1 Processor -- start 2024-09-13T18:45:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.791+0000 7f2d9e85a640 1 -- start start 2024-09-13T18:45:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.792+0000 7f2d9e85a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d980b4490 0x7f2d98146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.792+0000 7f2d9e85a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d98142ac0 0x7f2d98149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.792+0000 7f2d9e85a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d9814e2e0 0x7f2d9814ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:21.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.792+0000 7f2d9e85a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9813f660 con 0x7f2d980b4490 2024-09-13T18:45:21.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.792+0000 7f2d9e85a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9814bdf0 con 0x7f2d98142ac0 2024-09-13T18:45:21.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.792+0000 7f2d9e85a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9814c0d0 con 0x7f2d9814e2e0 2024-09-13T18:45:21.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.792+0000 7f2d97fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d980b4490 0x7f2d98146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:21.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.792+0000 7f2d97fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d980b4490 0x7f2d98146b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33370/0 (socket says 172.21.15.29:33370) 2024-09-13T18:45:21.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.792+0000 7f2d97fff640 1 -- 172.21.15.29:0/1652952621 learned_addr learned my addr 172.21.15.29:0/1652952621 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:21.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.792+0000 7f2d9cdf7640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d9814e2e0 0x7f2d9814ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:21.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.792+0000 7f2d977fe640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d98142ac0 0x7f2d98149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:21.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.793+0000 7f2d97fff640 1 -- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d9814e2e0 msgr2=0x7f2d9814ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:21.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.793+0000 7f2d97fff640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d9814e2e0 0x7f2d9814ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.793+0000 7f2d97fff640 1 -- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d98142ac0 msgr2=0x7f2d98149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:21.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.793+0000 7f2d97fff640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d98142ac0 0x7f2d98149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.793+0000 7f2d97fff640 1 -- 172.21.15.29:0/1652952621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90009a70 con 0x7f2d980b4490 2024-09-13T18:45:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.793+0000 7f2d97fff640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d980b4490 0x7f2d98146b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c4d0 tx=0x7f2d8800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.793+0000 7f2d94ff9640 1 -- 172.21.15.29:0/1652952621 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88007480 con 0x7f2d980b4490 2024-09-13T18:45:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.793+0000 7f2d94ff9640 1 -- 172.21.15.29:0/1652952621 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d880075e0 con 0x7f2d980b4490 2024-09-13T18:45:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.793+0000 7f2d9e85a640 1 -- 172.21.15.29:0/1652952621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c0094d0 con 0x7f2d980b4490 2024-09-13T18:45:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.793+0000 7f2d94ff9640 1 -- 172.21.15.29:0/1652952621 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d880049e0 con 0x7f2d980b4490 2024-09-13T18:45:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.793+0000 7f2d9e85a640 1 -- 172.21.15.29:0/1652952621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9814a6f0 con 0x7f2d980b4490 2024-09-13T18:45:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.794+0000 7f2d9e85a640 1 -- 172.21.15.29:0/1652952621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9806ba90 con 0x7f2d980b4490 2024-09-13T18:45:21.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.794+0000 7f2d94ff9640 1 -- 172.21.15.29:0/1652952621 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2d88004b40 con 0x7f2d980b4490 2024-09-13T18:45:21.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.795+0000 7f2d94ff9640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2d8406ac00 0x7f2d8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:21.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.795+0000 7f2d94ff9640 1 -- 172.21.15.29:0/1652952621 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2d88088400 con 0x7f2d980b4490 2024-09-13T18:45:21.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.795+0000 7f2d977fe640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2d8406ac00 0x7f2d8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:21.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.796+0000 7f2d977fe640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2d8406ac00 0x7f2d8406d0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c034000 tx=0x7f2d8c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:21.800+0000 7f2d94ff9640 1 -- 172.21.15.29:0/1652952621 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2d88053700 con 0x7f2d980b4490 2024-09-13T18:45:22.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.005+0000 7f2d9e85a640 1 -- 172.21.15.29:0/1652952621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2d9814a090 con 0x7f2d980b4490 2024-09-13T18:45:22.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.010+0000 7f2d94ff9640 1 -- 172.21.15.29:0/1652952621 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2d88056d20 con 0x7f2d980b4490 2024-09-13T18:45:22.014 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T18:45:22.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.020+0000 7f2d9e85a640 1 -- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2d8406ac00 msgr2=0x7f2d8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.020+0000 7f2d9e85a640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2d8406ac00 0x7f2d8406d0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c034000 tx=0x7f2d8c02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:22.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.020+0000 7f2d9e85a640 1 -- 172.21.15.29:0/1652952621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d980b4490 msgr2=0x7f2d98146b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.020+0000 7f2d9e85a640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d980b4490 0x7f2d98146b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c4d0 tx=0x7f2d8800c990 comp rx=0 tx=0).stop 2024-09-13T18:45:22.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.021+0000 7f2d9e85a640 1 -- 172.21.15.29:0/1652952621 shutdown_connections 2024-09-13T18:45:22.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.021+0000 7f2d9e85a640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2d8406ac00 0x7f2d8406d0c0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c034000 tx=0x7f2d8c02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:22.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.021+0000 7f2d9e85a640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d9814e2e0 0x7f2d9814ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.021+0000 7f2d9e85a640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d98142ac0 0x7f2d98149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.021+0000 7f2d9e85a640 1 --2- 172.21.15.29:0/1652952621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d980b4490 0x7f2d98146b90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.021+0000 7f2d9e85a640 1 -- 172.21.15.29:0/1652952621 >> 172.21.15.29:0/1652952621 conn(0x7f2d9806a5b0 msgr2=0x7f2d98145a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:22.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.027+0000 7f2d9e85a640 1 -- 172.21.15.29:0/1652952621 shutdown_connections 2024-09-13T18:45:22.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.027+0000 7f2d9e85a640 1 -- 172.21.15.29:0/1652952621 wait complete. 2024-09-13T18:45:22.045 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T18:45:22.045 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T18:45:22.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.153+0000 7f2524f6c640 1 Processor -- start 2024-09-13T18:45:22.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.153+0000 7f2524f6c640 1 -- start start 2024-09-13T18:45:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.154+0000 7f2524f6c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25200b4460 0x7f25200b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.154+0000 7f2524f6c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2520146200 0x7f2520146630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.154+0000 7f2524f6c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25200b5e50 con 0x7f25200b2dc0 2024-09-13T18:45:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.154+0000 7f2524f6c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2520145b10 con 0x7f2520146200 2024-09-13T18:45:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.154+0000 7f2524f6c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2520145d20 con 0x7f25200b4460 2024-09-13T18:45:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.154+0000 7f251dd9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f25200b2dc0 0x7f252013fb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52066/0 (socket says 172.21.15.29:52066) 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.154+0000 7f251dd9b640 1 -- 172.21.15.29:0/1255859092 learned_addr learned my addr 172.21.15.29:0/1255859092 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3211548497 0 0) 0x7f25200b5e50 con 0x7f25200b2dc0 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251ed9d640 1 --2- 172.21.15.29:0/1255859092 >> v2:172.21.15.96:3300/0 conn(0x7f2520146200 0x7f2520146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2508003520 con 0x7f25200b2dc0 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251e59c640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25200b4460 0x7f25200b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 878354387 0 0) 0x7f2508003520 con 0x7f25200b2dc0 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25200b4460 msgr2=0x7f25200b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25200b4460 0x7f25200b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 >> v2:172.21.15.96:3300/0 conn(0x7f2520146200 msgr2=0x7f2520146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 --2- 172.21.15.29:0/1255859092 >> v2:172.21.15.96:3300/0 conn(0x7f2520146200 0x7f2520146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200b4840 con 0x7f25200b2dc0 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f2514001670 con 0x7f25200b2dc0 2024-09-13T18:45:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251e59c640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25200b4460 0x7f25200b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 >> v1:172.21.15.29:6789/0 conn(0x7f25200b2dc0 legacy=0x7f252013fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25200b4460 0x7f2508003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2508003eb0 0x7f25080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2508004d00 0x7f2508005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520145b10 con 0x7f2508004d00 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520145d20 con 0x7f2508003eb0 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250800ba30 con 0x7f25200b4460 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251ed9d640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2508004d00 0x7f2508005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251e59c640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25200b4460 0x7f2508003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251dd9b640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2508003eb0 0x7f25080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251ed9d640 1 -- 172.21.15.29:0/1255859092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25200b4460 msgr2=0x7f2508003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251ed9d640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25200b4460 0x7f2508003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251ed9d640 1 -- 172.21.15.29:0/1255859092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2508003eb0 msgr2=0x7f25080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251ed9d640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2508003eb0 0x7f25080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.155+0000 7f251ed9d640 1 -- 172.21.15.29:0/1255859092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2508003520 con 0x7f2508004d00 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.156+0000 7f251ed9d640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2508004d00 0x7f2508005180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2518009fc0 tx=0x7f25080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0aeb111371e4875 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.156+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518031670 con 0x7f2508004d00 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.156+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251800f040 con 0x7f2508004d00 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.156+0000 7f251d59a640 1 -- 172.21.15.29:0/1255859092 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518031a10 con 0x7f2508004d00 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.157+0000 7f2524f6c640 1 -- 172.21.15.29:0/1255859092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2508004d00 msgr2=0x7f2508005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.157+0000 7f2524f6c640 1 --2- 172.21.15.29:0/1255859092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2508004d00 0x7f2508005180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2518009fc0 tx=0x7f25080057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.157+0000 7f251ed9d640 1 -- 172.21.15.29:0/1255859092 reap_dead start 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.157+0000 7f2524f6c640 1 -- 172.21.15.29:0/1255859092 shutdown_connections 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.157+0000 7f2524f6c640 1 -- 172.21.15.29:0/1255859092 >> 172.21.15.29:0/1255859092 conn(0x7f2520071e10 msgr2=0x7f25200bb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.157+0000 7f2524f6c640 1 -- 172.21.15.29:0/1255859092 shutdown_connections 2024-09-13T18:45:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.157+0000 7f2524f6c640 1 -- 172.21.15.29:0/1255859092 wait complete. 2024-09-13T18:45:22.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.158+0000 7f2524f6c640 1 Processor -- start 2024-09-13T18:45:22.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.158+0000 7f2524f6c640 1 -- start start 2024-09-13T18:45:22.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f2524f6c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2508004d00 0x7f25200a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f2524f6c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25200a88c0 0x7f25201daf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f2524f6c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25201db4d0 0x7f25200b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f2524f6c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25201dab80 con 0x7f25200a88c0 2024-09-13T18:45:22.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f2524f6c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25200a96f0 con 0x7f2508004d00 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f2524f6c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25201db950 con 0x7f25201db4d0 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f251dd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25200a88c0 0x7f25201daf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f251dd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25200a88c0 0x7f25201daf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33388/0 (socket says 172.21.15.29:33388) 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f251dd9b640 1 -- 172.21.15.29:0/614542510 learned_addr learned my addr 172.21.15.29:0/614542510 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f251e59c640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2508004d00 0x7f25200a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f251ed9d640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25201db4d0 0x7f25200b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f251dd9b640 1 -- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25201db4d0 msgr2=0x7f25200b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f251dd9b640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25201db4d0 0x7f25200b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f251dd9b640 1 -- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2508004d00 msgr2=0x7f25200a7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f251dd9b640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2508004d00 0x7f25200a7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f251dd9b640 1 -- 172.21.15.29:0/614542510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200a9030 con 0x7f25200a88c0 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f251dd9b640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25200a88c0 0x7f25201daf90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2514007340 tx=0x7f2514007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.159+0000 7f250effd640 1 -- 172.21.15.29:0/614542510 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400f8b0 con 0x7f25200a88c0 2024-09-13T18:45:22.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.160+0000 7f250effd640 1 -- 172.21.15.29:0/614542510 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400fa30 con 0x7f25200a88c0 2024-09-13T18:45:22.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.160+0000 7f2524f6c640 1 -- 172.21.15.29:0/614542510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25200a9310 con 0x7f25200a88c0 2024-09-13T18:45:22.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.160+0000 7f250effd640 1 -- 172.21.15.29:0/614542510 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400fde0 con 0x7f25200a88c0 2024-09-13T18:45:22.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.160+0000 7f2524f6c640 1 -- 172.21.15.29:0/614542510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25200a8d20 con 0x7f25200a88c0 2024-09-13T18:45:22.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.161+0000 7f2524f6c640 1 -- 172.21.15.29:0/614542510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25200b3b30 con 0x7f25200a88c0 2024-09-13T18:45:22.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.161+0000 7f250effd640 1 -- 172.21.15.29:0/614542510 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f251401d460 con 0x7f25200a88c0 2024-09-13T18:45:22.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.162+0000 7f250effd640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f250006ac00 0x7f250006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.162+0000 7f250effd640 1 -- 172.21.15.29:0/614542510 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2514089470 con 0x7f25200a88c0 2024-09-13T18:45:22.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.162+0000 7f251e59c640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f250006ac00 0x7f250006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.162+0000 7f251e59c640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f250006ac00 0x7f250006d0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2510006fa0 tx=0x7f2510008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:22.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.166+0000 7f250effd640 1 -- 172.21.15.29:0/614542510 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f25140546f0 con 0x7f25200a88c0 2024-09-13T18:45:22.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:22.345+0000 7f2524f6c640 1 -- 172.21.15.29:0/614542510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f252013d9e0 con 0x7f25200a88c0 2024-09-13T18:45:23.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.011+0000 7f250effd640 1 -- 172.21.15.29:0/614542510 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f2514057d10 con 0x7f25200a88c0 2024-09-13T18:45:23.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.013+0000 7f2524f6c640 1 -- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f250006ac00 msgr2=0x7f250006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.013+0000 7f2524f6c640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f250006ac00 0x7f250006d0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2510006fa0 tx=0x7f2510008040 comp rx=0 tx=0).stop 2024-09-13T18:45:23.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.013+0000 7f2524f6c640 1 -- 172.21.15.29:0/614542510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25200a88c0 msgr2=0x7f25201daf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.013+0000 7f2524f6c640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25200a88c0 0x7f25201daf90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2514007340 tx=0x7f2514007800 comp rx=0 tx=0).stop 2024-09-13T18:45:23.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.013+0000 7f2524f6c640 1 -- 172.21.15.29:0/614542510 shutdown_connections 2024-09-13T18:45:23.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.013+0000 7f2524f6c640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f250006ac00 0x7f250006d0c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.013+0000 7f2524f6c640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25201db4d0 0x7f25200b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.013+0000 7f2524f6c640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25200a88c0 0x7f25201daf90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.013+0000 7f2524f6c640 1 --2- 172.21.15.29:0/614542510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2508004d00 0x7f25200a7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.013+0000 7f2524f6c640 1 -- 172.21.15.29:0/614542510 >> 172.21.15.29:0/614542510 conn(0x7f2520071e10 msgr2=0x7f252013df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:23.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.014+0000 7f2524f6c640 1 -- 172.21.15.29:0/614542510 shutdown_connections 2024-09-13T18:45:23.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.014+0000 7f2524f6c640 1 -- 172.21.15.29:0/614542510 wait complete. 2024-09-13T18:45:23.030 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:45:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.143+0000 7f064b776640 1 Processor -- start 2024-09-13T18:45:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.143+0000 7f064b776640 1 -- start start 2024-09-13T18:45:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f064b776640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064406caf0 0x7f0644145c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f064b776640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f06441461b0 0x7f06440b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f064b776640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0644146640 con 0x7f064406afe0 2024-09-13T18:45:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f064b776640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0644072120 con 0x7f06441461b0 2024-09-13T18:45:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f064b776640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06440b5db0 con 0x7f064406caf0 2024-09-13T18:45:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f0649d13640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f06441461b0 0x7f06440b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f0649d13640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f06441461b0 0x7f06440b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33390/0 (socket says 172.21.15.29:33390) 2024-09-13T18:45:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f0649d13640 1 -- 172.21.15.29:0/3334332516 learned_addr learned my addr 172.21.15.29:0/3334332516 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f0649512640 1 --2- 172.21.15.29:0/3334332516 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064406caf0 0x7f0644145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f0649d13640 1 -- 172.21.15.29:0/3334332516 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064406caf0 msgr2=0x7f0644145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f0649d13640 1 --2- 172.21.15.29:0/3334332516 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064406caf0 0x7f0644145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f0649d13640 1 -- 172.21.15.29:0/3334332516 >> v1:172.21.15.96:6789/0 conn(0x7f064406afe0 legacy=0x7f06440af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.144+0000 7f0649d13640 1 -- 172.21.15.29:0/3334332516 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064406c0f0 con 0x7f06441461b0 2024-09-13T18:45:23.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.145+0000 7f0649d13640 1 --2- 172.21.15.29:0/3334332516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06441461b0 0x7f06440b0010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f063c009e50 tx=0x7f063c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b07167510c376f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:23.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.145+0000 7f063bfff640 1 -- 172.21.15.29:0/3334332516 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c031600 con 0x7f06441461b0 2024-09-13T18:45:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.145+0000 7f063bfff640 1 -- 172.21.15.29:0/3334332516 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c02d050 con 0x7f06441461b0 2024-09-13T18:45:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.145+0000 7f063bfff640 1 -- 172.21.15.29:0/3334332516 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c031980 con 0x7f06441461b0 2024-09-13T18:45:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.146+0000 7f064b776640 1 -- 172.21.15.29:0/3334332516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06441461b0 msgr2=0x7f06440b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.146+0000 7f064b776640 1 --2- 172.21.15.29:0/3334332516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06441461b0 0x7f06440b0010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f063c009e50 tx=0x7f063c02a5f0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.146+0000 7f064b776640 1 -- 172.21.15.29:0/3334332516 shutdown_connections 2024-09-13T18:45:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.146+0000 7f064b776640 1 --2- 172.21.15.29:0/3334332516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06441461b0 0x7f06440b0010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.146+0000 7f064b776640 1 --2- 172.21.15.29:0/3334332516 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064406caf0 0x7f0644145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.146+0000 7f064b776640 1 -- 172.21.15.29:0/3334332516 >> 172.21.15.29:0/3334332516 conn(0x7f06440b94c0 msgr2=0x7f06440b98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.146+0000 7f064b776640 1 -- 172.21.15.29:0/3334332516 shutdown_connections 2024-09-13T18:45:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.146+0000 7f064b776640 1 -- 172.21.15.29:0/3334332516 wait complete. 2024-09-13T18:45:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.147+0000 7f064b776640 1 Processor -- start 2024-09-13T18:45:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.147+0000 7f064b776640 1 -- start start 2024-09-13T18:45:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f064b776640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064406afe0 0x7f0644142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f064b776640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064406caf0 0x7f06440ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f064b776640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06441461b0 0x7f06440ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f064b776640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06441cc320 con 0x7f064406afe0 2024-09-13T18:45:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f064b776640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06441de3e0 con 0x7f06441461b0 2024-09-13T18:45:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f064b776640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06441de6c0 con 0x7f064406caf0 2024-09-13T18:45:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f0649512640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064406afe0 0x7f0644142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f0649512640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064406afe0 0x7f0644142ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33396/0 (socket says 172.21.15.29:33396) 2024-09-13T18:45:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f0649512640 1 -- 172.21.15.29:0/3797435129 learned_addr learned my addr 172.21.15.29:0/3797435129 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f0648d11640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064406caf0 0x7f06440ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f0649d13640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06441461b0 0x7f06440ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f0649512640 1 -- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064406caf0 msgr2=0x7f06440ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f0649512640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064406caf0 0x7f06440ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f0649512640 1 -- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06441461b0 msgr2=0x7f06440ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f0649512640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06441461b0 0x7f06440ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f0649512640 1 -- 172.21.15.29:0/3797435129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c009b30 con 0x7f064406afe0 2024-09-13T18:45:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f0649512640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064406afe0 0x7f0644142ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f064000e9b0 tx=0x7f064000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.148+0000 7f0639ffb640 1 -- 172.21.15.29:0/3797435129 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0640009670 con 0x7f064406afe0 2024-09-13T18:45:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.149+0000 7f0639ffb640 1 -- 172.21.15.29:0/3797435129 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064000c9a0 con 0x7f064406afe0 2024-09-13T18:45:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.149+0000 7f064b776640 1 -- 172.21.15.29:0/3797435129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06441de9a0 con 0x7f064406afe0 2024-09-13T18:45:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.149+0000 7f0639ffb640 1 -- 172.21.15.29:0/3797435129 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000cd50 con 0x7f064406afe0 2024-09-13T18:45:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.149+0000 7f064b776640 1 -- 172.21.15.29:0/3797435129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06441cc590 con 0x7f064406afe0 2024-09-13T18:45:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.150+0000 7f064b776640 1 -- 172.21.15.29:0/3797435129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0644145c70 con 0x7f064406afe0 2024-09-13T18:45:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.150+0000 7f0639ffb640 1 -- 172.21.15.29:0/3797435129 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0640013470 con 0x7f064406afe0 2024-09-13T18:45:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.151+0000 7f0639ffb640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f062806ac00 0x7f062806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.151+0000 7f0639ffb640 1 -- 172.21.15.29:0/3797435129 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f0640089590 con 0x7f064406afe0 2024-09-13T18:45:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.151+0000 7f0648d11640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f062806ac00 0x7f062806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:23.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.151+0000 7f0648d11640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f062806ac00 0x7f062806d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06440ad070 tx=0x7f0634009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:23.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.155+0000 7f0639ffb640 1 -- 172.21.15.29:0/3797435129 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f06400547d0 con 0x7f064406afe0 2024-09-13T18:45:23.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:23.324+0000 7f064b776640 1 -- 172.21.15.29:0/3797435129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f06440b8980 con 0x7f064406afe0 2024-09-13T18:45:25.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.029+0000 7f0639ffb640 1 -- 172.21.15.29:0/3797435129 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f0640057df0 con 0x7f064406afe0 2024-09-13T18:45:25.032 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' created 2024-09-13T18:45:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.033+0000 7f064b776640 1 -- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f062806ac00 msgr2=0x7f062806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.033+0000 7f064b776640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f062806ac00 0x7f062806d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06440ad070 tx=0x7f0634009040 comp rx=0 tx=0).stop 2024-09-13T18:45:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.033+0000 7f064b776640 1 -- 172.21.15.29:0/3797435129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064406afe0 msgr2=0x7f0644142ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.033+0000 7f064b776640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064406afe0 0x7f0644142ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f064000e9b0 tx=0x7f064000ee70 comp rx=0 tx=0).stop 2024-09-13T18:45:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.035+0000 7f064b776640 1 -- 172.21.15.29:0/3797435129 shutdown_connections 2024-09-13T18:45:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.035+0000 7f064b776640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f062806ac00 0x7f062806d0c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.035+0000 7f064b776640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06441461b0 0x7f06440ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.035+0000 7f064b776640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064406caf0 0x7f06440ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.035+0000 7f064b776640 1 --2- 172.21.15.29:0/3797435129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064406afe0 0x7f0644142ea0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.035+0000 7f064b776640 1 -- 172.21.15.29:0/3797435129 >> 172.21.15.29:0/3797435129 conn(0x7f06440b94c0 msgr2=0x7f0644145120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.036+0000 7f064b776640 1 -- 172.21.15.29:0/3797435129 shutdown_connections 2024-09-13T18:45:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.036+0000 7f064b776640 1 -- 172.21.15.29:0/3797435129 wait complete. 2024-09-13T18:45:25.057 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T18:45:25.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.165+0000 7f9768c87640 1 Processor -- start 2024-09-13T18:45:25.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.165+0000 7f9768c87640 1 -- start start 2024-09-13T18:45:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.166+0000 7f9768c87640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f97640bbe10 0x7f9764148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.166+0000 7f9768c87640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97640b3410 con 0x7f97640b4300 2024-09-13T18:45:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.166+0000 7f9768c87640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97640b52e0 con 0x7f976413fbd0 2024-09-13T18:45:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.166+0000 7f9768c87640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97640bc2b0 con 0x7f97640bbe10 2024-09-13T18:45:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.166+0000 7f976259c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f97640bbe10 0x7f9764148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.166+0000 7f9761d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f97640b4300 0x7f976413f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42816/0 (socket says 172.21.15.29:42816) 2024-09-13T18:45:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.166+0000 7f9761d9b640 1 -- 172.21.15.29:0/3795264331 learned_addr learned my addr 172.21.15.29:0/3795264331 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.166+0000 7f976259c640 1 -- 172.21.15.29:0/3795264331 >> v1:172.21.15.96:6789/0 conn(0x7f976413fbd0 legacy=0x7f9764150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:25.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.166+0000 7f976259c640 1 -- 172.21.15.29:0/3795264331 >> v1:172.21.15.29:6789/0 conn(0x7f97640b4300 legacy=0x7f976413f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.167+0000 7f976159a640 1 -- 172.21.15.29:0/3795264331 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590757874 0 0) 0x7f97640b3410 con 0x7f97640b4300 2024-09-13T18:45:25.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.167+0000 7f976259c640 1 -- 172.21.15.29:0/3795264331 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97640b2930 con 0x7f97640bbe10 2024-09-13T18:45:25.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.167+0000 7f976259c640 1 --2- 172.21.15.29:0/3795264331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97640bbe10 0x7f9764148ee0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f97540097d0 tx=0x7f975402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1c92a5a94fd319 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:25.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.167+0000 7f976159a640 1 -- 172.21.15.29:0/3795264331 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975402ae90 con 0x7f97640bbe10 2024-09-13T18:45:25.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.167+0000 7f976159a640 1 -- 172.21.15.29:0/3795264331 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9754032440 con 0x7f97640bbe10 2024-09-13T18:45:25.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.167+0000 7f976159a640 1 -- 172.21.15.29:0/3795264331 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540327d0 con 0x7f97640bbe10 2024-09-13T18:45:25.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.168+0000 7f9768c87640 1 -- 172.21.15.29:0/3795264331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97640bbe10 msgr2=0x7f9764148ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.168+0000 7f9768c87640 1 --2- 172.21.15.29:0/3795264331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97640bbe10 0x7f9764148ee0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f97540097d0 tx=0x7f975402a180 comp rx=0 tx=0).stop 2024-09-13T18:45:25.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.168+0000 7f9768c87640 1 -- 172.21.15.29:0/3795264331 shutdown_connections 2024-09-13T18:45:25.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.168+0000 7f9768c87640 1 --2- 172.21.15.29:0/3795264331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97640bbe10 0x7f9764148ee0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.168+0000 7f9768c87640 1 -- 172.21.15.29:0/3795264331 >> 172.21.15.29:0/3795264331 conn(0x7f9764071c30 msgr2=0x7f97640bb490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:25.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.168+0000 7f9768c87640 1 -- 172.21.15.29:0/3795264331 shutdown_connections 2024-09-13T18:45:25.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.168+0000 7f9768c87640 1 -- 172.21.15.29:0/3795264331 wait complete. 2024-09-13T18:45:25.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.169+0000 7f9768c87640 1 Processor -- start 2024-09-13T18:45:25.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.169+0000 7f9768c87640 1 -- start start 2024-09-13T18:45:25.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f9768c87640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97640b4300 0x7f9764148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:25.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f9768c87640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97640bbe10 0x7f9764147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:25.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f9768c87640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f976413fbd0 0x7f97641db6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:25.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f9768c87640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9764142a30 con 0x7f97640b4300 2024-09-13T18:45:25.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f9768c87640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97641431d0 con 0x7f97640bbe10 2024-09-13T18:45:25.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f9768c87640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97641db260 con 0x7f976413fbd0 2024-09-13T18:45:25.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f976259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97640b4300 0x7f9764148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:25.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f976259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97640b4300 0x7f9764148640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42846/0 (socket says 172.21.15.29:42846) 2024-09-13T18:45:25.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f976259c640 1 -- 172.21.15.29:0/3330504648 learned_addr learned my addr 172.21.15.29:0/3330504648 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:25.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f9761d9b640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97640bbe10 0x7f9764147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:25.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f9762d9d640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f976413fbd0 0x7f97641db6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:25.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f976259c640 1 -- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f976413fbd0 msgr2=0x7f97641db6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f976259c640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f976413fbd0 0x7f97641db6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f976259c640 1 -- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97640bbe10 msgr2=0x7f9764147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f976259c640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97640bbe10 0x7f9764147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.170+0000 7f976259c640 1 -- 172.21.15.29:0/3330504648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9754009400 con 0x7f97640b4300 2024-09-13T18:45:25.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.171+0000 7f976259c640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97640b4300 0x7f9764148640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f97540098f0 tx=0x7f97540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:25.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.171+0000 7f9752ffd640 1 -- 172.21.15.29:0/3330504648 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754004230 con 0x7f97640b4300 2024-09-13T18:45:25.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.171+0000 7f9752ffd640 1 -- 172.21.15.29:0/3330504648 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9754004390 con 0x7f97640b4300 2024-09-13T18:45:25.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.171+0000 7f9768c87640 1 -- 172.21.15.29:0/3330504648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9764147bd0 con 0x7f97640b4300 2024-09-13T18:45:25.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.171+0000 7f9752ffd640 1 -- 172.21.15.29:0/3330504648 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540309d0 con 0x7f97640b4300 2024-09-13T18:45:25.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.171+0000 7f9768c87640 1 -- 172.21.15.29:0/3330504648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9764142ef0 con 0x7f97640b4300 2024-09-13T18:45:25.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.172+0000 7f9768c87640 1 -- 172.21.15.29:0/3330504648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97641db3d0 con 0x7f97640b4300 2024-09-13T18:45:25.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.172+0000 7f9752ffd640 1 -- 172.21.15.29:0/3330504648 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9754039040 con 0x7f97640b4300 2024-09-13T18:45:25.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.173+0000 7f9752ffd640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f974406ac00 0x7f974406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:25.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.173+0000 7f9752ffd640 1 -- 172.21.15.29:0/3330504648 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f97540a9c00 con 0x7f97640b4300 2024-09-13T18:45:25.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.173+0000 7f9761d9b640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f974406ac00 0x7f974406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:25.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.173+0000 7f9761d9b640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f974406ac00 0x7f974406d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f97641dc390 tx=0x7f9758007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:25.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.177+0000 7f9752ffd640 1 -- 172.21.15.29:0/3330504648 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f97641db3d0 con 0x7f97640b4300 2024-09-13T18:45:25.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:25.348+0000 7f9768c87640 1 -- 172.21.15.29:0/3330504648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f97641db3d0 con 0x7f97640b4300 2024-09-13T18:45:25.986 INFO:tasks.ceph.mds.a.smithi029.stderr:2024-09-13T18:45:25.983+0000 7f3e5e2a5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:45:26.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.034+0000 7f9752ffd640 1 -- 172.21.15.29:0/3330504648 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f97641db3d0 con 0x7f97640b4300 2024-09-13T18:45:26.038 INFO:teuthology.orchestra.run.smithi029.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T18:45:26.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.046+0000 7f9768c87640 1 -- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f974406ac00 msgr2=0x7f974406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.047+0000 7f9768c87640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f974406ac00 0x7f974406d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f97641dc390 tx=0x7f9758007d50 comp rx=0 tx=0).stop 2024-09-13T18:45:26.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.047+0000 7f9768c87640 1 -- 172.21.15.29:0/3330504648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97640b4300 msgr2=0x7f9764148640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.047+0000 7f9768c87640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97640b4300 0x7f9764148640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f97540098f0 tx=0x7f97540046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.051+0000 7f9768c87640 1 -- 172.21.15.29:0/3330504648 shutdown_connections 2024-09-13T18:45:26.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.051+0000 7f9768c87640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f974406ac00 0x7f974406d0c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.051+0000 7f9768c87640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f976413fbd0 0x7f97641db6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.051+0000 7f9768c87640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97640bbe10 0x7f9764147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.051+0000 7f9768c87640 1 --2- 172.21.15.29:0/3330504648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97640b4300 0x7f9764148640 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.051+0000 7f9768c87640 1 -- 172.21.15.29:0/3330504648 >> 172.21.15.29:0/3330504648 conn(0x7f9764071c30 msgr2=0x7f9764145110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:26.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.056+0000 7f9768c87640 1 -- 172.21.15.29:0/3330504648 shutdown_connections 2024-09-13T18:45:26.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.056+0000 7f9768c87640 1 -- 172.21.15.29:0/3330504648 wait complete. 2024-09-13T18:45:26.073 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T18:45:26.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.177+0000 7f559d020640 1 Processor -- start 2024-09-13T18:45:26.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.177+0000 7f559d020640 1 -- start start 2024-09-13T18:45:26.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f559d020640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f55980b5f50 0x7f559813f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f559d020640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980b3320 0x7f559813fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f559d020640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55980b3880 con 0x7f55980b44b0 2024-09-13T18:45:26.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f559d020640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55980b5580 con 0x7f55980b5f50 2024-09-13T18:45:26.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f559d020640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55980b4890 con 0x7f55980b3320 2024-09-13T18:45:26.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f559659c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f55980b5f50 0x7f559813f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f5596d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f55980b44b0 0x7f55981462e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42818/0 (socket says 172.21.15.29:42818) 2024-09-13T18:45:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f5596d9d640 1 -- 172.21.15.29:0/545224554 learned_addr learned my addr 172.21.15.29:0/545224554 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f559759e640 1 --2- 172.21.15.29:0/545224554 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980b3320 0x7f559813fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f559659c640 1 -- 172.21.15.29:0/545224554 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980b3320 msgr2=0x7f559813fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f559659c640 1 --2- 172.21.15.29:0/545224554 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980b3320 0x7f559813fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f559659c640 1 -- 172.21.15.29:0/545224554 >> v1:172.21.15.29:6789/0 conn(0x7f55980b44b0 legacy=0x7f55981462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.178+0000 7f559659c640 1 -- 172.21.15.29:0/545224554 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55980b57f0 con 0x7f55980b5f50 2024-09-13T18:45:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.179+0000 7f559659c640 1 --2- 172.21.15.29:0/545224554 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55980b5f50 0x7f559813f5f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f558c0097a0 tx=0x7f558c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7116ca5fda275bff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.179+0000 7f5595d9b640 1 -- 172.21.15.29:0/545224554 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c032440 con 0x7f55980b5f50 2024-09-13T18:45:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.179+0000 7f5595d9b640 1 -- 172.21.15.29:0/545224554 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c0325a0 con 0x7f55980b5f50 2024-09-13T18:45:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.179+0000 7f5595d9b640 1 -- 172.21.15.29:0/545224554 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c032930 con 0x7f55980b5f50 2024-09-13T18:45:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.180+0000 7f559d020640 1 -- 172.21.15.29:0/545224554 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55980b5f50 msgr2=0x7f559813f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.180+0000 7f559d020640 1 --2- 172.21.15.29:0/545224554 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55980b5f50 0x7f559813f5f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f558c0097a0 tx=0x7f558c02a180 comp rx=0 tx=0).stop 2024-09-13T18:45:26.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.180+0000 7f559d020640 1 -- 172.21.15.29:0/545224554 shutdown_connections 2024-09-13T18:45:26.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.180+0000 7f559d020640 1 --2- 172.21.15.29:0/545224554 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980b3320 0x7f559813fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.180+0000 7f559d020640 1 --2- 172.21.15.29:0/545224554 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55980b5f50 0x7f559813f5f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.180+0000 7f559d020640 1 -- 172.21.15.29:0/545224554 >> 172.21.15.29:0/545224554 conn(0x7f55980b8050 msgr2=0x7f55980b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:26.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.180+0000 7f559d020640 1 -- 172.21.15.29:0/545224554 shutdown_connections 2024-09-13T18:45:26.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.180+0000 7f559d020640 1 -- 172.21.15.29:0/545224554 wait complete. 2024-09-13T18:45:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.181+0000 7f559d020640 1 Processor -- start 2024-09-13T18:45:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.181+0000 7f559d020640 1 -- start start 2024-09-13T18:45:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559d020640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980b3320 0x7f55980bb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559d020640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55980b44b0 0x7f55981db5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559d020640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55980b5f50 0x7f55981deb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559d020640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55981ccc10 con 0x7f55980b44b0 2024-09-13T18:45:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559d020640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55981cba20 con 0x7f55980b5f50 2024-09-13T18:45:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559d020640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55981cbd00 con 0x7f55980b3320 2024-09-13T18:45:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55980b44b0 0x7f55981db5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55980b44b0 0x7f55981db5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42862/0 (socket says 172.21.15.29:42862) 2024-09-13T18:45:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559659c640 1 -- 172.21.15.29:0/1035419440 learned_addr learned my addr 172.21.15.29:0/1035419440 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559759e640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55980b5f50 0x7f55981deb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f5596d9d640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980b3320 0x7f55980bb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559659c640 1 -- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980b3320 msgr2=0x7f55980bb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559659c640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980b3320 0x7f55980bb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559659c640 1 -- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55980b5f50 msgr2=0x7f55981deb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559659c640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55980b5f50 0x7f55981deb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559659c640 1 -- 172.21.15.29:0/1035419440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c009400 con 0x7f55980b44b0 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f5596d9d640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980b3320 0x7f55980bb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.182+0000 7f559659c640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55980b44b0 0x7f55981db5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f558c035040 tx=0x7f558c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.183+0000 7f557f7fe640 1 -- 172.21.15.29:0/1035419440 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c032440 con 0x7f55980b44b0 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.183+0000 7f557f7fe640 1 -- 172.21.15.29:0/1035419440 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c006e10 con 0x7f55980b44b0 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.183+0000 7f557f7fe640 1 -- 172.21.15.29:0/1035419440 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c030be0 con 0x7f55980b44b0 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.183+0000 7f559d020640 1 -- 172.21.15.29:0/1035419440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559813e290 con 0x7f55980b44b0 2024-09-13T18:45:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.183+0000 7f559d020640 1 -- 172.21.15.29:0/1035419440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55981dbb20 con 0x7f55980b44b0 2024-09-13T18:45:26.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.184+0000 7f559d020640 1 -- 172.21.15.29:0/1035419440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55981462e0 con 0x7f55980b44b0 2024-09-13T18:45:26.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.184+0000 7f557f7fe640 1 -- 172.21.15.29:0/1035419440 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f558c039040 con 0x7f55980b44b0 2024-09-13T18:45:26.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.185+0000 7f557f7fe640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f558406ac00 0x7f558406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.185+0000 7f557f7fe640 1 -- 172.21.15.29:0/1035419440 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f558c0a9f50 con 0x7f55980b44b0 2024-09-13T18:45:26.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.185+0000 7f5596d9d640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f558406ac00 0x7f558406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.185+0000 7f5596d9d640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f558406ac00 0x7f558406d0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5588005880 tx=0x7f5588009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.189+0000 7f557f7fe640 1 -- 172.21.15.29:0/1035419440 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f558c075010 con 0x7f55980b44b0 2024-09-13T18:45:26.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.402+0000 7f559d020640 1 -- 172.21.15.29:0/1035419440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f5598141150 con 0x7f55980b44b0 2024-09-13T18:45:26.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.407+0000 7f557f7fe640 1 -- 172.21.15.29:0/1035419440 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f558c078630 con 0x7f55980b44b0 2024-09-13T18:45:26.410 INFO:teuthology.orchestra.run.smithi029.stderr:added data pool 4 to fsmap 2024-09-13T18:45:26.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.409+0000 7f559d020640 1 -- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f558406ac00 msgr2=0x7f558406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.409+0000 7f559d020640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f558406ac00 0x7f558406d0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5588005880 tx=0x7f5588009040 comp rx=0 tx=0).stop 2024-09-13T18:45:26.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.409+0000 7f559d020640 1 -- 172.21.15.29:0/1035419440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55980b44b0 msgr2=0x7f55981db5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.409+0000 7f559d020640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55980b44b0 0x7f55981db5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f558c035040 tx=0x7f558c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.409+0000 7f559d020640 1 -- 172.21.15.29:0/1035419440 shutdown_connections 2024-09-13T18:45:26.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.409+0000 7f559d020640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f558406ac00 0x7f558406d0c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.409+0000 7f559d020640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55980b5f50 0x7f55981deb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.409+0000 7f559d020640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55980b44b0 0x7f55981db5e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.409+0000 7f559d020640 1 --2- 172.21.15.29:0/1035419440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980b3320 0x7f55980bb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.409+0000 7f559d020640 1 -- 172.21.15.29:0/1035419440 >> 172.21.15.29:0/1035419440 conn(0x7f55980b8050 msgr2=0x7f5598140700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:26.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.409+0000 7f559d020640 1 -- 172.21.15.29:0/1035419440 shutdown_connections 2024-09-13T18:45:26.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.409+0000 7f559d020640 1 -- 172.21.15.29:0/1035419440 wait complete. 2024-09-13T18:45:26.423 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:26.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.520+0000 7fe679e5a640 1 Processor -- start 2024-09-13T18:45:26.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.520+0000 7fe679e5a640 1 -- start start 2024-09-13T18:45:26.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.521+0000 7fe679e5a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6740b35b0 0x7fe6741498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.521+0000 7fe679e5a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe674149410 con 0x7fe67413f8e0 2024-09-13T18:45:26.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.521+0000 7fe679e5a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6740b4810 con 0x7fe6740b31d0 2024-09-13T18:45:26.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.521+0000 7fe679e5a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6741490a0 con 0x7fe6740b35b0 2024-09-13T18:45:26.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.521+0000 7fe673fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe67413f8e0 0x7fe67413fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42826/0 (socket says 172.21.15.29:42826) 2024-09-13T18:45:26.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.521+0000 7fe673fff640 1 -- 172.21.15.29:0/2063198630 learned_addr learned my addr 172.21.15.29:0/2063198630 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:26.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.521+0000 7fe672ffd640 1 --2- 172.21.15.29:0/2063198630 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6740b35b0 0x7fe6741498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.521+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781644168 0 0) 0x7fe674149410 con 0x7fe67413f8e0 2024-09-13T18:45:26.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe65c003520 con 0x7fe67413f8e0 2024-09-13T18:45:26.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 935698479 0 0) 0x7fe65c003520 con 0x7fe67413f8e0 2024-09-13T18:45:26.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6740b35b0 msgr2=0x7fe6741498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:26.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 --2- 172.21.15.29:0/2063198630 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6740b35b0 0x7fe6741498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 >> v1:172.21.15.96:6789/0 conn(0x7fe6740b31d0 legacy=0x7fe6740b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6740b5760 con 0x7fe67413f8e0 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7fe66c0019f0 con 0x7fe67413f8e0 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 >> v1:172.21.15.29:6789/0 conn(0x7fe67413f8e0 legacy=0x7fe67413fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 --2- 172.21.15.29:0/2063198630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0039a0 0x7fe65c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 --2- 172.21.15.29:0/2063198630 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6740b35b0 0x7fe65c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 --2- 172.21.15.29:0/2063198630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe65c004d00 0x7fe65c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6741490a0 con 0x7fe65c004d00 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c00bae0 con 0x7fe65c0039a0 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c00bca0 con 0x7fe6740b35b0 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe673fff640 1 --2- 172.21.15.29:0/2063198630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe65c004d00 0x7fe65c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe6737fe640 1 --2- 172.21.15.29:0/2063198630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0039a0 0x7fe65c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe672ffd640 1 --2- 172.21.15.29:0/2063198630 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6740b35b0 0x7fe65c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe673fff640 1 -- 172.21.15.29:0/2063198630 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6740b35b0 msgr2=0x7fe65c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe673fff640 1 --2- 172.21.15.29:0/2063198630 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6740b35b0 0x7fe65c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe673fff640 1 -- 172.21.15.29:0/2063198630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0039a0 msgr2=0x7fe65c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe673fff640 1 --2- 172.21.15.29:0/2063198630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c0039a0 0x7fe65c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.522+0000 7fe673fff640 1 -- 172.21.15.29:0/2063198630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c003520 con 0x7fe65c004d00 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.523+0000 7fe673fff640 1 --2- 172.21.15.29:0/2063198630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe65c004d00 0x7fe65c005180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00a830 tx=0x7fe65c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0e5309cea28066 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.523+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c02ba50 con 0x7fe65c004d00 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.523+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c02bbb0 con 0x7fe65c004d00 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.523+0000 7fe6727fc640 1 -- 172.21.15.29:0/2063198630 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c034470 con 0x7fe65c004d00 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.524+0000 7fe679e5a640 1 -- 172.21.15.29:0/2063198630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe65c004d00 msgr2=0x7fe65c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.524+0000 7fe679e5a640 1 --2- 172.21.15.29:0/2063198630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe65c004d00 0x7fe65c005180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00a830 tx=0x7fe65c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.524+0000 7fe673fff640 1 -- 172.21.15.29:0/2063198630 reap_dead start 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.524+0000 7fe679e5a640 1 -- 172.21.15.29:0/2063198630 shutdown_connections 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.524+0000 7fe679e5a640 1 -- 172.21.15.29:0/2063198630 >> 172.21.15.29:0/2063198630 conn(0x7fe6740bb590 msgr2=0x7fe6740bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.524+0000 7fe679e5a640 1 -- 172.21.15.29:0/2063198630 shutdown_connections 2024-09-13T18:45:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.524+0000 7fe679e5a640 1 -- 172.21.15.29:0/2063198630 wait complete. 2024-09-13T18:45:26.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.525+0000 7fe679e5a640 1 Processor -- start 2024-09-13T18:45:26.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.525+0000 7fe679e5a640 1 -- start start 2024-09-13T18:45:26.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe679e5a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c004d00 0x7fe674147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe679e5a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6741dac50 0x7fe6741db0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe679e5a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6741de1c0 0x7fe6741de640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe679e5a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6741db610 con 0x7fe6741dac50 2024-09-13T18:45:26.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe679e5a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe674148d40 con 0x7fe65c004d00 2024-09-13T18:45:26.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe679e5a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6741488b0 con 0x7fe6741de1c0 2024-09-13T18:45:26.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe672ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6741dac50 0x7fe6741db0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe672ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6741dac50 0x7fe6741db0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42894/0 (socket says 172.21.15.29:42894) 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe672ffd640 1 -- 172.21.15.29:0/2233102135 learned_addr learned my addr 172.21.15.29:0/2233102135 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe6737fe640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c004d00 0x7fe674147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe673fff640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6741de1c0 0x7fe6741de640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe672ffd640 1 -- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6741de1c0 msgr2=0x7fe6741de640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe672ffd640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6741de1c0 0x7fe6741de640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe672ffd640 1 -- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c004d00 msgr2=0x7fe674147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe672ffd640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c004d00 0x7fe674147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe672ffd640 1 -- 172.21.15.29:0/2233102135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6740a8330 con 0x7fe6741dac50 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe672ffd640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6741dac50 0x7fe6741db0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe668011910 tx=0x7fe668011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe65bfff640 1 -- 172.21.15.29:0/2233102135 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800faf0 con 0x7fe6741dac50 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe65bfff640 1 -- 172.21.15.29:0/2233102135 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66800fc50 con 0x7fe6741dac50 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe679e5a640 1 -- 172.21.15.29:0/2233102135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6740a8880 con 0x7fe6741dac50 2024-09-13T18:45:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe65bfff640 1 -- 172.21.15.29:0/2233102135 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668014440 con 0x7fe6741dac50 2024-09-13T18:45:26.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.526+0000 7fe679e5a640 1 -- 172.21.15.29:0/2233102135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe674148540 con 0x7fe6741dac50 2024-09-13T18:45:26.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.527+0000 7fe679e5a640 1 -- 172.21.15.29:0/2233102135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe674067300 con 0x7fe6741dac50 2024-09-13T18:45:26.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.528+0000 7fe65bfff640 1 -- 172.21.15.29:0/2233102135 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe6680145a0 con 0x7fe6741dac50 2024-09-13T18:45:26.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.528+0000 7fe65bfff640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe66006ac00 0x7fe66006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.528+0000 7fe65bfff640 1 -- 172.21.15.29:0/2233102135 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe668089d90 con 0x7fe6741dac50 2024-09-13T18:45:26.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.528+0000 7fe6737fe640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe66006ac00 0x7fe66006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.529+0000 7fe6737fe640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe66006ac00 0x7fe66006d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6640017e0 tx=0x7fe664009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.533+0000 7fe65bfff640 1 -- 172.21.15.29:0/2233102135 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe668054d30 con 0x7fe6741dac50 2024-09-13T18:45:26.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.739+0000 7fe679e5a640 1 -- 172.21.15.29:0/2233102135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6740b4010 con 0x7fe6741dac50 2024-09-13T18:45:26.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.739+0000 7fe65bfff640 1 -- 172.21.15.29:0/2233102135 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3215 (secure 0 0 0) 0x7fe668022ca0 con 0x7fe6741dac50 2024-09-13T18:45:26.743 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:26.743 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/3867151553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3867151553},{"type":"v1","addr":"172.21.15.96:6835","nonce":3867151553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:22.006847+0000","modified":"2024-09-13T18:45:26.405396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6833/175129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":175129703},{"type":"v1","addr":"172.21.15.29:6833","nonce":175129703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:45:26.743 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2024-09-13T18:45:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.741+0000 7fe679e5a640 1 -- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe66006ac00 msgr2=0x7fe66006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.741+0000 7fe679e5a640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe66006ac00 0x7fe66006d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6640017e0 tx=0x7fe664009040 comp rx=0 tx=0).stop 2024-09-13T18:45:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.741+0000 7fe679e5a640 1 -- 172.21.15.29:0/2233102135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6741dac50 msgr2=0x7fe6741db0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.741+0000 7fe679e5a640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6741dac50 0x7fe6741db0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe668011910 tx=0x7fe668011dd0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.741+0000 7fe679e5a640 1 -- 172.21.15.29:0/2233102135 shutdown_connections 2024-09-13T18:45:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.741+0000 7fe679e5a640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe66006ac00 0x7fe66006d0c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.741+0000 7fe679e5a640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6741de1c0 0x7fe6741de640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.741+0000 7fe679e5a640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6741dac50 0x7fe6741db0d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.741+0000 7fe679e5a640 1 --2- 172.21.15.29:0/2233102135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe65c004d00 0x7fe674147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.741+0000 7fe679e5a640 1 -- 172.21.15.29:0/2233102135 >> 172.21.15.29:0/2233102135 conn(0x7fe6740bb590 msgr2=0x7fe67413db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:26.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.741+0000 7fe679e5a640 1 -- 172.21.15.29:0/2233102135 shutdown_connections 2024-09-13T18:45:26.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.741+0000 7fe679e5a640 1 -- 172.21.15.29:0/2233102135 wait complete. 2024-09-13T18:45:26.756 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.854+0000 7f2e5ad45640 1 Processor -- start 2024-09-13T18:45:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.854+0000 7f2e5ad45640 1 -- start start 2024-09-13T18:45:26.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e5ad45640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e5413ff10 0x7f2e54151300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e5ad45640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5406a520 con 0x7f2e540b4ae0 2024-09-13T18:45:26.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e5ad45640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540715e0 con 0x7f2e5406a140 2024-09-13T18:45:26.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e5ad45640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54071370 con 0x7f2e5413ff10 2024-09-13T18:45:26.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e53fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2e540b4ae0 0x7f2e5413f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42830/0 (socket says 172.21.15.29:42830) 2024-09-13T18:45:26.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e53fff640 1 -- 172.21.15.29:0/3942523482 learned_addr learned my addr 172.21.15.29:0/3942523482 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:26.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e592e2640 1 --2- 172.21.15.29:0/3942523482 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e5413ff10 0x7f2e54151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e537fe640 1 -- 172.21.15.29:0/3942523482 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311764048 0 0) 0x7f2e5406a520 con 0x7f2e540b4ae0 2024-09-13T18:45:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e537fe640 1 -- 172.21.15.29:0/3942523482 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e44003520 con 0x7f2e540b4ae0 2024-09-13T18:45:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e537fe640 1 -- 172.21.15.29:0/3942523482 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393121318 0 0) 0x7f2e540715e0 con 0x7f2e5406a140 2024-09-13T18:45:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e537fe640 1 -- 172.21.15.29:0/3942523482 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e5406a520 con 0x7f2e5406a140 2024-09-13T18:45:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e592e2640 1 -- 172.21.15.29:0/3942523482 >> v1:172.21.15.96:6789/0 conn(0x7f2e5406a140 legacy=0x7f2e540b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e592e2640 1 -- 172.21.15.29:0/3942523482 >> v1:172.21.15.29:6789/0 conn(0x7f2e540b4ae0 legacy=0x7f2e5413f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.855+0000 7f2e592e2640 1 -- 172.21.15.29:0/3942523482 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54071e70 con 0x7f2e5413ff10 2024-09-13T18:45:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.856+0000 7f2e592e2640 1 --2- 172.21.15.29:0/3942523482 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e5413ff10 0x7f2e54151300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009dc0 tx=0x7f2e4c02a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d073ccab83385262 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.856+0000 7f2e537fe640 1 -- 172.21.15.29:0/3942523482 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c007740 con 0x7f2e5413ff10 2024-09-13T18:45:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.856+0000 7f2e537fe640 1 -- 172.21.15.29:0/3942523482 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c02d050 con 0x7f2e5413ff10 2024-09-13T18:45:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.856+0000 7f2e537fe640 1 -- 172.21.15.29:0/3942523482 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c007ac0 con 0x7f2e5413ff10 2024-09-13T18:45:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.857+0000 7f2e5ad45640 1 -- 172.21.15.29:0/3942523482 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e5413ff10 msgr2=0x7f2e54151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.857+0000 7f2e5ad45640 1 --2- 172.21.15.29:0/3942523482 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e5413ff10 0x7f2e54151300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009dc0 tx=0x7f2e4c02a5b0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.857+0000 7f2e5ad45640 1 -- 172.21.15.29:0/3942523482 shutdown_connections 2024-09-13T18:45:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.857+0000 7f2e5ad45640 1 --2- 172.21.15.29:0/3942523482 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e5413ff10 0x7f2e54151300 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.857+0000 7f2e5ad45640 1 -- 172.21.15.29:0/3942523482 >> 172.21.15.29:0/3942523482 conn(0x7f2e540b8440 msgr2=0x7f2e540b8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.857+0000 7f2e5ad45640 1 -- 172.21.15.29:0/3942523482 shutdown_connections 2024-09-13T18:45:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.857+0000 7f2e5ad45640 1 -- 172.21.15.29:0/3942523482 wait complete. 2024-09-13T18:45:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.858+0000 7f2e5ad45640 1 Processor -- start 2024-09-13T18:45:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.858+0000 7f2e5ad45640 1 -- start start 2024-09-13T18:45:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e5ad45640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e5406a140 0x7f2e540ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e5ad45640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e540b4ae0 0x7f2e54146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e5ad45640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e5413ff10 0x7f2e541dae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e5ad45640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540ae6a0 con 0x7f2e5406a140 2024-09-13T18:45:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e5ad45640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540addb0 con 0x7f2e5413ff10 2024-09-13T18:45:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e5ad45640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54145a10 con 0x7f2e540b4ae0 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e58ae1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e5406a140 0x7f2e540ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e58ae1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e5406a140 0x7f2e540ad1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42900/0 (socket says 172.21.15.29:42900) 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e58ae1640 1 -- 172.21.15.29:0/1168262136 learned_addr learned my addr 172.21.15.29:0/1168262136 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e53fff640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e540b4ae0 0x7f2e54146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e592e2640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e5413ff10 0x7f2e541dae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e58ae1640 1 -- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e540b4ae0 msgr2=0x7f2e54146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e58ae1640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e540b4ae0 0x7f2e54146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e58ae1640 1 -- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e5413ff10 msgr2=0x7f2e541dae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e58ae1640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e5413ff10 0x7f2e541dae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e58ae1640 1 -- 172.21.15.29:0/1168262136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c009a70 con 0x7f2e5406a140 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e53fff640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e540b4ae0 0x7f2e54146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e592e2640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e5413ff10 0x7f2e541dae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e58ae1640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e5406a140 0x7f2e540ad1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800c490 tx=0x7f2e4800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e517fa640 1 -- 172.21.15.29:0/1168262136 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e480052d0 con 0x7f2e5406a140 2024-09-13T18:45:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e517fa640 1 -- 172.21.15.29:0/1168262136 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e48005430 con 0x7f2e5406a140 2024-09-13T18:45:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e517fa640 1 -- 172.21.15.29:0/1168262136 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e48012870 con 0x7f2e5406a140 2024-09-13T18:45:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e5ad45640 1 -- 172.21.15.29:0/1168262136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e540ae050 con 0x7f2e5406a140 2024-09-13T18:45:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.859+0000 7f2e5ad45640 1 -- 172.21.15.29:0/1168262136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e54145670 con 0x7f2e5406a140 2024-09-13T18:45:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.860+0000 7f2e5ad45640 1 -- 172.21.15.29:0/1168262136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e540715e0 con 0x7f2e5406a140 2024-09-13T18:45:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.861+0000 7f2e517fa640 1 -- 172.21.15.29:0/1168262136 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2e480129d0 con 0x7f2e5406a140 2024-09-13T18:45:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.861+0000 7f2e517fa640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2e3806ac30 0x7f2e3806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.861+0000 7f2e517fa640 1 -- 172.21.15.29:0/1168262136 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e48089150 con 0x7f2e5406a140 2024-09-13T18:45:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.861+0000 7f2e53fff640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2e3806ac30 0x7f2e3806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.862+0000 7f2e53fff640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2e3806ac30 0x7f2e3806d0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2e540b22c0 tx=0x7f2e40009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:26.866+0000 7f2e517fa640 1 -- 172.21.15.29:0/1168262136 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2e480540d0 con 0x7f2e5406a140 2024-09-13T18:45:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.037+0000 7f2e5ad45640 1 -- 172.21.15.29:0/1168262136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e54073530 con 0x7f2e5406a140 2024-09-13T18:45:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.039+0000 7f2e517fa640 1 -- 172.21.15.29:0/1168262136 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7f2e480576f0 con 0x7f2e5406a140 2024-09-13T18:45:27.043 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:27.043 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.041+0000 7f2e5ad45640 1 -- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2e3806ac30 msgr2=0x7f2e3806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.041+0000 7f2e5ad45640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2e3806ac30 0x7f2e3806d0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2e540b22c0 tx=0x7f2e40009040 comp rx=0 tx=0).stop 2024-09-13T18:45:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.041+0000 7f2e5ad45640 1 -- 172.21.15.29:0/1168262136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e5406a140 msgr2=0x7f2e540ad1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.041+0000 7f2e5ad45640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e5406a140 0x7f2e540ad1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800c490 tx=0x7f2e4800c950 comp rx=0 tx=0).stop 2024-09-13T18:45:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.041+0000 7f2e5ad45640 1 -- 172.21.15.29:0/1168262136 shutdown_connections 2024-09-13T18:45:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.041+0000 7f2e5ad45640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2e3806ac30 0x7f2e3806d0f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.041+0000 7f2e5ad45640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e5413ff10 0x7f2e541dae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.041+0000 7f2e5ad45640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e540b4ae0 0x7f2e54146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.041+0000 7f2e5ad45640 1 --2- 172.21.15.29:0/1168262136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e5406a140 0x7f2e540ad1c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.041+0000 7f2e5ad45640 1 -- 172.21.15.29:0/1168262136 >> 172.21.15.29:0/1168262136 conn(0x7f2e540b8440 msgr2=0x7f2e5413f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.041+0000 7f2e5ad45640 1 -- 172.21.15.29:0/1168262136 shutdown_connections 2024-09-13T18:45:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.041+0000 7f2e5ad45640 1 -- 172.21.15.29:0/1168262136 wait complete. 2024-09-13T18:45:27.056 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:27.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.154+0000 7f6644ded640 1 Processor -- start 2024-09-13T18:45:27.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.154+0000 7f6644ded640 1 -- start start 2024-09-13T18:45:27.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f6644ded640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f66400b4ae0 0x7f664013f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f6644ded640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6640070140 0x7f664013fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f6644ded640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6640140280 con 0x7f664006a140 2024-09-13T18:45:27.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f6644ded640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6640071370 con 0x7f66400b4ae0 2024-09-13T18:45:27.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f6644ded640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664006a520 con 0x7f6640070140 2024-09-13T18:45:27.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f663e59c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f664006a140 0x7f66400b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42842/0 (socket says 172.21.15.29:42842) 2024-09-13T18:45:27.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f663e59c640 1 -- 172.21.15.29:0/330768502 learned_addr learned my addr 172.21.15.29:0/330768502 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:27.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168228236 0 0) 0x7f6640140280 con 0x7f664006a140 2024-09-13T18:45:27.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f663dd9b640 1 --2- 172.21.15.29:0/330768502 >> v2:172.21.15.96:3300/0 conn(0x7f66400b4ae0 0x7f664013f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f663ed9d640 1 --2- 172.21.15.29:0/330768502 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6640070140 0x7f664013fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6628003520 con 0x7f664006a140 2024-09-13T18:45:27.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1183128689 0 0) 0x7f6628003520 con 0x7f664006a140 2024-09-13T18:45:27.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6640070140 msgr2=0x7f664013fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:27.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.155+0000 7f663d59a640 1 --2- 172.21.15.29:0/330768502 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6640070140 0x7f664013fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 >> v2:172.21.15.96:3300/0 conn(0x7f66400b4ae0 msgr2=0x7f664013f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:27.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663d59a640 1 --2- 172.21.15.29:0/330768502 >> v2:172.21.15.96:3300/0 conn(0x7f66400b4ae0 0x7f664013f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66400715e0 con 0x7f664006a140 2024-09-13T18:45:27.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f6630001670 con 0x7f664006a140 2024-09-13T18:45:27.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 >> v1:172.21.15.29:6789/0 conn(0x7f664006a140 legacy=0x7f66400b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663d59a640 1 --2- 172.21.15.29:0/330768502 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6640070140 0x7f6628003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663d59a640 1 --2- 172.21.15.29:0/330768502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6628003ef0 0x7f66280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663d59a640 1 --2- 172.21.15.29:0/330768502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6628004d00 0x7f6628005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664006a520 con 0x7f6628003ef0 2024-09-13T18:45:27.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662800b9e0 con 0x7f6628004d00 2024-09-13T18:45:27.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662800bba0 con 0x7f6640070140 2024-09-13T18:45:27.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663dd9b640 1 --2- 172.21.15.29:0/330768502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6628003ef0 0x7f66280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663e59c640 1 --2- 172.21.15.29:0/330768502 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6640070140 0x7f6628003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663ed9d640 1 --2- 172.21.15.29:0/330768502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6628004d00 0x7f6628005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663dd9b640 1 -- 172.21.15.29:0/330768502 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6640070140 msgr2=0x7f6628003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:27.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663dd9b640 1 --2- 172.21.15.29:0/330768502 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6640070140 0x7f6628003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663dd9b640 1 -- 172.21.15.29:0/330768502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6628004d00 msgr2=0x7f6628005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:27.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663dd9b640 1 --2- 172.21.15.29:0/330768502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6628004d00 0x7f6628005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.156+0000 7f663dd9b640 1 -- 172.21.15.29:0/330768502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6628003520 con 0x7f6628003ef0 2024-09-13T18:45:27.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.157+0000 7f663dd9b640 1 --2- 172.21.15.29:0/330768502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6628003ef0 0x7f66280047c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6634009ac0 tx=0x7f66280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bb3b0fab589c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.157+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634031400 con 0x7f6628003ef0 2024-09-13T18:45:27.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.157+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663402d050 con 0x7f6628003ef0 2024-09-13T18:45:27.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.157+0000 7f663d59a640 1 -- 172.21.15.29:0/330768502 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634031780 con 0x7f6628003ef0 2024-09-13T18:45:27.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.157+0000 7f6644ded640 1 -- 172.21.15.29:0/330768502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6628003ef0 msgr2=0x7f66280047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.157+0000 7f6644ded640 1 --2- 172.21.15.29:0/330768502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6628003ef0 0x7f66280047c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6634009ac0 tx=0x7f66280057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.157+0000 7f663ed9d640 1 -- 172.21.15.29:0/330768502 reap_dead start 2024-09-13T18:45:27.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.158+0000 7f6644ded640 1 -- 172.21.15.29:0/330768502 shutdown_connections 2024-09-13T18:45:27.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.158+0000 7f6644ded640 1 -- 172.21.15.29:0/330768502 >> 172.21.15.29:0/330768502 conn(0x7f66400b8440 msgr2=0x7f66400b8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:27.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.158+0000 7f6644ded640 1 -- 172.21.15.29:0/330768502 shutdown_connections 2024-09-13T18:45:27.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.158+0000 7f6644ded640 1 -- 172.21.15.29:0/330768502 wait complete. 2024-09-13T18:45:27.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.159+0000 7f6644ded640 1 Processor -- start 2024-09-13T18:45:27.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.159+0000 7f6644ded640 1 -- start start 2024-09-13T18:45:27.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.159+0000 7f6644ded640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6628003ef0 0x7f66400ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.159+0000 7f6644ded640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66400ad740 0x7f66401db420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.159+0000 7f6644ded640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66401db960 0x7f66401de440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.159+0000 7f6644ded640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6640146540 con 0x7f66401db960 2024-09-13T18:45:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.159+0000 7f6644ded640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66401dafd0 con 0x7f66400ad740 2024-09-13T18:45:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.159+0000 7f6644ded640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66401dbe10 con 0x7f6628003ef0 2024-09-13T18:45:27.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f663ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66401db960 0x7f66401de440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f663ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66401db960 0x7f66401de440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42932/0 (socket says 172.21.15.29:42932) 2024-09-13T18:45:27.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f663ed9d640 1 -- 172.21.15.29:0/2178553128 learned_addr learned my addr 172.21.15.29:0/2178553128 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:27.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f663e59c640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6628003ef0 0x7f66400ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f663dd9b640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66400ad740 0x7f66401db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f663ed9d640 1 -- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6628003ef0 msgr2=0x7f66400ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f663ed9d640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6628003ef0 0x7f66400ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f663ed9d640 1 -- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66400ad740 msgr2=0x7f66401db420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f663ed9d640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66400ad740 0x7f66401db420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f663ed9d640 1 -- 172.21.15.29:0/2178553128 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66400adc20 con 0x7f66401db960 2024-09-13T18:45:27.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f663ed9d640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66401db960 0x7f66401de440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f664006ade0 tx=0x7f663800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f662effd640 1 -- 172.21.15.29:0/2178553128 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800e040 con 0x7f66401db960 2024-09-13T18:45:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f662effd640 1 -- 172.21.15.29:0/2178553128 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663800f040 con 0x7f66401db960 2024-09-13T18:45:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f6644ded640 1 -- 172.21.15.29:0/2178553128 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66400adf00 con 0x7f66401db960 2024-09-13T18:45:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f662effd640 1 -- 172.21.15.29:0/2178553128 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638015430 con 0x7f66401db960 2024-09-13T18:45:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.160+0000 7f6644ded640 1 -- 172.21.15.29:0/2178553128 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6640146a30 con 0x7f66401db960 2024-09-13T18:45:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.161+0000 7f6644ded640 1 -- 172.21.15.29:0/2178553128 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66401db140 con 0x7f66401db960 2024-09-13T18:45:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.162+0000 7f662effd640 1 -- 172.21.15.29:0/2178553128 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6638015590 con 0x7f66401db960 2024-09-13T18:45:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.162+0000 7f662effd640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f662006ac00 0x7f662006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.162+0000 7f662effd640 1 -- 172.21.15.29:0/2178553128 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6638089df0 con 0x7f66401db960 2024-09-13T18:45:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.162+0000 7f663e59c640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f662006ac00 0x7f662006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.163+0000 7f663e59c640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f662006ac00 0x7f662006d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6640143810 tx=0x7f66300078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.166+0000 7f662effd640 1 -- 172.21.15.29:0/2178553128 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6638054e20 con 0x7f66401db960 2024-09-13T18:45:27.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.339+0000 7f6644ded640 1 -- 172.21.15.29:0/2178553128 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66400b43d0 con 0x7f66401db960 2024-09-13T18:45:27.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.341+0000 7f662effd640 1 -- 172.21.15.29:0/2178553128 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7f6638058440 con 0x7f66401db960 2024-09-13T18:45:27.344 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:27.344 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.342+0000 7f6644ded640 1 -- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f662006ac00 msgr2=0x7f662006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.342+0000 7f6644ded640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f662006ac00 0x7f662006d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6640143810 tx=0x7f66300078f0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.342+0000 7f6644ded640 1 -- 172.21.15.29:0/2178553128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66401db960 msgr2=0x7f66401de440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.342+0000 7f6644ded640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66401db960 0x7f66401de440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f664006ade0 tx=0x7f663800f580 comp rx=0 tx=0).stop 2024-09-13T18:45:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.342+0000 7f6644ded640 1 -- 172.21.15.29:0/2178553128 shutdown_connections 2024-09-13T18:45:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.342+0000 7f6644ded640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f662006ac00 0x7f662006d0c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.342+0000 7f6644ded640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66401db960 0x7f66401de440 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.342+0000 7f6644ded640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66400ad740 0x7f66401db420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.342+0000 7f6644ded640 1 --2- 172.21.15.29:0/2178553128 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6628003ef0 0x7f66400ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.342+0000 7f6644ded640 1 -- 172.21.15.29:0/2178553128 >> 172.21.15.29:0/2178553128 conn(0x7f66400b8440 msgr2=0x7f66400b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.343+0000 7f6644ded640 1 -- 172.21.15.29:0/2178553128 shutdown_connections 2024-09-13T18:45:27.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.343+0000 7f6644ded640 1 -- 172.21.15.29:0/2178553128 wait complete. 2024-09-13T18:45:27.374 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:27.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.471+0000 7faa17c80640 1 Processor -- start 2024-09-13T18:45:27.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.471+0000 7faa17c80640 1 -- start start 2024-09-13T18:45:27.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa17c80640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa1006b150 0x7faa100712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa17c80640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faa1013fe10 0x7faa10150270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa17c80640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa10070b30 con 0x7faa100717e0 2024-09-13T18:45:27.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa17c80640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa100b4160 con 0x7faa1006b150 2024-09-13T18:45:27.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa17c80640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1006f780 con 0x7faa1013fe10 2024-09-13T18:45:27.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa15a1c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa1006b150 0x7faa100712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa15a1c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa1006b150 0x7faa100712a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42940/0 (socket says 172.21.15.29:42940) 2024-09-13T18:45:27.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa15a1c640 1 -- 172.21.15.29:0/76344011 learned_addr learned my addr 172.21.15.29:0/76344011 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa1621d640 1 --2- 172.21.15.29:0/76344011 >> v2:172.21.15.96:3300/0 conn(0x7faa1013fe10 0x7faa10150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa15a1c640 1 -- 172.21.15.29:0/76344011 >> v2:172.21.15.96:3300/0 conn(0x7faa1013fe10 msgr2=0x7faa10150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa15a1c640 1 --2- 172.21.15.29:0/76344011 >> v2:172.21.15.96:3300/0 conn(0x7faa1013fe10 0x7faa10150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa15a1c640 1 -- 172.21.15.29:0/76344011 >> v1:172.21.15.96:6789/0 conn(0x7faa100717e0 legacy=0x7faa1013f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa15a1c640 1 -- 172.21.15.29:0/76344011 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa100b4440 con 0x7faa1006b150 2024-09-13T18:45:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.472+0000 7faa1621d640 1 --2- 172.21.15.29:0/76344011 >> v2:172.21.15.96:3300/0 conn(0x7faa1013fe10 0x7faa10150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.473+0000 7faa15a1c640 1 --2- 172.21.15.29:0/76344011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa1006b150 0x7faa100712a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009870 tx=0x7faa0c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aea84314971f542 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.473+0000 7faa14a1a640 1 -- 172.21.15.29:0/76344011 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c02ae40 con 0x7faa1006b150 2024-09-13T18:45:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.473+0000 7faa14a1a640 1 -- 172.21.15.29:0/76344011 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c032440 con 0x7faa1006b150 2024-09-13T18:45:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.473+0000 7faa14a1a640 1 -- 172.21.15.29:0/76344011 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0327d0 con 0x7faa1006b150 2024-09-13T18:45:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.474+0000 7faa17c80640 1 -- 172.21.15.29:0/76344011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa1006b150 msgr2=0x7faa100712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.474+0000 7faa17c80640 1 --2- 172.21.15.29:0/76344011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa1006b150 0x7faa100712a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009870 tx=0x7faa0c02a130 comp rx=0 tx=0).stop 2024-09-13T18:45:27.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.474+0000 7faa17c80640 1 -- 172.21.15.29:0/76344011 shutdown_connections 2024-09-13T18:45:27.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.474+0000 7faa17c80640 1 --2- 172.21.15.29:0/76344011 >> v2:172.21.15.96:3300/0 conn(0x7faa1013fe10 0x7faa10150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.474+0000 7faa17c80640 1 --2- 172.21.15.29:0/76344011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa1006b150 0x7faa100712a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.474+0000 7faa17c80640 1 -- 172.21.15.29:0/76344011 >> 172.21.15.29:0/76344011 conn(0x7faa100b4780 msgr2=0x7faa100b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:27.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.474+0000 7faa17c80640 1 -- 172.21.15.29:0/76344011 shutdown_connections 2024-09-13T18:45:27.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.474+0000 7faa17c80640 1 -- 172.21.15.29:0/76344011 wait complete. 2024-09-13T18:45:27.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.475+0000 7faa17c80640 1 Processor -- start 2024-09-13T18:45:27.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.475+0000 7faa17c80640 1 -- start start 2024-09-13T18:45:27.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa17c80640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa1006b150 0x7faa1013b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa17c80640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faa100717e0 0x7faa101dc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa17c80640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa1013fe10 0x7faa101df410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa17c80640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa101dbad0 con 0x7faa1013fe10 2024-09-13T18:45:27.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa17c80640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa101dbd70 con 0x7faa1006b150 2024-09-13T18:45:27.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa17c80640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa101dfdc0 con 0x7faa100717e0 2024-09-13T18:45:27.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa1621d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa1013fe10 0x7faa101df410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa1621d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa1013fe10 0x7faa101df410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42944/0 (socket says 172.21.15.29:42944) 2024-09-13T18:45:27.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa1621d640 1 -- 172.21.15.29:0/587789552 learned_addr learned my addr 172.21.15.29:0/587789552 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:27.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa15a1c640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa1006b150 0x7faa1013b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa1521b640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faa100717e0 0x7faa101dc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa1621d640 1 -- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faa100717e0 msgr2=0x7faa101dc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa1621d640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faa100717e0 0x7faa101dc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa1621d640 1 -- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa1006b150 msgr2=0x7faa1013b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa1621d640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa1006b150 0x7faa1013b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa1621d640 1 -- 172.21.15.29:0/587789552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0094d0 con 0x7faa1013fe10 2024-09-13T18:45:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa15a1c640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa1006b150 0x7faa1013b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.476+0000 7faa1621d640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa1013fe10 0x7faa101df410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faa0800cd80 tx=0x7faa0800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.477+0000 7faa067fc640 1 -- 172.21.15.29:0/587789552 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0800f680 con 0x7faa1013fe10 2024-09-13T18:45:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.477+0000 7faa067fc640 1 -- 172.21.15.29:0/587789552 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0800f800 con 0x7faa1013fe10 2024-09-13T18:45:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.477+0000 7faa17c80640 1 -- 172.21.15.29:0/587789552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1006fe20 con 0x7faa1013fe10 2024-09-13T18:45:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.477+0000 7faa067fc640 1 -- 172.21.15.29:0/587789552 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0800fbb0 con 0x7faa1013fe10 2024-09-13T18:45:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.477+0000 7faa17c80640 1 -- 172.21.15.29:0/587789552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa100afc60 con 0x7faa1013fe10 2024-09-13T18:45:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.478+0000 7faa17c80640 1 -- 172.21.15.29:0/587789552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa10067300 con 0x7faa1013fe10 2024-09-13T18:45:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.478+0000 7faa067fc640 1 -- 172.21.15.29:0/587789552 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faa0800b040 con 0x7faa1013fe10 2024-09-13T18:45:27.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.479+0000 7faa067fc640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa9f406ac00 0x7fa9f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.479+0000 7faa067fc640 1 -- 172.21.15.29:0/587789552 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa08089ea0 con 0x7faa1013fe10 2024-09-13T18:45:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.479+0000 7faa15a1c640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa9f406ac00 0x7fa9f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.479+0000 7faa15a1c640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa9f406ac00 0x7fa9f406d0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa0c034000 tx=0x7faa0c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.483+0000 7faa067fc640 1 -- 172.21.15.29:0/587789552 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faa08054e40 con 0x7faa1013fe10 2024-09-13T18:45:27.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.692+0000 7faa17c80640 1 -- 172.21.15.29:0/587789552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa10143530 con 0x7faa1013fe10 2024-09-13T18:45:27.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.693+0000 7faa067fc640 1 -- 172.21.15.29:0/587789552 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3215 (secure 0 0 0) 0x7faa0801d020 con 0x7faa1013fe10 2024-09-13T18:45:27.697 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:27.697 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/3867151553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3867151553},{"type":"v1","addr":"172.21.15.96:6835","nonce":3867151553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:22.006847+0000","modified":"2024-09-13T18:45:26.405396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6833/175129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":175129703},{"type":"v1","addr":"172.21.15.29:6833","nonce":175129703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:45:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2024-09-13T18:45:27.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.695+0000 7faa17c80640 1 -- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa9f406ac00 msgr2=0x7fa9f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.695+0000 7faa17c80640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa9f406ac00 0x7fa9f406d0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa0c034000 tx=0x7faa0c02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:27.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.695+0000 7faa17c80640 1 -- 172.21.15.29:0/587789552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa1013fe10 msgr2=0x7faa101df410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.695+0000 7faa17c80640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa1013fe10 0x7faa101df410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faa0800cd80 tx=0x7faa0800a650 comp rx=0 tx=0).stop 2024-09-13T18:45:27.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.695+0000 7faa17c80640 1 -- 172.21.15.29:0/587789552 shutdown_connections 2024-09-13T18:45:27.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.695+0000 7faa17c80640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa9f406ac00 0x7fa9f406d0c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.695+0000 7faa17c80640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa1013fe10 0x7faa101df410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.695+0000 7faa17c80640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faa100717e0 0x7faa101dc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.695+0000 7faa17c80640 1 --2- 172.21.15.29:0/587789552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa1006b150 0x7faa1013b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.695+0000 7faa17c80640 1 -- 172.21.15.29:0/587789552 >> 172.21.15.29:0/587789552 conn(0x7faa100b4780 msgr2=0x7faa10143860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:27.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.695+0000 7faa17c80640 1 -- 172.21.15.29:0/587789552 shutdown_connections 2024-09-13T18:45:27.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.695+0000 7faa17c80640 1 -- 172.21.15.29:0/587789552 wait complete. 2024-09-13T18:45:27.709 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:27.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.807+0000 7f432c63a640 1 Processor -- start 2024-09-13T18:45:27.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.807+0000 7f432c63a640 1 -- start start 2024-09-13T18:45:27.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432c63a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f43240b1fc0 0x7f43240b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432c63a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4324146300 0x7f432413c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432c63a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432406f230 con 0x7f432413c550 2024-09-13T18:45:27.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432c63a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43240b23a0 con 0x7f43240b1fc0 2024-09-13T18:45:27.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432c63a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43240b0d70 con 0x7f4324146300 2024-09-13T18:45:27.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432a3d6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f43240b1fc0 0x7f43240b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432a3d6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f43240b1fc0 0x7f43240b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42952/0 (socket says 172.21.15.29:42952) 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432a3d6640 1 -- 172.21.15.29:0/2752300919 learned_addr learned my addr 172.21.15.29:0/2752300919 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432abd7640 1 --2- 172.21.15.29:0/2752300919 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4324146300 0x7f432413c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432a3d6640 1 -- 172.21.15.29:0/2752300919 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4324146300 msgr2=0x7f432413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432a3d6640 1 --2- 172.21.15.29:0/2752300919 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4324146300 0x7f432413c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432a3d6640 1 -- 172.21.15.29:0/2752300919 >> v1:172.21.15.96:6789/0 conn(0x7f432413c550 legacy=0x7f4324145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.808+0000 7f432a3d6640 1 -- 172.21.15.29:0/2752300919 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43240b1050 con 0x7f43240b1fc0 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.809+0000 7f432a3d6640 1 --2- 172.21.15.29:0/2752300919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43240b1fc0 0x7f43240b04a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f432000bb10 tx=0x7f432002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9e3963331b41b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.809+0000 7f43293d4640 1 -- 172.21.15.29:0/2752300919 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320032820 con 0x7f43240b1fc0 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.809+0000 7f43293d4640 1 -- 172.21.15.29:0/2752300919 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432002e040 con 0x7f43240b1fc0 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.809+0000 7f43293d4640 1 -- 172.21.15.29:0/2752300919 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320032ba0 con 0x7f43240b1fc0 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.809+0000 7f432c63a640 1 -- 172.21.15.29:0/2752300919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43240b1fc0 msgr2=0x7f43240b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.809+0000 7f432c63a640 1 --2- 172.21.15.29:0/2752300919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43240b1fc0 0x7f43240b04a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f432000bb10 tx=0x7f432002c920 comp rx=0 tx=0).stop 2024-09-13T18:45:27.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.809+0000 7f432c63a640 1 -- 172.21.15.29:0/2752300919 shutdown_connections 2024-09-13T18:45:27.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.809+0000 7f432c63a640 1 --2- 172.21.15.29:0/2752300919 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4324146300 0x7f432413c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.810+0000 7f432c63a640 1 --2- 172.21.15.29:0/2752300919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43240b1fc0 0x7f43240b04a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.810+0000 7f432c63a640 1 -- 172.21.15.29:0/2752300919 >> 172.21.15.29:0/2752300919 conn(0x7f432406a890 msgr2=0x7f43240b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:27.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.810+0000 7f432c63a640 1 -- 172.21.15.29:0/2752300919 shutdown_connections 2024-09-13T18:45:27.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.810+0000 7f432c63a640 1 -- 172.21.15.29:0/2752300919 wait complete. 2024-09-13T18:45:27.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.811+0000 7f432c63a640 1 Processor -- start 2024-09-13T18:45:27.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.811+0000 7f432c63a640 1 -- start start 2024-09-13T18:45:27.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.811+0000 7f432c63a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43240b1fc0 0x7f4324142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.811+0000 7f432c63a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f432413c550 0x7f432413d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.811+0000 7f432c63a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4324146300 0x7f432413d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.811+0000 7f432c63a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432413b1c0 con 0x7f432413c550 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.811+0000 7f432c63a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432413fb20 con 0x7f4324146300 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.811+0000 7f432c63a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4324140090 con 0x7f43240b1fc0 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.811+0000 7f4329bd5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f432413c550 0x7f432413d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.811+0000 7f4329bd5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f432413c550 0x7f432413d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42958/0 (socket says 172.21.15.29:42958) 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f4329bd5640 1 -- 172.21.15.29:0/884473529 learned_addr learned my addr 172.21.15.29:0/884473529 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f432a3d6640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43240b1fc0 0x7f4324142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f432abd7640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4324146300 0x7f432413d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f4329bd5640 1 -- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43240b1fc0 msgr2=0x7f4324142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f4329bd5640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43240b1fc0 0x7f4324142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f4329bd5640 1 -- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4324146300 msgr2=0x7f432413d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f4329bd5640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4324146300 0x7f432413d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f4329bd5640 1 -- 172.21.15.29:0/884473529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432000b770 con 0x7f432413c550 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f4329bd5640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f432413c550 0x7f432413d2a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f431400c450 tx=0x7f431400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f431affd640 1 -- 172.21.15.29:0/884473529 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43140052d0 con 0x7f432413c550 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f431affd640 1 -- 172.21.15.29:0/884473529 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4314005430 con 0x7f432413c550 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f432c63a640 1 -- 172.21.15.29:0/884473529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432413ee70 con 0x7f432413c550 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f431affd640 1 -- 172.21.15.29:0/884473529 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314012870 con 0x7f432413c550 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.812+0000 7f432c63a640 1 -- 172.21.15.29:0/884473529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432413fd20 con 0x7f432413c550 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.813+0000 7f432c63a640 1 -- 172.21.15.29:0/884473529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43240b04a0 con 0x7f432413c550 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.814+0000 7f431affd640 1 -- 172.21.15.29:0/884473529 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f43140129d0 con 0x7f432413c550 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.814+0000 7f431affd640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f430806ac30 0x7f430806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.814+0000 7f431affd640 1 -- 172.21.15.29:0/884473529 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4314088f70 con 0x7f432413c550 2024-09-13T18:45:27.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.814+0000 7f432a3d6640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f430806ac30 0x7f430806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.815+0000 7f432a3d6640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f430806ac30 0x7f430806d0f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4320037000 tx=0x7f432003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.818+0000 7f431affd640 1 -- 172.21.15.29:0/884473529 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f43140bc9c0 con 0x7f432413c550 2024-09-13T18:45:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.989+0000 7f432c63a640 1 -- 172.21.15.29:0/884473529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f432406aee0 con 0x7f432413c550 2024-09-13T18:45:27.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.990+0000 7f431affd640 1 -- 172.21.15.29:0/884473529 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7f4314053fa0 con 0x7f432413c550 2024-09-13T18:45:27.994 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:27.994 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.992+0000 7f432c63a640 1 -- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f430806ac30 msgr2=0x7f430806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.992+0000 7f432c63a640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f430806ac30 0x7f430806d0f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4320037000 tx=0x7f432003d040 comp rx=0 tx=0).stop 2024-09-13T18:45:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.993+0000 7f432c63a640 1 -- 172.21.15.29:0/884473529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f432413c550 msgr2=0x7f432413d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.993+0000 7f432c63a640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f432413c550 0x7f432413d2a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f431400c450 tx=0x7f431400c910 comp rx=0 tx=0).stop 2024-09-13T18:45:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.993+0000 7f432c63a640 1 -- 172.21.15.29:0/884473529 shutdown_connections 2024-09-13T18:45:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.993+0000 7f432c63a640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f430806ac30 0x7f430806d0f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.993+0000 7f432c63a640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4324146300 0x7f432413d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.993+0000 7f432c63a640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f432413c550 0x7f432413d2a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.993+0000 7f432c63a640 1 --2- 172.21.15.29:0/884473529 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f43240b1fc0 0x7f4324142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.993+0000 7f432c63a640 1 -- 172.21.15.29:0/884473529 >> 172.21.15.29:0/884473529 conn(0x7f432406a890 msgr2=0x7f4324070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.993+0000 7f432c63a640 1 -- 172.21.15.29:0/884473529 shutdown_connections 2024-09-13T18:45:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:27.993+0000 7f432c63a640 1 -- 172.21.15.29:0/884473529 wait complete. 2024-09-13T18:45:28.213 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:45:22.006847+0000', 'modified': '2024-09-13T18:45:26.405396+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4239}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4239': {'gid': 4239, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6833/175129703', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6832', 'nonce': 175129703}, {'type': 'v1', 'addr': '172.21.15.29:6833', 'nonce': 175129703}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T18:45:28.213 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:45:28.213 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:45:28.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.313+0000 7f9eee88e640 1 Processor -- start 2024-09-13T18:45:28.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.313+0000 7f9eee88e640 1 -- start start 2024-09-13T18:45:28.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9eee88e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ee80b4490 0x7f9ee806c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9eee88e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9ee806cc50 0x7f9ee8142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9eee88e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee806c2f0 con 0x7f9ee8143000 2024-09-13T18:45:28.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9eee88e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee80ba420 con 0x7f9ee80b4490 2024-09-13T18:45:28.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9eee88e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee80b4870 con 0x7f9ee806cc50 2024-09-13T18:45:28.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9ee7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ee80b4490 0x7f9ee806c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9ee7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ee80b4490 0x7f9ee806c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42964/0 (socket says 172.21.15.29:42964) 2024-09-13T18:45:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9ee7fff640 1 -- 172.21.15.29:0/4203697243 learned_addr learned my addr 172.21.15.29:0/4203697243 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9ee77fe640 1 --2- 172.21.15.29:0/4203697243 >> v2:172.21.15.96:3300/0 conn(0x7f9ee806cc50 0x7f9ee8142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9ee7fff640 1 -- 172.21.15.29:0/4203697243 >> v2:172.21.15.96:3300/0 conn(0x7f9ee806cc50 msgr2=0x7f9ee8142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/4203697243 >> v2:172.21.15.96:3300/0 conn(0x7f9ee806cc50 0x7f9ee8142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9ee7fff640 1 -- 172.21.15.29:0/4203697243 >> v1:172.21.15.96:6789/0 conn(0x7f9ee8143000 legacy=0x7f9ee8070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.314+0000 7f9ee7fff640 1 -- 172.21.15.29:0/4203697243 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee80b5c90 con 0x7f9ee80b4490 2024-09-13T18:45:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.315+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/4203697243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee80b4490 0x7f9ee806c710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80726b0 tx=0x7f9ed802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e07ce0e8cea6e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.315+0000 7f9ee6ffd640 1 -- 172.21.15.29:0/4203697243 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8032440 con 0x7f9ee80b4490 2024-09-13T18:45:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.315+0000 7f9ee6ffd640 1 -- 172.21.15.29:0/4203697243 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed80325a0 con 0x7f9ee80b4490 2024-09-13T18:45:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.315+0000 7f9ee6ffd640 1 -- 172.21.15.29:0/4203697243 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8032930 con 0x7f9ee80b4490 2024-09-13T18:45:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.316+0000 7f9eee88e640 1 -- 172.21.15.29:0/4203697243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee80b4490 msgr2=0x7f9ee806c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.316+0000 7f9eee88e640 1 --2- 172.21.15.29:0/4203697243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee80b4490 0x7f9ee806c710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80726b0 tx=0x7f9ed802a1e0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.316+0000 7f9eee88e640 1 -- 172.21.15.29:0/4203697243 shutdown_connections 2024-09-13T18:45:28.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.316+0000 7f9eee88e640 1 --2- 172.21.15.29:0/4203697243 >> v2:172.21.15.96:3300/0 conn(0x7f9ee806cc50 0x7f9ee8142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.316+0000 7f9eee88e640 1 --2- 172.21.15.29:0/4203697243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee80b4490 0x7f9ee806c710 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.316+0000 7f9eee88e640 1 -- 172.21.15.29:0/4203697243 >> 172.21.15.29:0/4203697243 conn(0x7f9ee806a5b0 msgr2=0x7f9ee80b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:28.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.316+0000 7f9eee88e640 1 -- 172.21.15.29:0/4203697243 shutdown_connections 2024-09-13T18:45:28.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.316+0000 7f9eee88e640 1 -- 172.21.15.29:0/4203697243 wait complete. 2024-09-13T18:45:28.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.317+0000 7f9eee88e640 1 Processor -- start 2024-09-13T18:45:28.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.317+0000 7f9eee88e640 1 -- start start 2024-09-13T18:45:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.317+0000 7f9eee88e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee806cc50 0x7f9ee81deb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9eee88e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee80b4490 0x7f9ee81df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9eee88e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ee8143000 0x7f9ee813e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9eee88e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81ccb80 con 0x7f9ee806cc50 2024-09-13T18:45:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9eee88e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81cbe50 con 0x7f9ee80b4490 2024-09-13T18:45:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9eee88e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81df7e0 con 0x7f9ee8143000 2024-09-13T18:45:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee806cc50 0x7f9ee81deb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee806cc50 0x7f9ee81deb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42966/0 (socket says 172.21.15.29:42966) 2024-09-13T18:45:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee7fff640 1 -- 172.21.15.29:0/897971655 learned_addr learned my addr 172.21.15.29:0/897971655 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee77fe640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee80b4490 0x7f9ee81df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9eece2b640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ee8143000 0x7f9ee813e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee7fff640 1 -- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ee8143000 msgr2=0x7f9ee813e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ee8143000 0x7f9ee813e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee7fff640 1 -- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee80b4490 msgr2=0x7f9ee81df2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee80b4490 0x7f9ee81df2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee7fff640 1 -- 172.21.15.29:0/897971655 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80094d0 con 0x7f9ee806cc50 2024-09-13T18:45:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee806cc50 0x7f9ee81deb00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ed802a220 tx=0x7f9ed80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee4ff9640 1 -- 172.21.15.29:0/897971655 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8032440 con 0x7f9ee806cc50 2024-09-13T18:45:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee4ff9640 1 -- 172.21.15.29:0/897971655 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8030ba0 con 0x7f9ee806cc50 2024-09-13T18:45:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9eee88e640 1 -- 172.21.15.29:0/897971655 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee81cbb50 con 0x7f9ee806cc50 2024-09-13T18:45:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.318+0000 7f9ee4ff9640 1 -- 172.21.15.29:0/897971655 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed803d440 con 0x7f9ee806cc50 2024-09-13T18:45:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.319+0000 7f9eee88e640 1 -- 172.21.15.29:0/897971655 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee80af8c0 con 0x7f9ee806cc50 2024-09-13T18:45:28.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.320+0000 7f9ee4ff9640 1 -- 172.21.15.29:0/897971655 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9ed8039040 con 0x7f9ee806cc50 2024-09-13T18:45:28.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.321+0000 7f9ee4ff9640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9ed406ac00 0x7f9ed406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.321+0000 7f9ee4ff9640 1 -- 172.21.15.29:0/897971655 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ed80aa040 con 0x7f9ee806cc50 2024-09-13T18:45:28.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.321+0000 7f9ee77fe640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9ed406ac00 0x7f9ed406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.321+0000 7f9ee77fe640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9ed406ac00 0x7f9ed406d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ee81d2e50 tx=0x7f9edc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.321+0000 7f9ef1688740 1 Processor -- start 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ef1688740 1 -- start start 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ef1688740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48cfc7f0 0x556d48d2e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ef1688740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48d386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ef1688740 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d38be0 0x556d48d39060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ef1688740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d48c5c7c0 con 0x556d48cfc7f0 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ef1688740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d48c6bb70 con 0x556d48d2eb60 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ef1688740 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d48c69300 con 0x556d48d38be0 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ee7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48cfc7f0 0x556d48d2e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ee7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48cfc7f0 0x556d48d2e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42968/0 (socket says 172.21.15.29:42968) 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ee7fff640 1 -- 172.21.15.29:0/1914040092 learned_addr learned my addr 172.21.15.29:0/1914040092 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ee77fe640 1 --2- 172.21.15.29:0/1914040092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48d386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9eece2b640 1 --2- 172.21.15.29:0/1914040092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d38be0 0x556d48d39060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ee7fff640 1 -- 172.21.15.29:0/1914040092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d38be0 msgr2=0x556d48d39060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/1914040092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d38be0 0x556d48d39060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ee7fff640 1 -- 172.21.15.29:0/1914040092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 msgr2=0x556d48d386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/1914040092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48d386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ee7fff640 1 -- 172.21.15.29:0/1914040092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d48bf14b0 con 0x556d48cfc7f0 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9ee77fe640 1 --2- 172.21.15.29:0/1914040092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48d386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.322+0000 7f9eece2b640 1 --2- 172.21.15.29:0/1914040092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d38be0 0x556d48d39060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/1914040092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48cfc7f0 0x556d48d2e620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80a8280 tx=0x7f9ed8078750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09c2ede39248ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ecdffb640 1 -- 172.21.15.29:0/1914040092 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80770d0 con 0x556d48cfc7f0 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ecdffb640 1 -- 172.21.15.29:0/1914040092 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8075440 con 0x556d48cfc7f0 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ecdffb640 1 -- 172.21.15.29:0/1914040092 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80791b0 con 0x556d48cfc7f0 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ef1688740 1 -- 172.21.15.29:0/1914040092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48cfc7f0 msgr2=0x556d48d2e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1914040092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48cfc7f0 0x556d48d2e620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80a8280 tx=0x7f9ed8078750 comp rx=0 tx=0).stop 2024-09-13T18:45:28.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ef1688740 1 -- 172.21.15.29:0/1914040092 shutdown_connections 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1914040092 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d38be0 0x556d48d39060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1914040092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48d386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1914040092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48cfc7f0 0x556d48d2e620 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ef1688740 1 -- 172.21.15.29:0/1914040092 >> 172.21.15.29:0/1914040092 conn(0x556d48cfe500 msgr2=0x556d48d00c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ef1688740 1 -- 172.21.15.29:0/1914040092 shutdown_connections 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.323+0000 7f9ef1688740 1 -- 172.21.15.29:0/1914040092 wait complete. 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.324+0000 7f9ef1688740 1 -- start start 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.324+0000 7f9ef1688740 1 Processor -- start 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ef1688740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48d337e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ef1688740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 0x556d48d36780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ef1688740 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d431f0 0x556d48d2b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ef1688740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d48c64bf0 con 0x556d48d38be0 2024-09-13T18:45:28.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ef1688740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d48c23250 con 0x556d48d2eb60 2024-09-13T18:45:28.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ef1688740 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d48c22ef0 con 0x556d48d431f0 2024-09-13T18:45:28.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ef1688740 10 client.0 _ll_register_callbacks cb 0x556d48c55740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:45:28.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ee77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 0x556d48d36780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ee77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 0x556d48d36780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42980/0 (socket says 172.21.15.29:42980) 2024-09-13T18:45:28.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ee77fe640 1 -- 172.21.15.29:0/2358393392 learned_addr learned my addr 172.21.15.29:0/2358393392 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:28.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48d337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9eece2b640 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d431f0 0x556d48d2b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ee77fe640 1 -- 172.21.15.29:0/2358393392 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d431f0 msgr2=0x556d48d2b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ee77fe640 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d431f0 0x556d48d2b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ee77fe640 1 -- 172.21.15.29:0/2358393392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 msgr2=0x556d48d337e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ee77fe640 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48d337e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ee77fe640 1 -- 172.21.15.29:0/2358393392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee80af8c0 con 0x556d48d38be0 2024-09-13T18:45:28.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9eece2b640 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d431f0 0x556d48d2b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:28.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ee77fe640 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 0x556d48d36780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9edc016830 tx=0x7f9edc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cc8956456abfa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ec6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-13T18:45:28.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ec6ffd640 1 -- 172.21.15.29:0/2358393392 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc026070 con 0x556d48d38be0 2024-09-13T18:45:28.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ec6ffd640 1 -- 172.21.15.29:0/2358393392 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9edc004020 con 0x556d48d38be0 2024-09-13T18:45:28.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.325+0000 7f9ef1688740 1 -- 172.21.15.29:0/2358393392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d489583c0 con 0x556d48d38be0 2024-09-13T18:45:28.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ec6ffd640 1 -- 172.21.15.29:0/2358393392 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9edc0041e0 con 0x556d48d38be0 2024-09-13T18:45:28.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ef1688740 10 client.4380 fetch_fsmap learned FSMap version 7 2024-09-13T18:45:28.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ef1688740 1 -- 172.21.15.29:0/2358393392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x556d48c63270 con 0x556d48d38be0 2024-09-13T18:45:28.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ec6ffd640 1 -- 172.21.15.29:0/2358393392 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556d489583c0 con 0x556d48d38be0 2024-09-13T18:45:28.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ec6ffd640 1 -- 172.21.15.29:0/2358393392 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 7) v1 ==== 2032+0+0 (secure 0 0 0) 0x7f9edc029020 con 0x556d48d38be0 2024-09-13T18:45:28.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ef1688740 10 client.4380 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T18:45:28.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ef1688740 10 client.4380 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:45:28.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ef1688740 20 client.4380 populate_metadata read hostname 'smithi029' 2024-09-13T18:45:28.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ef1688740 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x556d48d16ff0 0x556d48d173d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ef1688740 4 client.4380 mds_command: new command op to 4239 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:45:28.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ef1688740 1 -- 172.21.15.29:0/2358393392 --> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d489696c0 con 0x556d48d16ff0 2024-09-13T18:45:28.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x556d48d16ff0 0x556d48d173d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ec6ffd640 10 client.4380 ms_handle_connect on v2:172.21.15.29:6832/175129703 2024-09-13T18:45:28.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.326+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x556d48d16ff0 0x556d48d173d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14f1457b844c9f55 server_cookie=931d95d2aa3b6f7 in_seq=0 out_seq=0 2024-09-13T18:45:28.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ec6ffd640 1 -- 172.21.15.29:0/2358393392 <== mds.0 v2:172.21.15.29:6832/175129703 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x556d489696c0 con 0x556d48d16ff0 2024-09-13T18:45:28.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ec6ffd640 10 client.4380 handle_command_reply: tid=0 2024-09-13T18:45:28.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ef1688740 1 client.4380 shutdown 2024-09-13T18:45:28.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ef1688740 1 -- 172.21.15.29:0/2358393392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 msgr2=0x556d48d36780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ef1688740 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 0x556d48d36780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9edc016830 tx=0x7f9edc004730 comp rx=0 tx=0).stop 2024-09-13T18:45:28.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ef1688740 1 -- 172.21.15.29:0/2358393392 shutdown_connections 2024-09-13T18:45:28.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ef1688740 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d431f0 0x556d48d2b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ef1688740 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x556d48d16ff0 0x556d48d173d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ef1688740 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 0x556d48d36780 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ef1688740 1 --2- 172.21.15.29:0/2358393392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48d337e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ec6ffd640 0 client.4380 ms_handle_reset on v2:172.21.15.29:6832/175129703 2024-09-13T18:45:28.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ef1688740 1 -- 172.21.15.29:0/2358393392 >> 172.21.15.29:0/2358393392 conn(0x556d48cfc7f0 msgr2=0x556d48cfb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:28.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ef1688740 1 -- 172.21.15.29:0/2358393392 shutdown_connections 2024-09-13T18:45:28.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ef1688740 1 -- 172.21.15.29:0/2358393392 wait complete. 2024-09-13T18:45:28.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.327+0000 7f9ef1688740 20 client.4380 trim_cache size 0 max 16384 2024-09-13T18:45:28.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.342+0000 7f9ef1688740 1 Processor -- start 2024-09-13T18:45:28.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.342+0000 7f9ef1688740 1 -- start start 2024-09-13T18:45:28.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ef1688740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d2eb60 0x556d48d49660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ef1688740 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d38be0 0x556d48d009c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ef1688740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d431f0 0x556d48d00f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ef1688740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d48be8460 con 0x556d48d2eb60 2024-09-13T18:45:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ef1688740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d48cef1a0 con 0x556d48d431f0 2024-09-13T18:45:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ef1688740 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d48d49f80 con 0x556d48d38be0 2024-09-13T18:45:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ee7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d2eb60 0x556d48d49660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ee7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d2eb60 0x556d48d49660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42986/0 (socket says 172.21.15.29:42986) 2024-09-13T18:45:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ee7fff640 1 -- 172.21.15.29:0/1578641321 learned_addr learned my addr 172.21.15.29:0/1578641321 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ee7fff640 1 -- 172.21.15.29:0/1578641321 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d38be0 msgr2=0x556d48d009c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/1578641321 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d38be0 0x556d48d009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ee7fff640 1 -- 172.21.15.29:0/1578641321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d431f0 msgr2=0x556d48d00f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/1578641321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d431f0 0x556d48d00f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ee7fff640 1 -- 172.21.15.29:0/1578641321 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d48c055f0 con 0x556d48d2eb60 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/1578641321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d2eb60 0x556d48d49660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80a8360 tx=0x7f9ed8007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f7e0ff5fca2bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ece7fc640 1 -- 172.21.15.29:0/1578641321 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80770d0 con 0x556d48d2eb60 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ece7fc640 1 -- 172.21.15.29:0/1578641321 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8078220 con 0x556d48d2eb60 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.343+0000 7f9ece7fc640 1 -- 172.21.15.29:0/1578641321 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8078f90 con 0x556d48d2eb60 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.344+0000 7f9ef1688740 1 -- 172.21.15.29:0/1578641321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d2eb60 msgr2=0x556d48d49660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.344+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1578641321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d2eb60 0x556d48d49660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80a8360 tx=0x7f9ed8007000 comp rx=0 tx=0).stop 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.344+0000 7f9ef1688740 1 -- 172.21.15.29:0/1578641321 shutdown_connections 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.344+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1578641321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d431f0 0x556d48d00f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.344+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1578641321 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d38be0 0x556d48d009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.344+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1578641321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d2eb60 0x556d48d49660 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.344+0000 7f9ef1688740 1 -- 172.21.15.29:0/1578641321 >> 172.21.15.29:0/1578641321 conn(0x556d48cfc7f0 msgr2=0x556d48cfcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.344+0000 7f9ef1688740 1 -- 172.21.15.29:0/1578641321 shutdown_connections 2024-09-13T18:45:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.344+0000 7f9ef1688740 1 -- 172.21.15.29:0/1578641321 wait complete. 2024-09-13T18:45:28.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.344+0000 7f9ef1688740 1 -- start start 2024-09-13T18:45:28.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.345+0000 7f9ef1688740 1 Processor -- start 2024-09-13T18:45:28.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.345+0000 7f9ef1688740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48cfb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.345+0000 7f9ef1688740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 0x556d48d29500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.345+0000 7f9ef1688740 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d431f0 0x556d48d942a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.345+0000 7f9ef1688740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d48d29a40 con 0x556d48d38be0 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.345+0000 7f9ef1688740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d48d29e70 con 0x556d48d2eb60 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.345+0000 7f9ef1688740 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d48d2fa10 con 0x556d48d431f0 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.345+0000 7f9ef1688740 10 client.0 _ll_register_callbacks cb 0x7f9ed8006cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.345+0000 7f9ee77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 0x556d48d29500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.345+0000 7f9ee77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 0x556d48d29500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42998/0 (socket says 172.21.15.29:42998) 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.345+0000 7f9ee77fe640 1 -- 172.21.15.29:0/1396976860 learned_addr learned my addr 172.21.15.29:0/1396976860 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ee77fe640 1 -- 172.21.15.29:0/1396976860 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d431f0 msgr2=0x556d48d942a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/1396976860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48cfb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ee77fe640 1 --2- 172.21.15.29:0/1396976860 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d431f0 0x556d48d942a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ee77fe640 1 -- 172.21.15.29:0/1396976860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 msgr2=0x556d48cfb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ee77fe640 1 --2- 172.21.15.29:0/1396976860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48cfb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ee77fe640 1 -- 172.21.15.29:0/1396976860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d48bf14b0 con 0x556d48d38be0 2024-09-13T18:45:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ee77fe640 1 --2- 172.21.15.29:0/1396976860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 0x556d48d29500 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9edc016800 tx=0x7f9edc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad768853cc20bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ec6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ec6ffd640 1 -- 172.21.15.29:0/1396976860 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc026040 con 0x556d48d38be0 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ec6ffd640 1 -- 172.21.15.29:0/1396976860 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9edc029330 con 0x556d48d38be0 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ef1688740 1 -- 172.21.15.29:0/1396976860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ed8075440 con 0x556d48d38be0 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ec6ffd640 1 -- 172.21.15.29:0/1396976860 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9edc0294f0 con 0x556d48d38be0 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ef1688740 10 client.4386 fetch_fsmap learned FSMap version 7 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ef1688740 1 -- 172.21.15.29:0/1396976860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x556d48c2ad00 con 0x556d48d38be0 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ec6ffd640 1 -- 172.21.15.29:0/1396976860 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8075440 con 0x556d48d38be0 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ec6ffd640 1 -- 172.21.15.29:0/1396976860 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 7) v1 ==== 2032+0+0 (secure 0 0 0) 0x7f9edc029050 con 0x556d48d38be0 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ef1688740 10 client.4386 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ef1688740 10 client.4386 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ef1688740 20 client.4386 populate_metadata read hostname 'smithi029' 2024-09-13T18:45:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1396976860 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x556d48d947e0 0x556d48cff460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ef1688740 4 client.4386 mds_command: new command op to 4239 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:45:28.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ef1688740 1 -- 172.21.15.29:0/1396976860 --> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556d489bcd10 con 0x556d48d947e0 2024-09-13T18:45:28.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.346+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/1396976860 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x556d48d947e0 0x556d48cff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ec6ffd640 10 client.4386 ms_handle_connect on v2:172.21.15.29:6832/175129703 2024-09-13T18:45:28.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ee7fff640 1 --2- 172.21.15.29:0/1396976860 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x556d48d947e0 0x556d48cff460 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d32f0a7a1dff894 server_cookie=21526f6ed0daa8a in_seq=0 out_seq=0 2024-09-13T18:45:28.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ec6ffd640 1 -- 172.21.15.29:0/1396976860 <== mds.0 v2:172.21.15.29:6832/175129703 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x556d489bcd10 con 0x556d48d947e0 2024-09-13T18:45:28.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ec6ffd640 10 client.4386 handle_command_reply: tid=0 2024-09-13T18:45:28.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ef1688740 1 client.4386 shutdown 2024-09-13T18:45:28.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ef1688740 1 -- 172.21.15.29:0/1396976860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 msgr2=0x556d48d29500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1396976860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 0x556d48d29500 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9edc016800 tx=0x7f9edc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ef1688740 1 -- 172.21.15.29:0/1396976860 shutdown_connections 2024-09-13T18:45:28.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1396976860 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x556d48d431f0 0x556d48d942a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1396976860 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x556d48d947e0 0x556d48cff460 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1396976860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d48d38be0 0x556d48d29500 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ef1688740 1 --2- 172.21.15.29:0/1396976860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556d48d2eb60 0x556d48cfb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ec6ffd640 0 client.4386 ms_handle_reset on v2:172.21.15.29:6832/175129703 2024-09-13T18:45:28.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ef1688740 1 -- 172.21.15.29:0/1396976860 >> 172.21.15.29:0/1396976860 conn(0x556d48cfc7f0 msgr2=0x556d48d2b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:28.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ef1688740 1 -- 172.21.15.29:0/1396976860 shutdown_connections 2024-09-13T18:45:28.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ef1688740 1 -- 172.21.15.29:0/1396976860 wait complete. 2024-09-13T18:45:28.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.347+0000 7f9ef1688740 20 client.4386 trim_cache size 0 max 16384 2024-09-13T18:45:28.357 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-13T18:45:28.357 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "41f49ea7-93ea-4289-a814-d28f860525af", 2024-09-13T18:45:28.358 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-09-13T18:45:28.358 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4239, 2024-09-13T18:45:28.358 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-13T18:45:28.358 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-13T18:45:28.358 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-13T18:45:28.358 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 6.3407896859999999, 2024-09-13T18:45:28.358 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 7, 2024-09-13T18:45:28.358 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 24, 2024-09-13T18:45:28.358 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 23, 2024-09-13T18:45:28.358 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 12.372453409 2024-09-13T18:45:28.358 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-13T18:45:28.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.348+0000 7f9eee88e640 1 -- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9ed406ac00 msgr2=0x7f9ed406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.348+0000 7f9eee88e640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9ed406ac00 0x7f9ed406d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ee81d2e50 tx=0x7f9edc008040 comp rx=0 tx=0).stop 2024-09-13T18:45:28.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.348+0000 7f9eee88e640 1 -- 172.21.15.29:0/897971655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee806cc50 msgr2=0x7f9ee81deb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.348+0000 7f9eee88e640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee806cc50 0x7f9ee81deb00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ed802a220 tx=0x7f9ed80046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.348+0000 7f9eee88e640 1 -- 172.21.15.29:0/897971655 shutdown_connections 2024-09-13T18:45:28.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.348+0000 7f9eee88e640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9ed406ac00 0x7f9ed406d0c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.348+0000 7f9eee88e640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ee8143000 0x7f9ee813e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.348+0000 7f9eee88e640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee80b4490 0x7f9ee81df2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.348+0000 7f9eee88e640 1 --2- 172.21.15.29:0/897971655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee806cc50 0x7f9ee81deb00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.348+0000 7f9eee88e640 1 -- 172.21.15.29:0/897971655 >> 172.21.15.29:0/897971655 conn(0x7f9ee806a5b0 msgr2=0x7f9ee80b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.348+0000 7f9eee88e640 1 -- 172.21.15.29:0/897971655 shutdown_connections 2024-09-13T18:45:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.348+0000 7f9eee88e640 1 -- 172.21.15.29:0/897971655 wait complete. 2024-09-13T18:45:28.362 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:45:28.362 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:28.363 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:45:28.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.460+0000 7f5fbc4d7640 1 Processor -- start 2024-09-13T18:45:28.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.460+0000 7f5fbc4d7640 1 -- start start 2024-09-13T18:45:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fbc4d7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5fb40b5920 0x7f5fb40b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fbc4d7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5fb40b20f0 0x7f5fb413d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fbc4d7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5fb40b2530 0x7f5fb413daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fbc4d7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb40b1010 con 0x7f5fb40b20f0 2024-09-13T18:45:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fbc4d7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb40b1cd0 con 0x7f5fb40b2530 2024-09-13T18:45:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fbc4d7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb40b4220 con 0x7f5fb40b5920 2024-09-13T18:45:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fb9a72640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5fb40b20f0 0x7f5fb413d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fb9a72640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5fb40b20f0 0x7f5fb413d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43012/0 (socket says 172.21.15.29:43012) 2024-09-13T18:45:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fb9a72640 1 -- 172.21.15.29:0/2990905348 learned_addr learned my addr 172.21.15.29:0/2990905348 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fbaa74640 1 --2- 172.21.15.29:0/2990905348 >> v2:172.21.15.96:3300/0 conn(0x7f5fb40b2530 0x7f5fb413daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fba273640 1 --2- 172.21.15.29:0/2990905348 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5fb40b5920 0x7f5fb40b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fb9a72640 1 -- 172.21.15.29:0/2990905348 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5fb40b5920 msgr2=0x7f5fb40b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fb9a72640 1 --2- 172.21.15.29:0/2990905348 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5fb40b5920 0x7f5fb40b4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fb9a72640 1 -- 172.21.15.29:0/2990905348 >> v2:172.21.15.96:3300/0 conn(0x7f5fb40b2530 msgr2=0x7f5fb413daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fb9a72640 1 --2- 172.21.15.29:0/2990905348 >> v2:172.21.15.96:3300/0 conn(0x7f5fb40b2530 0x7f5fb413daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.461+0000 7f5fb9a72640 1 -- 172.21.15.29:0/2990905348 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb40b9cc0 con 0x7f5fb40b20f0 2024-09-13T18:45:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.462+0000 7f5fb9a72640 1 --2- 172.21.15.29:0/2990905348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fb40b20f0 0x7f5fb413d5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40b0d90 tx=0x7f5fa402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e439886b6a3068 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.462+0000 7f5fb9271640 1 -- 172.21.15.29:0/2990905348 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa402ae90 con 0x7f5fb40b20f0 2024-09-13T18:45:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.462+0000 7f5fb9271640 1 -- 172.21.15.29:0/2990905348 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa4032440 con 0x7f5fb40b20f0 2024-09-13T18:45:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.462+0000 7f5fb9271640 1 -- 172.21.15.29:0/2990905348 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa40327d0 con 0x7f5fb40b20f0 2024-09-13T18:45:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.463+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/2990905348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fb40b20f0 msgr2=0x7f5fb413d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.463+0000 7f5fbc4d7640 1 --2- 172.21.15.29:0/2990905348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fb40b20f0 0x7f5fb413d5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40b0d90 tx=0x7f5fa402a140 comp rx=0 tx=0).stop 2024-09-13T18:45:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.463+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/2990905348 shutdown_connections 2024-09-13T18:45:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.463+0000 7f5fbc4d7640 1 --2- 172.21.15.29:0/2990905348 >> v2:172.21.15.96:3300/0 conn(0x7f5fb40b2530 0x7f5fb413daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.463+0000 7f5fbc4d7640 1 --2- 172.21.15.29:0/2990905348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fb40b20f0 0x7f5fb413d5b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.463+0000 7f5fbc4d7640 1 --2- 172.21.15.29:0/2990905348 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5fb40b5920 0x7f5fb40b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.463+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/2990905348 >> 172.21.15.29:0/2990905348 conn(0x7f5fb406a5b0 msgr2=0x7f5fb40b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.463+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/2990905348 shutdown_connections 2024-09-13T18:45:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.463+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/2990905348 wait complete. 2024-09-13T18:45:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.464+0000 7f5fbc4d7640 1 Processor -- start 2024-09-13T18:45:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.464+0000 7f5fbc4d7640 1 -- start start 2024-09-13T18:45:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fbc4d7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fb40b20f0 0x7f5fb4137e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fbc4d7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5fb40b2530 0x7f5fb41d9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fbc4d7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fb40b5920 0x7f5fb41d9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fbc4d7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb4138360 con 0x7f5fb40b20f0 2024-09-13T18:45:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fbc4d7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb41d9040 con 0x7f5fb40b5920 2024-09-13T18:45:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fbc4d7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb413e810 con 0x7f5fb40b2530 2024-09-13T18:45:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fba273640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fb40b20f0 0x7f5fb4137e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fba273640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fb40b20f0 0x7f5fb4137e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43014/0 (socket says 172.21.15.29:43014) 2024-09-13T18:45:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fba273640 1 -- 172.21.15.29:0/1710058727 learned_addr learned my addr 172.21.15.29:0/1710058727 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fbaa74640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fb40b5920 0x7f5fb41d9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fb9a72640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5fb40b2530 0x7f5fb41d9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fba273640 1 -- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5fb40b2530 msgr2=0x7f5fb41d9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fba273640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5fb40b2530 0x7f5fb41d9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fba273640 1 -- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fb40b5920 msgr2=0x7f5fb41d9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fba273640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fb40b5920 0x7f5fb41d9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fba273640 1 -- 172.21.15.29:0/1710058727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa40094d0 con 0x7f5fb40b20f0 2024-09-13T18:45:28.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fba273640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fb40b20f0 0x7f5fb4137e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000c7f0 tx=0x7f5fb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5faaffd640 1 -- 172.21.15.29:0/1710058727 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0004220 con 0x7f5fb40b20f0 2024-09-13T18:45:28.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5faaffd640 1 -- 172.21.15.29:0/1710058727 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb0004380 con 0x7f5fb40b20f0 2024-09-13T18:45:28.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5faaffd640 1 -- 172.21.15.29:0/1710058727 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0007840 con 0x7f5fb40b20f0 2024-09-13T18:45:28.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/1710058727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb4138540 con 0x7f5fb40b20f0 2024-09-13T18:45:28.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.465+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/1710058727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb413e530 con 0x7f5fb40b20f0 2024-09-13T18:45:28.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.466+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/1710058727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb4139320 con 0x7f5fb40b20f0 2024-09-13T18:45:28.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.467+0000 7f5faaffd640 1 -- 172.21.15.29:0/1710058727 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5fb0007bb0 con 0x7f5fb40b20f0 2024-09-13T18:45:28.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.467+0000 7f5faaffd640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f9806ac00 0x7f5f9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.467+0000 7f5faaffd640 1 -- 172.21.15.29:0/1710058727 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5fb0089430 con 0x7f5fb40b20f0 2024-09-13T18:45:28.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.468+0000 7f5fb9a72640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f9806ac00 0x7f5f9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.468+0000 7f5fb9a72640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f9806ac00 0x7f5f9806d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4034000 tx=0x7f5fa402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.471+0000 7f5faaffd640 1 -- 172.21.15.29:0/1710058727 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5fb4139320 con 0x7f5fb40b20f0 2024-09-13T18:45:28.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.677+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/1710058727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5fb4139320 con 0x7f5fb40b20f0 2024-09-13T18:45:28.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.677+0000 7f5faaffd640 1 -- 172.21.15.29:0/1710058727 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5fb4139320 con 0x7f5fb40b20f0 2024-09-13T18:45:28.681 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:45:28.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.679+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f9806ac00 msgr2=0x7f5f9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.679+0000 7f5fbc4d7640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f9806ac00 0x7f5f9806d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4034000 tx=0x7f5fa402e000 comp rx=0 tx=0).stop 2024-09-13T18:45:28.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.679+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/1710058727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fb40b20f0 msgr2=0x7f5fb4137e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.679+0000 7f5fbc4d7640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fb40b20f0 0x7f5fb4137e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000c7f0 tx=0x7f5fb000ccb0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.679+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/1710058727 shutdown_connections 2024-09-13T18:45:28.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.679+0000 7f5fbc4d7640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f9806ac00 0x7f5f9806d0c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.679+0000 7f5fbc4d7640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5fb40b5920 0x7f5fb41d9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.679+0000 7f5fbc4d7640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5fb40b2530 0x7f5fb41d9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.679+0000 7f5fbc4d7640 1 --2- 172.21.15.29:0/1710058727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fb40b20f0 0x7f5fb4137e20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.679+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/1710058727 >> 172.21.15.29:0/1710058727 conn(0x7f5fb406a5b0 msgr2=0x7f5fb4071060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:28.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.679+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/1710058727 shutdown_connections 2024-09-13T18:45:28.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:28.679+0000 7f5fbc4d7640 1 -- 172.21.15.29:0/1710058727 wait complete. 2024-09-13T18:45:28.693 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:45:28.693 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:45:28.693 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-09-13T18:45:28.693 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T18:45:28.693 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:28.694 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:45:28.694 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:45:28.694 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:45:28.694 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T18:45:28.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:28.694 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-09-13T18:45:28.710 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:45:28.710 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:45:28.710 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:45:28.710 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:28.711 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-09-13T18:45:28.711 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:28.711 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:45:28.711 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:28.711 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-09-13T18:45:28.711 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:45:28.711 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:28.711 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-09-13T18:45:28.711 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:45:28.711 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:28.711 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-09-13T18:45:28.711 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T18:45:28.712 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42799sec preferred_lft 42799sec 2024-09-13T18:45:28.712 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-09-13T18:45:28.712 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:28.712 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:45:28.712 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:28.712 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-09-13T18:45:28.712 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:45:28.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:28.713 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-09-13T18:45:28.713 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-13T18:45:28.713 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:45:28.713 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-09-13T18:45:28.713 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-09-13T18:45:28.713 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:45:28.713 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-13T18:45:28.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:28.891 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:45:28.916 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-09-13T18:45:28.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:28.918 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-09-13T18:45:28.990 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-09-13T18:45:28.990 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:45:28.990 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T18:45:28.991 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T18:45:28.991 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:45:28.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:28.992 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-09-13T18:45:28.992 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-13T18:45:28.992 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:45:28.992 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:45:28.992 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:45:28.992 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-13T18:45:29.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:29.279 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-09-13T18:45:29.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:29.295 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-09-13T18:45:29.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:29.352 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-09-13T18:45:29.352 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-13T18:45:29.352 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T18:45:29.352 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T18:45:29.352 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-13T18:45:29.431 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T18:45:29.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:29.432 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-09-13T18:45:29.432 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-13T18:45:29.432 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T18:45:29.432 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:45:29.432 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T18:45:29.432 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T18:45:29.432 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T18:45:29.432 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-13T18:45:29.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:29.572 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-09-13T18:45:29.573 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-13T18:45:29.573 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-09-13T18:45:29.573 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:45:29.573 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-13T18:45:29.612 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T18:45:29.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:45:29.613 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:29.670 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T18:45:29.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:45:29.671 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:29.727 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-09-13T18:45:29.794 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:45:29.794 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:45:29.860 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:45:29.861 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:45:29.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:29.862 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-09-13T18:45:29.918 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:45:29.918 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T18:45:29.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-09-13T18:45:29.986 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:45:29.987 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:45:30.053 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:45:30.054 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:45:30.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:30.055 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-09-13T18:45:30.060 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:2024-09-13T18:45:30.057+0000 7fc80d182480 -1 init, newargv = 0x55e0530fcc30 newargc=15 2024-09-13T18:45:30.060 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[41332]: starting ceph client 2024-09-13T18:45:30.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[41332]: starting fuse 2024-09-13T18:45:30.076 INFO:teuthology.orchestra.run.smithi029.stdout:41 2024-09-13T18:45:30.076 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-09-13T18:45:30.077 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.admin")) 2024-09-13T18:45:30.078 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-09-13T18:45:30.193 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.admin.41332.asok 2024-09-13T18:45:30.378 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41332.asok 2024-09-13T18:45:30.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:30.379 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41332.asok status 2024-09-13T18:45:30.516 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-13T18:45:30.516 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-09-13T18:45:30.516 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:45:30.516 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:45:30.516 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "admin", 2024-09-13T18:45:30.516 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-09-13T18:45:30.516 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T18:45:30.516 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "41332", 2024-09-13T18:45:30.516 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-09-13T18:45:30.517 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-13T18:45:30.517 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-09-13T18:45:30.517 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-09-13T18:45:30.517 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4405, 2024-09-13T18:45:30.517 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-09-13T18:45:30.517 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-09-13T18:45:30.517 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-09-13T18:45:30.517 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4405 2024-09-13T18:45:30.517 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-13T18:45:30.517 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-09-13T18:45:30.517 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-09-13T18:45:30.517 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2024-09-13T18:45:30.518 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 768210832 2024-09-13T18:45:30.518 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-13T18:45:30.518 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-13T18:45:30.518 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-09-13T18:45:30.518 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-09-13T18:45:30.518 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2024-09-13T18:45:30.518 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 768210832 2024-09-13T18:45:30.518 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-13T18:45:30.518 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4405 172.21.15.29:0/768210832", 2024-09-13T18:45:30.518 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "172.21.15.29:0/768210832", 2024-09-13T18:45:30.518 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-09-13T18:45:30.518 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 7, 2024-09-13T18:45:30.519 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 24, 2024-09-13T18:45:30.519 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:45:30.519 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-09-13T18:45:30.519 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-09-13T18:45:30.519 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-13T18:45:30.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:30.524 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-09-13T18:45:30.524 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:30.540 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-09-13T18:45:30.541 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:30.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:30.541 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:30.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:30.608 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T18:45:30.686 INFO:teuthology.orchestra.run.smithi029.stdout:# file: . 2024-09-13T18:45:30.686 INFO:teuthology.orchestra.run.smithi029.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T18:45:30.686 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:30.686 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:30.687 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:30.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.881+0000 7f8253a32640 1 Processor -- start 2024-09-13T18:45:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.881+0000 7f8253a32640 1 -- start start 2024-09-13T18:45:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8253a32640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f824c0b0cd0 0x7f824c070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8253a32640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f824c071900 0x7f824c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8253a32640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f824c13d4f0 0x7f824c13d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8253a32640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824c06f3c0 con 0x7f824c071900 2024-09-13T18:45:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8253a32640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824c06eab0 con 0x7f824c13d4f0 2024-09-13T18:45:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8253a32640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0b10b0 con 0x7f824c0b0cd0 2024-09-13T18:45:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8250fcd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f824c071900 0x7f824c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8250fcd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f824c071900 0x7f824c0710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43016/0 (socket says 172.21.15.29:43016) 2024-09-13T18:45:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8250fcd640 1 -- 172.21.15.29:0/3265163347 learned_addr learned my addr 172.21.15.29:0/3265163347 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f82517ce640 1 --2- 172.21.15.29:0/3265163347 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f824c0b0cd0 0x7f824c070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8251fcf640 1 --2- 172.21.15.29:0/3265163347 >> v2:172.21.15.96:3300/0 conn(0x7f824c13d4f0 0x7f824c13d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8250fcd640 1 -- 172.21.15.29:0/3265163347 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f824c0b0cd0 msgr2=0x7f824c070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8250fcd640 1 --2- 172.21.15.29:0/3265163347 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f824c0b0cd0 0x7f824c070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8250fcd640 1 -- 172.21.15.29:0/3265163347 >> v2:172.21.15.96:3300/0 conn(0x7f824c13d4f0 msgr2=0x7f824c13d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8250fcd640 1 --2- 172.21.15.29:0/3265163347 >> v2:172.21.15.96:3300/0 conn(0x7f824c13d4f0 0x7f824c13d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.882+0000 7f8250fcd640 1 -- 172.21.15.29:0/3265163347 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c0702d0 con 0x7f824c071900 2024-09-13T18:45:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.883+0000 7f8251fcf640 1 --2- 172.21.15.29:0/3265163347 >> v2:172.21.15.96:3300/0 conn(0x7f824c13d4f0 0x7f824c13d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.883+0000 7f8250fcd640 1 --2- 172.21.15.29:0/3265163347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f824c071900 0x7f824c0710f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f824c1448c0 tx=0x7f823c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6892f3806d16d828 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.883+0000 7f8243fff640 1 -- 172.21.15.29:0/3265163347 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c02ae90 con 0x7f824c071900 2024-09-13T18:45:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.883+0000 7f8243fff640 1 -- 172.21.15.29:0/3265163347 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c032440 con 0x7f824c071900 2024-09-13T18:45:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.883+0000 7f8243fff640 1 -- 172.21.15.29:0/3265163347 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c0327d0 con 0x7f824c071900 2024-09-13T18:45:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.884+0000 7f8253a32640 1 -- 172.21.15.29:0/3265163347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f824c071900 msgr2=0x7f824c0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.884+0000 7f8253a32640 1 --2- 172.21.15.29:0/3265163347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f824c071900 0x7f824c0710f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f824c1448c0 tx=0x7f823c02a140 comp rx=0 tx=0).stop 2024-09-13T18:45:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.884+0000 7f8253a32640 1 -- 172.21.15.29:0/3265163347 shutdown_connections 2024-09-13T18:45:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.884+0000 7f8253a32640 1 --2- 172.21.15.29:0/3265163347 >> v2:172.21.15.96:3300/0 conn(0x7f824c13d4f0 0x7f824c13d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.884+0000 7f8253a32640 1 --2- 172.21.15.29:0/3265163347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f824c071900 0x7f824c0710f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.884+0000 7f8253a32640 1 --2- 172.21.15.29:0/3265163347 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f824c0b0cd0 0x7f824c070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.884+0000 7f8253a32640 1 -- 172.21.15.29:0/3265163347 >> 172.21.15.29:0/3265163347 conn(0x7f824c06a890 msgr2=0x7f824c0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.884+0000 7f8253a32640 1 -- 172.21.15.29:0/3265163347 shutdown_connections 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.884+0000 7f8253a32640 1 -- 172.21.15.29:0/3265163347 wait complete. 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.885+0000 7f8253a32640 1 Processor -- start 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.885+0000 7f8253a32640 1 -- start start 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8253a32640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f824c071900 0x7f824c1441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8253a32640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f824c0b0cd0 0x7f824c1cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8253a32640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f824c13d4f0 0x7f824c1d9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8253a32640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0a7800 con 0x7f824c0b0cd0 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8253a32640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c143ad0 con 0x7f824c071900 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8253a32640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c1cc7e0 con 0x7f824c13d4f0 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8250fcd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f824c0b0cd0 0x7f824c1cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8250fcd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f824c0b0cd0 0x7f824c1cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43018/0 (socket says 172.21.15.29:43018) 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8250fcd640 1 -- 172.21.15.29:0/1111729817 learned_addr learned my addr 172.21.15.29:0/1111729817 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8251fcf640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f824c13d4f0 0x7f824c1d9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:30.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f82517ce640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f824c071900 0x7f824c1441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8250fcd640 1 -- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f824c13d4f0 msgr2=0x7f824c1d9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8250fcd640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f824c13d4f0 0x7f824c1d9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8250fcd640 1 -- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f824c071900 msgr2=0x7f824c1441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8250fcd640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f824c071900 0x7f824c1441f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8250fcd640 1 -- 172.21.15.29:0/1111729817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c0094d0 con 0x7f824c0b0cd0 2024-09-13T18:45:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8250fcd640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f824c0b0cd0 0x7f824c1cbb90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f823c02a180 tx=0x7f823c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8241ffb640 1 -- 172.21.15.29:0/1111729817 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c03d830 con 0x7f824c0b0cd0 2024-09-13T18:45:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8241ffb640 1 -- 172.21.15.29:0/1111729817 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c03d990 con 0x7f824c0b0cd0 2024-09-13T18:45:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8253a32640 1 -- 172.21.15.29:0/1111729817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824c1437f0 con 0x7f824c0b0cd0 2024-09-13T18:45:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.886+0000 7f8241ffb640 1 -- 172.21.15.29:0/1111729817 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c03dd40 con 0x7f824c0b0cd0 2024-09-13T18:45:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.887+0000 7f8253a32640 1 -- 172.21.15.29:0/1111729817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824c1d9650 con 0x7f824c0b0cd0 2024-09-13T18:45:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.888+0000 7f8253a32640 1 -- 172.21.15.29:0/1111729817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f824c144910 con 0x7f824c0b0cd0 2024-09-13T18:45:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.888+0000 7f8241ffb640 1 -- 172.21.15.29:0/1111729817 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f823c039040 con 0x7f824c0b0cd0 2024-09-13T18:45:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.889+0000 7f8241ffb640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f823006ac00 0x7f823006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.889+0000 7f82517ce640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f823006ac00 0x7f823006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.889+0000 7f8241ffb640 1 -- 172.21.15.29:0/1111729817 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f823c0aa020 con 0x7f824c0b0cd0 2024-09-13T18:45:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.889+0000 7f82517ce640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f823006ac00 0x7f823006d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f824c1cf5f0 tx=0x7f8248008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:30.894+0000 7f8241ffb640 1 -- 172.21.15.29:0/1111729817 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f823c074fa0 con 0x7f824c0b0cd0 2024-09-13T18:45:31.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.067+0000 7f8253a32640 1 -- 172.21.15.29:0/1111729817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f824c0b1a40 con 0x7f824c0b0cd0 2024-09-13T18:45:31.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.068+0000 7f8241ffb640 1 -- 172.21.15.29:0/1111729817 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7f823c0785c0 con 0x7f824c0b0cd0 2024-09-13T18:45:31.072 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:31.072 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.070+0000 7f8253a32640 1 -- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f823006ac00 msgr2=0x7f823006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.070+0000 7f8253a32640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f823006ac00 0x7f823006d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f824c1cf5f0 tx=0x7f8248008040 comp rx=0 tx=0).stop 2024-09-13T18:45:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.070+0000 7f8253a32640 1 -- 172.21.15.29:0/1111729817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f824c0b0cd0 msgr2=0x7f824c1cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.070+0000 7f8253a32640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f824c0b0cd0 0x7f824c1cbb90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f823c02a180 tx=0x7f823c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.070+0000 7f8253a32640 1 -- 172.21.15.29:0/1111729817 shutdown_connections 2024-09-13T18:45:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.070+0000 7f8253a32640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f823006ac00 0x7f823006d0c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.070+0000 7f8253a32640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f824c13d4f0 0x7f824c1d9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.070+0000 7f8253a32640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f824c0b0cd0 0x7f824c1cbb90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.070+0000 7f8253a32640 1 --2- 172.21.15.29:0/1111729817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f824c071900 0x7f824c1441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.070+0000 7f8253a32640 1 -- 172.21.15.29:0/1111729817 >> 172.21.15.29:0/1111729817 conn(0x7f824c06a890 msgr2=0x7f824c1cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.070+0000 7f8253a32640 1 -- 172.21.15.29:0/1111729817 shutdown_connections 2024-09-13T18:45:31.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.070+0000 7f8253a32640 1 -- 172.21.15.29:0/1111729817 wait complete. 2024-09-13T18:45:31.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:45:17.630827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:45:20.113248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:20.978194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:24.059966+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:45:31.085 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.185+0000 7fc9b3d9c640 1 Processor -- start 2024-09-13T18:45:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.185+0000 7fc9b3d9c640 1 -- start start 2024-09-13T18:45:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b3d9c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9ac09c100 0x7fc9ac071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b3d9c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc9ac0b39a0 0x7fc9ac14cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b3d9c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ac09c4e0 con 0x7fc9ac0721b0 2024-09-13T18:45:31.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b3d9c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac0b2b90 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b3d9c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac0b79d0 con 0x7fc9ac09c100 2024-09-13T18:45:31.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b2339640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc9ac0b39a0 0x7fc9ac14cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b2339640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc9ac0b39a0 0x7fc9ac14cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43026/0 (socket says 172.21.15.29:43026) 2024-09-13T18:45:31.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b2339640 1 -- 172.21.15.29:0/287069064 learned_addr learned my addr 172.21.15.29:0/287069064 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:31.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b1b38640 1 --2- 172.21.15.29:0/287069064 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9ac09c100 0x7fc9ac071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b2339640 1 -- 172.21.15.29:0/287069064 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9ac09c100 msgr2=0x7fc9ac071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b2339640 1 --2- 172.21.15.29:0/287069064 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9ac09c100 0x7fc9ac071c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b2339640 1 -- 172.21.15.29:0/287069064 >> v1:172.21.15.96:6789/0 conn(0x7fc9ac0721b0 legacy=0x7fc9ac145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b2339640 1 -- 172.21.15.29:0/287069064 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac0b7c90 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.186+0000 7fc9b1b38640 1 --2- 172.21.15.29:0/287069064 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9ac09c100 0x7fc9ac071c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.187+0000 7fc9b2339640 1 --2- 172.21.15.29:0/287069064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0b39a0 0x7fc9ac14cfc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400d150 tx=0x7fc9a402c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb8ee446d63a825 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.187+0000 7fc9b0b36640 1 -- 172.21.15.29:0/287069064 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4030050 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.187+0000 7fc9b0b36640 1 -- 172.21.15.29:0/287069064 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4009600 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.187+0000 7fc9b0b36640 1 -- 172.21.15.29:0/287069064 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4009990 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.188+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/287069064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0b39a0 msgr2=0x7fc9ac14cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.188+0000 7fc9b3d9c640 1 --2- 172.21.15.29:0/287069064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0b39a0 0x7fc9ac14cfc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400d150 tx=0x7fc9a402c840 comp rx=0 tx=0).stop 2024-09-13T18:45:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.188+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/287069064 shutdown_connections 2024-09-13T18:45:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.188+0000 7fc9b3d9c640 1 --2- 172.21.15.29:0/287069064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0b39a0 0x7fc9ac14cfc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.188+0000 7fc9b3d9c640 1 --2- 172.21.15.29:0/287069064 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9ac09c100 0x7fc9ac071c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.188+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/287069064 >> 172.21.15.29:0/287069064 conn(0x7fc9ac06a2f0 msgr2=0x7fc9ac06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.188+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/287069064 shutdown_connections 2024-09-13T18:45:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.188+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/287069064 wait complete. 2024-09-13T18:45:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.189+0000 7fc9b3d9c640 1 Processor -- start 2024-09-13T18:45:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.189+0000 7fc9b3d9c640 1 -- start start 2024-09-13T18:45:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b3d9c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9ac0721b0 0x7fc9ac144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b3d9c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9ac09c100 0x7fc9ac13d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b3d9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0b39a0 0x7fc9ac13bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b3d9c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac13fb40 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b3d9c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac13f3d0 con 0x7fc9ac09c100 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b3d9c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac13f6b0 con 0x7fc9ac0721b0 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b2339640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0b39a0 0x7fc9ac13bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b2339640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0b39a0 0x7fc9ac13bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43028/0 (socket says 172.21.15.29:43028) 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b2339640 1 -- 172.21.15.29:0/1816996285 learned_addr learned my addr 172.21.15.29:0/1816996285 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b1b38640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9ac0721b0 0x7fc9ac144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b1337640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9ac09c100 0x7fc9ac13d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b2339640 1 -- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9ac0721b0 msgr2=0x7fc9ac144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b2339640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9ac0721b0 0x7fc9ac144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b2339640 1 -- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9ac09c100 msgr2=0x7fc9ac13d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b2339640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9ac09c100 0x7fc9ac13d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b2339640 1 -- 172.21.15.29:0/1816996285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a400bd40 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b2339640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0b39a0 0x7fc9ac13bf70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4037040 tx=0x7fc9a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9a27fc640 1 -- 172.21.15.29:0/1816996285 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a403d830 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9a27fc640 1 -- 172.21.15.29:0/1816996285 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a403d990 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/1816996285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac13fde0 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9a27fc640 1 -- 172.21.15.29:0/1816996285 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a403dd40 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.190+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/1816996285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac13d370 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.191+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/1816996285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ac0672b0 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.192+0000 7fc9a27fc640 1 -- 172.21.15.29:0/1816996285 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc9a403b070 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.192+0000 7fc9a27fc640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc99006ac00 0x7fc99006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.192+0000 7fc9a27fc640 1 -- 172.21.15.29:0/1816996285 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9a40aa3f0 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.192+0000 7fc9b1b38640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc99006ac00 0x7fc99006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.193+0000 7fc9b1b38640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc99006ac00 0x7fc99006d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac1453b0 tx=0x7fc9a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.197+0000 7fc9a27fc640 1 -- 172.21.15.29:0/1816996285 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc9a40753a0 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.364+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/1816996285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9ac13ffd0 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.365+0000 7fc9a27fc640 1 -- 172.21.15.29:0/1816996285 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9a40789c0 con 0x7fc9ac0b39a0 2024-09-13T18:45:31.368 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-09-13T18:45:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.367+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc99006ac00 msgr2=0x7fc99006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.367+0000 7fc9b3d9c640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc99006ac00 0x7fc99006d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac1453b0 tx=0x7fc9a8008040 comp rx=0 tx=0).stop 2024-09-13T18:45:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.367+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/1816996285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0b39a0 msgr2=0x7fc9ac13bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.367+0000 7fc9b3d9c640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0b39a0 0x7fc9ac13bf70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4037040 tx=0x7fc9a4004a40 comp rx=0 tx=0).stop 2024-09-13T18:45:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.367+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/1816996285 shutdown_connections 2024-09-13T18:45:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.367+0000 7fc9b3d9c640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc99006ac00 0x7fc99006d0c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.367+0000 7fc9b3d9c640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0b39a0 0x7fc9ac13bf70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.367+0000 7fc9b3d9c640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9ac09c100 0x7fc9ac13d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.367+0000 7fc9b3d9c640 1 --2- 172.21.15.29:0/1816996285 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9ac0721b0 0x7fc9ac144c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.367+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/1816996285 >> 172.21.15.29:0/1816996285 conn(0x7fc9ac06a2f0 msgr2=0x7fc9ac098500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.367+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/1816996285 shutdown_connections 2024-09-13T18:45:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.367+0000 7fc9b3d9c640 1 -- 172.21.15.29:0/1816996285 wait complete. 2024-09-13T18:45:31.380 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:45:31.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.482+0000 7ff7cf311640 1 Processor -- start 2024-09-13T18:45:31.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.482+0000 7ff7cf311640 1 -- start start 2024-09-13T18:45:31.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.482+0000 7ff7cf311640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff7c813f9f0 0x7ff7c806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.482+0000 7ff7cf311640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c8071bb0 con 0x7ff7c8145920 2024-09-13T18:45:31.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.482+0000 7ff7cf311640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c8071920 con 0x7ff7c813fdd0 2024-09-13T18:45:31.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.483+0000 7ff7cf311640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c8070b10 con 0x7ff7c813f9f0 2024-09-13T18:45:31.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.483+0000 7ff7cd0ad640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff7c813f9f0 0x7ff7c806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.483+0000 7ff7cd8ae640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff7c8145920 0x7ff7c8150210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42858/0 (socket says 172.21.15.29:42858) 2024-09-13T18:45:31.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.483+0000 7ff7cd8ae640 1 -- 172.21.15.29:0/632986924 learned_addr learned my addr 172.21.15.29:0/632986924 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:31.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.483+0000 7ff7cd0ad640 1 -- 172.21.15.29:0/632986924 >> v1:172.21.15.96:6789/0 conn(0x7ff7c813fdd0 legacy=0x7ff7c8071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.483+0000 7ff7cd0ad640 1 -- 172.21.15.29:0/632986924 >> v1:172.21.15.29:6789/0 conn(0x7ff7c8145920 legacy=0x7ff7c8150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.483+0000 7ff7cd0ad640 1 -- 172.21.15.29:0/632986924 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c806f390 con 0x7ff7c813f9f0 2024-09-13T18:45:31.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.483+0000 7ff7bffff640 1 -- 172.21.15.29:0/632986924 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158548153 0 0) 0x7ff7c8071bb0 con 0x7ff7c8145920 2024-09-13T18:45:31.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.484+0000 7ff7cd0ad640 1 --2- 172.21.15.29:0/632986924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c813f9f0 0x7ff7c806aee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40097a0 tx=0x7ff7c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f6dd8902bbdb01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.484+0000 7ff7bffff640 1 -- 172.21.15.29:0/632986924 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4032440 con 0x7ff7c813f9f0 2024-09-13T18:45:31.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.484+0000 7ff7bffff640 1 -- 172.21.15.29:0/632986924 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40325a0 con 0x7ff7c813f9f0 2024-09-13T18:45:31.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.484+0000 7ff7bffff640 1 -- 172.21.15.29:0/632986924 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4032930 con 0x7ff7c813f9f0 2024-09-13T18:45:31.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.484+0000 7ff7cf311640 1 -- 172.21.15.29:0/632986924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c813f9f0 msgr2=0x7ff7c806aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.484+0000 7ff7cf311640 1 --2- 172.21.15.29:0/632986924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c813f9f0 0x7ff7c806aee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40097a0 tx=0x7ff7c402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.484+0000 7ff7cf311640 1 -- 172.21.15.29:0/632986924 shutdown_connections 2024-09-13T18:45:31.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.484+0000 7ff7cf311640 1 --2- 172.21.15.29:0/632986924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c813f9f0 0x7ff7c806aee0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.484+0000 7ff7cf311640 1 -- 172.21.15.29:0/632986924 >> 172.21.15.29:0/632986924 conn(0x7ff7c80b4710 msgr2=0x7ff7c80b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.485+0000 7ff7cf311640 1 -- 172.21.15.29:0/632986924 shutdown_connections 2024-09-13T18:45:31.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.485+0000 7ff7cf311640 1 -- 172.21.15.29:0/632986924 wait complete. 2024-09-13T18:45:31.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.485+0000 7ff7cf311640 1 Processor -- start 2024-09-13T18:45:31.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.486+0000 7ff7cf311640 1 -- start start 2024-09-13T18:45:31.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.486+0000 7ff7cf311640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff7c813f9f0 0x7ff7c80b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.486+0000 7ff7cf311640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c813fdd0 0x7ff7c81db270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.486+0000 7ff7cf311640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7c8145920 0x7ff7c813ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.486+0000 7ff7cf311640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8142c60 con 0x7ff7c813fdd0 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.486+0000 7ff7cf311640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80abd20 con 0x7ff7c8145920 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.486+0000 7ff7cf311640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80acab0 con 0x7ff7c813f9f0 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.486+0000 7ff7cc8ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c813fdd0 0x7ff7c81db270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.486+0000 7ff7cc8ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c813fdd0 0x7ff7c81db270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43056/0 (socket says 172.21.15.29:43056) 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.486+0000 7ff7cc8ac640 1 -- 172.21.15.29:0/1881703354 learned_addr learned my addr 172.21.15.29:0/1881703354 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.486+0000 7ff7cd0ad640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff7c813f9f0 0x7ff7c80b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.486+0000 7ff7cd8ae640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7c8145920 0x7ff7c813ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.487+0000 7ff7cc8ac640 1 -- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff7c813f9f0 msgr2=0x7ff7c80b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.487+0000 7ff7cc8ac640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff7c813f9f0 0x7ff7c80b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.487+0000 7ff7cc8ac640 1 -- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7c8145920 msgr2=0x7ff7c813ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.487+0000 7ff7cc8ac640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7c8145920 0x7ff7c813ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.487+0000 7ff7cc8ac640 1 -- 172.21.15.29:0/1881703354 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4009400 con 0x7ff7c813fdd0 2024-09-13T18:45:31.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.487+0000 7ff7cc8ac640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c813fdd0 0x7ff7c81db270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800c450 tx=0x7ff7b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.487+0000 7ff7bdffb640 1 -- 172.21.15.29:0/1881703354 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b80052d0 con 0x7ff7c813fdd0 2024-09-13T18:45:31.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.487+0000 7ff7bdffb640 1 -- 172.21.15.29:0/1881703354 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b8005430 con 0x7ff7c813fdd0 2024-09-13T18:45:31.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.487+0000 7ff7cf311640 1 -- 172.21.15.29:0/1881703354 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c80acd90 con 0x7ff7c813fdd0 2024-09-13T18:45:31.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.487+0000 7ff7bdffb640 1 -- 172.21.15.29:0/1881703354 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8012870 con 0x7ff7c813fdd0 2024-09-13T18:45:31.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.487+0000 7ff7cf311640 1 -- 172.21.15.29:0/1881703354 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c80b1f00 con 0x7ff7c813fdd0 2024-09-13T18:45:31.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.488+0000 7ff7cf311640 1 -- 172.21.15.29:0/1881703354 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c80702b0 con 0x7ff7c813fdd0 2024-09-13T18:45:31.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.488+0000 7ff7bdffb640 1 -- 172.21.15.29:0/1881703354 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff7b80129d0 con 0x7ff7c813fdd0 2024-09-13T18:45:31.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.489+0000 7ff7bdffb640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff7ac06ac00 0x7ff7ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.489+0000 7ff7bdffb640 1 -- 172.21.15.29:0/1881703354 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7b8088f60 con 0x7ff7c813fdd0 2024-09-13T18:45:31.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.489+0000 7ff7cd0ad640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff7ac06ac00 0x7ff7ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.490+0000 7ff7cd0ad640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff7ac06ac00 0x7ff7ac06d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4034000 tx=0x7ff7c402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.493+0000 7ff7bdffb640 1 -- 172.21.15.29:0/1881703354 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff7b8053f90 con 0x7ff7c813fdd0 2024-09-13T18:45:31.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.667+0000 7ff7cf311640 1 -- 172.21.15.29:0/1881703354 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7c81429c0 con 0x7ff7c813fdd0 2024-09-13T18:45:31.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.667+0000 7ff7bdffb640 1 -- 172.21.15.29:0/1881703354 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7c81429c0 con 0x7ff7c813fdd0 2024-09-13T18:45:31.670 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-13T18:45:31.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.670+0000 7ff7cf311640 1 -- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff7ac06ac00 msgr2=0x7ff7ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.670+0000 7ff7cf311640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff7ac06ac00 0x7ff7ac06d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4034000 tx=0x7ff7c402e000 comp rx=0 tx=0).stop 2024-09-13T18:45:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.670+0000 7ff7cf311640 1 -- 172.21.15.29:0/1881703354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c813fdd0 msgr2=0x7ff7c81db270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.670+0000 7ff7cf311640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c813fdd0 0x7ff7c81db270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800c450 tx=0x7ff7b800c910 comp rx=0 tx=0).stop 2024-09-13T18:45:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.670+0000 7ff7cf311640 1 -- 172.21.15.29:0/1881703354 shutdown_connections 2024-09-13T18:45:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.670+0000 7ff7cf311640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff7ac06ac00 0x7ff7ac06d0c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.670+0000 7ff7cf311640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7c8145920 0x7ff7c813ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.670+0000 7ff7cf311640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c813fdd0 0x7ff7c81db270 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.670+0000 7ff7cf311640 1 --2- 172.21.15.29:0/1881703354 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff7c813f9f0 0x7ff7c80b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.670+0000 7ff7cf311640 1 -- 172.21.15.29:0/1881703354 >> 172.21.15.29:0/1881703354 conn(0x7ff7c80b4710 msgr2=0x7ff7c806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.670+0000 7ff7cf311640 1 -- 172.21.15.29:0/1881703354 shutdown_connections 2024-09-13T18:45:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.670+0000 7ff7cf311640 1 -- 172.21.15.29:0/1881703354 wait complete. 2024-09-13T18:45:31.683 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:45:31.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.785+0000 7f0b7d261640 1 Processor -- start 2024-09-13T18:45:31.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.785+0000 7f0b7d261640 1 -- start start 2024-09-13T18:45:31.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.785+0000 7f0b7d261640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0b780b82d0 0x7f0b78140c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.785+0000 7f0b7d261640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b78071490 0x7f0b7814e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.785+0000 7f0b7d261640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b780b86b0 con 0x7f0b781411d0 2024-09-13T18:45:31.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.785+0000 7f0b7d261640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b78070410 con 0x7f0b780b82d0 2024-09-13T18:45:31.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.785+0000 7f0b7d261640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780706f0 con 0x7f0b78071490 2024-09-13T18:45:31.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.786+0000 7f0b767fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0b781411d0 0x7f0b78070d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42872/0 (socket says 172.21.15.29:42872) 2024-09-13T18:45:31.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.786+0000 7f0b767fc640 1 -- 172.21.15.29:0/1525328705 learned_addr learned my addr 172.21.15.29:0/1525328705 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:31.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.786+0000 7f0b76ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0b780b82d0 0x7f0b78140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.786+0000 7f0b777fe640 1 --2- 172.21.15.29:0/1525328705 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b78071490 0x7f0b7814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.786+0000 7f0b75ffb640 1 -- 172.21.15.29:0/1525328705 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863111737 0 0) 0x7f0b780b86b0 con 0x7f0b781411d0 2024-09-13T18:45:31.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.786+0000 7f0b75ffb640 1 -- 172.21.15.29:0/1525328705 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b60003520 con 0x7f0b781411d0 2024-09-13T18:45:31.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.786+0000 7f0b76ffd640 1 -- 172.21.15.29:0/1525328705 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b78071490 msgr2=0x7f0b7814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:31.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.786+0000 7f0b76ffd640 1 --2- 172.21.15.29:0/1525328705 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b78071490 0x7f0b7814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.786+0000 7f0b76ffd640 1 -- 172.21.15.29:0/1525328705 >> v1:172.21.15.29:6789/0 conn(0x7f0b781411d0 legacy=0x7f0b78070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.786+0000 7f0b76ffd640 1 -- 172.21.15.29:0/1525328705 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7806ee80 con 0x7f0b780b82d0 2024-09-13T18:45:31.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.786+0000 7f0b777fe640 1 --2- 172.21.15.29:0/1525328705 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b78071490 0x7f0b7814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:31.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.787+0000 7f0b76ffd640 1 --2- 172.21.15.29:0/1525328705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b780b82d0 0x7f0b78140c90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0b680097a0 tx=0x7f0b6802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9795e9a189251b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.787+0000 7f0b75ffb640 1 -- 172.21.15.29:0/1525328705 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6802adb0 con 0x7f0b780b82d0 2024-09-13T18:45:31.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.787+0000 7f0b75ffb640 1 -- 172.21.15.29:0/1525328705 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b68032440 con 0x7f0b780b82d0 2024-09-13T18:45:31.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.787+0000 7f0b75ffb640 1 -- 172.21.15.29:0/1525328705 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b680327d0 con 0x7f0b780b82d0 2024-09-13T18:45:31.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.787+0000 7f0b7d261640 1 -- 172.21.15.29:0/1525328705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b780b82d0 msgr2=0x7f0b78140c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.787+0000 7f0b7d261640 1 --2- 172.21.15.29:0/1525328705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b780b82d0 0x7f0b78140c90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0b680097a0 tx=0x7f0b6802a060 comp rx=0 tx=0).stop 2024-09-13T18:45:31.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.787+0000 7f0b7d261640 1 -- 172.21.15.29:0/1525328705 shutdown_connections 2024-09-13T18:45:31.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.787+0000 7f0b7d261640 1 --2- 172.21.15.29:0/1525328705 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b78071490 0x7f0b7814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.787+0000 7f0b7d261640 1 --2- 172.21.15.29:0/1525328705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b780b82d0 0x7f0b78140c90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.787+0000 7f0b7d261640 1 -- 172.21.15.29:0/1525328705 >> 172.21.15.29:0/1525328705 conn(0x7f0b7806a560 msgr2=0x7f0b780b7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.787+0000 7f0b7d261640 1 -- 172.21.15.29:0/1525328705 shutdown_connections 2024-09-13T18:45:31.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.787+0000 7f0b7d261640 1 -- 172.21.15.29:0/1525328705 wait complete. 2024-09-13T18:45:31.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.789+0000 7f0b7d261640 1 Processor -- start 2024-09-13T18:45:31.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.789+0000 7f0b7d261640 1 -- start start 2024-09-13T18:45:31.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.789+0000 7f0b7d261640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b78071490 0x7f0b781444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.789+0000 7f0b7d261640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b780b82d0 0x7f0b781470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.789+0000 7f0b7d261640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b781411d0 0x7f0b781d9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.789+0000 7f0b7d261640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780a8610 con 0x7f0b781411d0 2024-09-13T18:45:31.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.789+0000 7f0b7d261640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780a8b60 con 0x7f0b780b82d0 2024-09-13T18:45:31.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.789+0000 7f0b7d261640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780a7650 con 0x7f0b78071490 2024-09-13T18:45:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.789+0000 7f0b777fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b781411d0 0x7f0b781d9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.789+0000 7f0b777fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b781411d0 0x7f0b781d9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43082/0 (socket says 172.21.15.29:43082) 2024-09-13T18:45:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.789+0000 7f0b777fe640 1 -- 172.21.15.29:0/3109324436 learned_addr learned my addr 172.21.15.29:0/3109324436 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b76ffd640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b78071490 0x7f0b781444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b767fc640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b780b82d0 0x7f0b781470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b777fe640 1 -- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b78071490 msgr2=0x7f0b781444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b777fe640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b78071490 0x7f0b781444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b777fe640 1 -- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b780b82d0 msgr2=0x7f0b781470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b777fe640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b780b82d0 0x7f0b781470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b777fe640 1 -- 172.21.15.29:0/3109324436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b68009400 con 0x7f0b781411d0 2024-09-13T18:45:31.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b76ffd640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b78071490 0x7f0b781444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:31.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b767fc640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b780b82d0 0x7f0b781470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:31.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b777fe640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b781411d0 0x7f0b781d9810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b70007e70 tx=0x7f0b7000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b5f7fe640 1 -- 172.21.15.29:0/3109324436 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b70003b90 con 0x7f0b781411d0 2024-09-13T18:45:31.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b5f7fe640 1 -- 172.21.15.29:0/3109324436 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7000f040 con 0x7f0b781411d0 2024-09-13T18:45:31.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b7d261640 1 -- 172.21.15.29:0/3109324436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b780a7930 con 0x7f0b781411d0 2024-09-13T18:45:31.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b5f7fe640 1 -- 172.21.15.29:0/3109324436 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7000de80 con 0x7f0b781411d0 2024-09-13T18:45:31.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.790+0000 7f0b7d261640 1 -- 172.21.15.29:0/3109324436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b781d9280 con 0x7f0b781411d0 2024-09-13T18:45:31.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.791+0000 7f0b7d261640 1 -- 172.21.15.29:0/3109324436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b780a74b0 con 0x7f0b781411d0 2024-09-13T18:45:31.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.791+0000 7f0b5f7fe640 1 -- 172.21.15.29:0/3109324436 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b70004030 con 0x7f0b781411d0 2024-09-13T18:45:31.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.792+0000 7f0b5f7fe640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0b6406ac00 0x7f0b6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.792+0000 7f0b5f7fe640 1 -- 172.21.15.29:0/3109324436 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b700898f0 con 0x7f0b781411d0 2024-09-13T18:45:31.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.792+0000 7f0b76ffd640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0b6406ac00 0x7f0b6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.793+0000 7f0b76ffd640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0b6406ac00 0x7f0b6406d0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b68034000 tx=0x7f0b6802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.796+0000 7f0b5f7fe640 1 -- 172.21.15.29:0/3109324436 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0b780a74b0 con 0x7f0b781411d0 2024-09-13T18:45:31.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.967+0000 7f0b7d261640 1 -- 172.21.15.29:0/3109324436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b780a74b0 con 0x7f0b781411d0 2024-09-13T18:45:31.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.967+0000 7f0b5f7fe640 1 -- 172.21.15.29:0/3109324436 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b7001a020 con 0x7f0b781411d0 2024-09-13T18:45:31.970 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-09-13T18:45:31.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.969+0000 7f0b7d261640 1 -- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0b6406ac00 msgr2=0x7f0b6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.969+0000 7f0b7d261640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0b6406ac00 0x7f0b6406d0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b68034000 tx=0x7f0b6802e000 comp rx=0 tx=0).stop 2024-09-13T18:45:31.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.969+0000 7f0b7d261640 1 -- 172.21.15.29:0/3109324436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b781411d0 msgr2=0x7f0b781d9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.969+0000 7f0b7d261640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b781411d0 0x7f0b781d9810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b70007e70 tx=0x7f0b7000d4a0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.969+0000 7f0b7d261640 1 -- 172.21.15.29:0/3109324436 shutdown_connections 2024-09-13T18:45:31.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.969+0000 7f0b7d261640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0b6406ac00 0x7f0b6406d0c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.969+0000 7f0b7d261640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b781411d0 0x7f0b781d9810 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.969+0000 7f0b7d261640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b780b82d0 0x7f0b781470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.969+0000 7f0b7d261640 1 --2- 172.21.15.29:0/3109324436 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b78071490 0x7f0b781444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.969+0000 7f0b7d261640 1 -- 172.21.15.29:0/3109324436 >> 172.21.15.29:0/3109324436 conn(0x7f0b7806a560 msgr2=0x7f0b7813e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.969+0000 7f0b7d261640 1 -- 172.21.15.29:0/3109324436 shutdown_connections 2024-09-13T18:45:31.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:31.969+0000 7f0b7d261640 1 -- 172.21.15.29:0/3109324436 wait complete. 2024-09-13T18:45:31.982 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:45:32.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.084+0000 7f8f26725640 1 Processor -- start 2024-09-13T18:45:32.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.084+0000 7f8f26725640 1 -- start start 2024-09-13T18:45:32.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f26725640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8f2009c100 0x7f8f20071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f26725640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8f200721b0 0x7f8f20145da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f26725640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2009c4e0 con 0x7f8f200b39a0 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f26725640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f200b2b90 con 0x7f8f200721b0 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f26725640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f200b79d0 con 0x7f8f2009c100 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f24cc2640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8f200b39a0 0x7f8f200b3f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42886/0 (socket says 172.21.15.29:42886) 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f24cc2640 1 -- 172.21.15.29:0/2383405118 learned_addr learned my addr 172.21.15.29:0/2383405118 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f1f7fe640 1 --2- 172.21.15.29:0/2383405118 >> v2:172.21.15.96:3300/0 conn(0x7f8f200721b0 0x7f8f20145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f1ffff640 1 --2- 172.21.15.29:0/2383405118 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8f2009c100 0x7f8f20071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f1effd640 1 -- 172.21.15.29:0/2383405118 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521478322 0 0) 0x7f8f2009c4e0 con 0x7f8f200b39a0 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f1effd640 1 -- 172.21.15.29:0/2383405118 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f08003520 con 0x7f8f200b39a0 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f1effd640 1 -- 172.21.15.29:0/2383405118 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3528025819 0 0) 0x7f8f08003520 con 0x7f8f200b39a0 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f1ffff640 1 -- 172.21.15.29:0/2383405118 >> v2:172.21.15.96:3300/0 conn(0x7f8f200721b0 msgr2=0x7f8f20145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f1ffff640 1 --2- 172.21.15.29:0/2383405118 >> v2:172.21.15.96:3300/0 conn(0x7f8f200721b0 0x7f8f20145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f1ffff640 1 -- 172.21.15.29:0/2383405118 >> v1:172.21.15.29:6789/0 conn(0x7f8f200b39a0 legacy=0x7f8f200b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f1ffff640 1 -- 172.21.15.29:0/2383405118 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f200b7c90 con 0x7f8f2009c100 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.085+0000 7f8f1f7fe640 1 --2- 172.21.15.29:0/2383405118 >> v2:172.21.15.96:3300/0 conn(0x7f8f200721b0 0x7f8f20145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.086+0000 7f8f1ffff640 1 --2- 172.21.15.29:0/2383405118 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8f2009c100 0x7f8f20071c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f100097a0 tx=0x7f8f1002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a32ef9f6357fd7af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.086+0000 7f8f1effd640 1 -- 172.21.15.29:0/2383405118 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f180019f0 con 0x7f8f2009c100 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.086+0000 7f8f1effd640 1 -- 172.21.15.29:0/2383405118 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1002ab10 con 0x7f8f2009c100 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.086+0000 7f8f1effd640 1 -- 172.21.15.29:0/2383405118 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1002aea0 con 0x7f8f2009c100 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.087+0000 7f8f26725640 1 -- 172.21.15.29:0/2383405118 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8f2009c100 msgr2=0x7f8f20071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.087+0000 7f8f26725640 1 --2- 172.21.15.29:0/2383405118 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8f2009c100 0x7f8f20071c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f100097a0 tx=0x7f8f1002a080 comp rx=0 tx=0).stop 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.087+0000 7f8f26725640 1 -- 172.21.15.29:0/2383405118 shutdown_connections 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.087+0000 7f8f26725640 1 --2- 172.21.15.29:0/2383405118 >> v2:172.21.15.96:3300/0 conn(0x7f8f200721b0 0x7f8f20145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.087+0000 7f8f26725640 1 --2- 172.21.15.29:0/2383405118 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8f2009c100 0x7f8f20071c70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.087+0000 7f8f26725640 1 -- 172.21.15.29:0/2383405118 >> 172.21.15.29:0/2383405118 conn(0x7f8f2006a2f0 msgr2=0x7f8f2006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.087+0000 7f8f26725640 1 -- 172.21.15.29:0/2383405118 shutdown_connections 2024-09-13T18:45:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.087+0000 7f8f26725640 1 -- 172.21.15.29:0/2383405118 wait complete. 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.088+0000 7f8f26725640 1 Processor -- start 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.088+0000 7f8f26725640 1 -- start start 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f26725640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8f200721b0 0x7f8f201dcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f26725640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f2009c100 0x7f8f20142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f26725640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200b39a0 0x7f8f201d96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f26725640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f201dd890 con 0x7f8f200b39a0 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f26725640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f201dd240 con 0x7f8f2009c100 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f26725640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f201dd520 con 0x7f8f200721b0 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f24cc2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200b39a0 0x7f8f201d96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f24cc2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200b39a0 0x7f8f201d96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43094/0 (socket says 172.21.15.29:43094) 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f24cc2640 1 -- 172.21.15.29:0/1757594964 learned_addr learned my addr 172.21.15.29:0/1757594964 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f1ffff640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8f200721b0 0x7f8f201dcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f1f7fe640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f2009c100 0x7f8f20142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f24cc2640 1 -- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8f200721b0 msgr2=0x7f8f201dcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f24cc2640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8f200721b0 0x7f8f201dcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f24cc2640 1 -- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f2009c100 msgr2=0x7f8f20142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f24cc2640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f2009c100 0x7f8f20142a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.089+0000 7f8f24cc2640 1 -- 172.21.15.29:0/1757594964 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f14009400 con 0x7f8f200b39a0 2024-09-13T18:45:32.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.090+0000 7f8f24cc2640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200b39a0 0x7f8f201d96d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800cc00 tx=0x7f8f1800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.090+0000 7f8f1cff9640 1 -- 172.21.15.29:0/1757594964 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1800ce10 con 0x7f8f200b39a0 2024-09-13T18:45:32.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.090+0000 7f8f1cff9640 1 -- 172.21.15.29:0/1757594964 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f18012400 con 0x7f8f200b39a0 2024-09-13T18:45:32.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.090+0000 7f8f1cff9640 1 -- 172.21.15.29:0/1757594964 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f180127f0 con 0x7f8f200b39a0 2024-09-13T18:45:32.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.090+0000 7f8f26725640 1 -- 172.21.15.29:0/1757594964 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f10009400 con 0x7f8f200b39a0 2024-09-13T18:45:32.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.090+0000 7f8f26725640 1 -- 172.21.15.29:0/1757594964 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f200ae880 con 0x7f8f200b39a0 2024-09-13T18:45:32.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.091+0000 7f8f26725640 1 -- 172.21.15.29:0/1757594964 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f201dda40 con 0x7f8f200b39a0 2024-09-13T18:45:32.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.091+0000 7f8f1cff9640 1 -- 172.21.15.29:0/1757594964 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8f18007070 con 0x7f8f200b39a0 2024-09-13T18:45:32.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.092+0000 7f8f1cff9640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8f0c06ac00 0x7f8f0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.092+0000 7f8f1cff9640 1 -- 172.21.15.29:0/1757594964 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f180896e0 con 0x7f8f200b39a0 2024-09-13T18:45:32.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.092+0000 7f8f1ffff640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8f0c06ac00 0x7f8f0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.092+0000 7f8f1ffff640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8f0c06ac00 0x7f8f0c06d0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f10034000 tx=0x7f8f1002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.096+0000 7f8f1cff9640 1 -- 172.21.15.29:0/1757594964 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8f201dda40 con 0x7f8f200b39a0 2024-09-13T18:45:32.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.267+0000 7f8f26725640 1 -- 172.21.15.29:0/1757594964 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8f201dda40 con 0x7f8f200b39a0 2024-09-13T18:45:32.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.267+0000 7f8f1cff9640 1 -- 172.21.15.29:0/1757594964 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8f201dda40 con 0x7f8f200b39a0 2024-09-13T18:45:32.270 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-13T18:45:32.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.269+0000 7f8f26725640 1 -- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8f0c06ac00 msgr2=0x7f8f0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.269+0000 7f8f26725640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8f0c06ac00 0x7f8f0c06d0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f10034000 tx=0x7f8f1002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:32.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.269+0000 7f8f26725640 1 -- 172.21.15.29:0/1757594964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200b39a0 msgr2=0x7f8f201d96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.269+0000 7f8f26725640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200b39a0 0x7f8f201d96d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800cc00 tx=0x7f8f1800a430 comp rx=0 tx=0).stop 2024-09-13T18:45:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.269+0000 7f8f26725640 1 -- 172.21.15.29:0/1757594964 shutdown_connections 2024-09-13T18:45:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.269+0000 7f8f26725640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8f0c06ac00 0x7f8f0c06d0c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.269+0000 7f8f26725640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200b39a0 0x7f8f201d96d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.269+0000 7f8f26725640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f2009c100 0x7f8f20142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.269+0000 7f8f26725640 1 --2- 172.21.15.29:0/1757594964 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8f200721b0 0x7f8f201dcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.269+0000 7f8f26725640 1 -- 172.21.15.29:0/1757594964 >> 172.21.15.29:0/1757594964 conn(0x7f8f2006a2f0 msgr2=0x7f8f200b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.270+0000 7f8f26725640 1 -- 172.21.15.29:0/1757594964 shutdown_connections 2024-09-13T18:45:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.270+0000 7f8f26725640 1 -- 172.21.15.29:0/1757594964 wait complete. 2024-09-13T18:45:32.283 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:45:32.325 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:32.328 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:32.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.384+0000 7f445d8d0640 1 Processor -- start 2024-09-13T18:45:32.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.384+0000 7f445d8d0640 1 -- start start 2024-09-13T18:45:32.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f445d8d0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f44580b9eb0 0x7f44580b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f445d8d0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f44580b5b30 0x7f44580b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f445d8d0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44580b29c0 con 0x7f445813d4e0 2024-09-13T18:45:32.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f445d8d0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44580b1a20 con 0x7f44580b5b30 2024-09-13T18:45:32.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f445d8d0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44580b1c20 con 0x7f44580b9eb0 2024-09-13T18:45:32.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f44567fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f44580b5b30 0x7f44580b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f44567fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f44580b5b30 0x7f44580b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43104/0 (socket says 172.21.15.29:43104) 2024-09-13T18:45:32.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f44567fc640 1 -- 172.21.15.29:0/1649472276 learned_addr learned my addr 172.21.15.29:0/1649472276 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:32.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f4456ffd640 1 --2- 172.21.15.29:0/1649472276 >> v2:172.21.15.96:3300/0 conn(0x7f44580b9eb0 0x7f44580b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f44567fc640 1 -- 172.21.15.29:0/1649472276 >> v2:172.21.15.96:3300/0 conn(0x7f44580b9eb0 msgr2=0x7f44580b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:32.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f44567fc640 1 --2- 172.21.15.29:0/1649472276 >> v2:172.21.15.96:3300/0 conn(0x7f44580b9eb0 0x7f44580b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f44567fc640 1 -- 172.21.15.29:0/1649472276 >> v1:172.21.15.96:6789/0 conn(0x7f445813d4e0 legacy=0x7f445813d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:32.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.385+0000 7f44567fc640 1 -- 172.21.15.29:0/1649472276 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44580ba290 con 0x7f44580b5b30 2024-09-13T18:45:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.386+0000 7f44567fc640 1 --2- 172.21.15.29:0/1649472276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44580b5b30 0x7f44580b35a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f44580ba4d0 tx=0x7f444c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e48016039c033b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.386+0000 7f4455ffb640 1 -- 172.21.15.29:0/1649472276 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c032440 con 0x7f44580b5b30 2024-09-13T18:45:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.386+0000 7f4455ffb640 1 -- 172.21.15.29:0/1649472276 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c0325a0 con 0x7f44580b5b30 2024-09-13T18:45:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.386+0000 7f4455ffb640 1 -- 172.21.15.29:0/1649472276 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c032930 con 0x7f44580b5b30 2024-09-13T18:45:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.387+0000 7f445d8d0640 1 -- 172.21.15.29:0/1649472276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44580b5b30 msgr2=0x7f44580b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.387+0000 7f445d8d0640 1 --2- 172.21.15.29:0/1649472276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44580b5b30 0x7f44580b35a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f44580ba4d0 tx=0x7f444c02a230 comp rx=0 tx=0).stop 2024-09-13T18:45:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.387+0000 7f445d8d0640 1 -- 172.21.15.29:0/1649472276 shutdown_connections 2024-09-13T18:45:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.387+0000 7f445d8d0640 1 --2- 172.21.15.29:0/1649472276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44580b5b30 0x7f44580b35a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.387+0000 7f445d8d0640 1 --2- 172.21.15.29:0/1649472276 >> v2:172.21.15.96:3300/0 conn(0x7f44580b9eb0 0x7f44580b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.387+0000 7f445d8d0640 1 -- 172.21.15.29:0/1649472276 >> 172.21.15.29:0/1649472276 conn(0x7f445806a4d0 msgr2=0x7f44580b9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.387+0000 7f445d8d0640 1 -- 172.21.15.29:0/1649472276 shutdown_connections 2024-09-13T18:45:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.387+0000 7f445d8d0640 1 -- 172.21.15.29:0/1649472276 wait complete. 2024-09-13T18:45:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.388+0000 7f445d8d0640 1 Processor -- start 2024-09-13T18:45:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.388+0000 7f445d8d0640 1 -- start start 2024-09-13T18:45:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.388+0000 7f445d8d0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44580b5b30 0x7f4458138db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.388+0000 7f445d8d0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44580b9eb0 0x7f445813dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.388+0000 7f445d8d0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f445813d4e0 0x7f445806afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.388+0000 7f445d8d0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44581c9e50 con 0x7f445813d4e0 2024-09-13T18:45:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.388+0000 7f445d8d0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44581cb410 con 0x7f44580b9eb0 2024-09-13T18:45:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.388+0000 7f445d8d0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44581c9790 con 0x7f44580b5b30 2024-09-13T18:45:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f44577fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f445813d4e0 0x7f445806afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f44577fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f445813d4e0 0x7f445806afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43112/0 (socket says 172.21.15.29:43112) 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f44577fe640 1 -- 172.21.15.29:0/3824084611 learned_addr learned my addr 172.21.15.29:0/3824084611 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f44567fc640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44580b9eb0 0x7f445813dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f4456ffd640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44580b5b30 0x7f4458138db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f44577fe640 1 -- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44580b5b30 msgr2=0x7f4458138db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f44577fe640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44580b5b30 0x7f4458138db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f44577fe640 1 -- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44580b9eb0 msgr2=0x7f445813dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f44577fe640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44580b9eb0 0x7f445813dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f44577fe640 1 -- 172.21.15.29:0/3824084611 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0094d0 con 0x7f445813d4e0 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f44577fe640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f445813d4e0 0x7f445806afe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f445000b970 tx=0x7f445000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f443ffff640 1 -- 172.21.15.29:0/3824084611 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445000cb40 con 0x7f445813d4e0 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f443ffff640 1 -- 172.21.15.29:0/3824084611 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445000cca0 con 0x7f445813d4e0 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f445d8d0640 1 -- 172.21.15.29:0/3824084611 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44581c9a70 con 0x7f445813d4e0 2024-09-13T18:45:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f443ffff640 1 -- 172.21.15.29:0/3824084611 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450014680 con 0x7f445813d4e0 2024-09-13T18:45:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.389+0000 7f445d8d0640 1 -- 172.21.15.29:0/3824084611 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445813cef0 con 0x7f445813d4e0 2024-09-13T18:45:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.390+0000 7f445d8d0640 1 -- 172.21.15.29:0/3824084611 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445813d930 con 0x7f445813d4e0 2024-09-13T18:45:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.391+0000 7f443ffff640 1 -- 172.21.15.29:0/3824084611 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f445001d3b0 con 0x7f445813d4e0 2024-09-13T18:45:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.391+0000 7f443ffff640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f444406ac00 0x7f444406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.391+0000 7f443ffff640 1 -- 172.21.15.29:0/3824084611 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4450089310 con 0x7f445813d4e0 2024-09-13T18:45:32.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.391+0000 7f4456ffd640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f444406ac00 0x7f444406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.392+0000 7f4456ffd640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f444406ac00 0x7f444406d0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4448006fd0 tx=0x7f4448008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.396+0000 7f443ffff640 1 -- 172.21.15.29:0/3824084611 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4450054340 con 0x7f445813d4e0 2024-09-13T18:45:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.576+0000 7f445d8d0640 1 -- 172.21.15.29:0/3824084611 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f44581446d0 con 0x7f445813d4e0 2024-09-13T18:45:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.576+0000 7f443ffff640 1 -- 172.21.15.29:0/3824084611 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4450057960 con 0x7f445813d4e0 2024-09-13T18:45:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-09-13T18:45:32.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.578+0000 7f445d8d0640 1 -- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f444406ac00 msgr2=0x7f444406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.578+0000 7f445d8d0640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f444406ac00 0x7f444406d0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4448006fd0 tx=0x7f4448008040 comp rx=0 tx=0).stop 2024-09-13T18:45:32.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.578+0000 7f445d8d0640 1 -- 172.21.15.29:0/3824084611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f445813d4e0 msgr2=0x7f445806afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.578+0000 7f445d8d0640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f445813d4e0 0x7f445806afe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f445000b970 tx=0x7f445000be30 comp rx=0 tx=0).stop 2024-09-13T18:45:32.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.578+0000 7f445d8d0640 1 -- 172.21.15.29:0/3824084611 shutdown_connections 2024-09-13T18:45:32.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.578+0000 7f445d8d0640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f444406ac00 0x7f444406d0c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.578+0000 7f445d8d0640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f445813d4e0 0x7f445806afe0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.578+0000 7f445d8d0640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44580b9eb0 0x7f445813dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.578+0000 7f445d8d0640 1 --2- 172.21.15.29:0/3824084611 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44580b5b30 0x7f4458138db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.578+0000 7f445d8d0640 1 -- 172.21.15.29:0/3824084611 >> 172.21.15.29:0/3824084611 conn(0x7f445806a4d0 msgr2=0x7f4458143b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:32.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.578+0000 7f445d8d0640 1 -- 172.21.15.29:0/3824084611 shutdown_connections 2024-09-13T18:45:32.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.578+0000 7f445d8d0640 1 -- 172.21.15.29:0/3824084611 wait complete. 2024-09-13T18:45:32.591 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:45:32.592 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:32.648 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:32.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.786+0000 7f57b759c640 1 Processor -- start 2024-09-13T18:45:32.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.786+0000 7f57b759c640 1 -- start start 2024-09-13T18:45:32.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b759c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f57b00b0cd0 0x7f57b0070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b759c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f57b0071900 0x7f57b00710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b759c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b006eab0 con 0x7f57b013d4f0 2024-09-13T18:45:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b759c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b006f3c0 con 0x7f57b00b0cd0 2024-09-13T18:45:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b759c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00b10b0 con 0x7f57b0071900 2024-09-13T18:45:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b5338640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f57b00b0cd0 0x7f57b0070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b5338640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f57b00b0cd0 0x7f57b0070bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43114/0 (socket says 172.21.15.29:43114) 2024-09-13T18:45:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b5338640 1 -- 172.21.15.29:0/1347249858 learned_addr learned my addr 172.21.15.29:0/1347249858 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b4b37640 1 --2- 172.21.15.29:0/1347249858 >> v2:172.21.15.96:3300/0 conn(0x7f57b0071900 0x7f57b00710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b5338640 1 -- 172.21.15.29:0/1347249858 >> v2:172.21.15.96:3300/0 conn(0x7f57b0071900 msgr2=0x7f57b00710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b5338640 1 --2- 172.21.15.29:0/1347249858 >> v2:172.21.15.96:3300/0 conn(0x7f57b0071900 0x7f57b00710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b5338640 1 -- 172.21.15.29:0/1347249858 >> v1:172.21.15.96:6789/0 conn(0x7f57b013d4f0 legacy=0x7f57b013d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b5338640 1 -- 172.21.15.29:0/1347249858 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b00702d0 con 0x7f57b00b0cd0 2024-09-13T18:45:32.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.787+0000 7f57b4b37640 1 --2- 172.21.15.29:0/1347249858 >> v2:172.21.15.96:3300/0 conn(0x7f57b0071900 0x7f57b00710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:32.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.788+0000 7f57b5338640 1 --2- 172.21.15.29:0/1347249858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b00b0cd0 0x7f57b0070bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f57b00ae720 tx=0x7f57ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2542b30de71f766 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.788+0000 7f57a7fff640 1 -- 172.21.15.29:0/1347249858 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac032440 con 0x7f57b00b0cd0 2024-09-13T18:45:32.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.788+0000 7f57a7fff640 1 -- 172.21.15.29:0/1347249858 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac0325a0 con 0x7f57b00b0cd0 2024-09-13T18:45:32.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.788+0000 7f57a7fff640 1 -- 172.21.15.29:0/1347249858 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac032930 con 0x7f57b00b0cd0 2024-09-13T18:45:32.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.788+0000 7f57b759c640 1 -- 172.21.15.29:0/1347249858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b00b0cd0 msgr2=0x7f57b0070bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.788+0000 7f57b759c640 1 --2- 172.21.15.29:0/1347249858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b00b0cd0 0x7f57b0070bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f57b00ae720 tx=0x7f57ac02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.789+0000 7f57b759c640 1 -- 172.21.15.29:0/1347249858 shutdown_connections 2024-09-13T18:45:32.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.789+0000 7f57b759c640 1 --2- 172.21.15.29:0/1347249858 >> v2:172.21.15.96:3300/0 conn(0x7f57b0071900 0x7f57b00710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.789+0000 7f57b759c640 1 --2- 172.21.15.29:0/1347249858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b00b0cd0 0x7f57b0070bb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.789+0000 7f57b759c640 1 -- 172.21.15.29:0/1347249858 >> 172.21.15.29:0/1347249858 conn(0x7f57b006a890 msgr2=0x7f57b00b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:32.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.789+0000 7f57b759c640 1 -- 172.21.15.29:0/1347249858 shutdown_connections 2024-09-13T18:45:32.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.789+0000 7f57b759c640 1 -- 172.21.15.29:0/1347249858 wait complete. 2024-09-13T18:45:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.790+0000 7f57b759c640 1 Processor -- start 2024-09-13T18:45:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.790+0000 7f57b759c640 1 -- start start 2024-09-13T18:45:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.790+0000 7f57b759c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b0071900 0x7f57b00ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.790+0000 7f57b759c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57b00b0cd0 0x7f57b01cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.790+0000 7f57b759c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57b013d4f0 0x7f57b01dece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.790+0000 7f57b759c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00afff0 con 0x7f57b0071900 2024-09-13T18:45:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.790+0000 7f57b759c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00b0800 con 0x7f57b00b0cd0 2024-09-13T18:45:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.790+0000 7f57b759c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00b0240 con 0x7f57b013d4f0 2024-09-13T18:45:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.790+0000 7f57b5338640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b0071900 0x7f57b00ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57b5338640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b0071900 0x7f57b00ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43120/0 (socket says 172.21.15.29:43120) 2024-09-13T18:45:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57b5338640 1 -- 172.21.15.29:0/1619189455 learned_addr learned my addr 172.21.15.29:0/1619189455 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57b4b37640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57b00b0cd0 0x7f57b01cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57b5b39640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57b013d4f0 0x7f57b01dece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57b5338640 1 -- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57b013d4f0 msgr2=0x7f57b01dece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57b5338640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57b013d4f0 0x7f57b01dece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57b5338640 1 -- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57b00b0cd0 msgr2=0x7f57b01cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57b5338640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57b00b0cd0 0x7f57b01cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57b5338640 1 -- 172.21.15.29:0/1619189455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac0094d0 con 0x7f57b0071900 2024-09-13T18:45:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57b5338640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b0071900 0x7f57b00ae210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57ac000c00 tx=0x7f57ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57a5ffb640 1 -- 172.21.15.29:0/1619189455 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac032440 con 0x7f57b0071900 2024-09-13T18:45:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57a5ffb640 1 -- 172.21.15.29:0/1619189455 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac030ba0 con 0x7f57b0071900 2024-09-13T18:45:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57a5ffb640 1 -- 172.21.15.29:0/1619189455 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac03d440 con 0x7f57b0071900 2024-09-13T18:45:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57b759c640 1 -- 172.21.15.29:0/1619189455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b00b0520 con 0x7f57b0071900 2024-09-13T18:45:32.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.791+0000 7f57b759c640 1 -- 172.21.15.29:0/1619189455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b01cc370 con 0x7f57b0071900 2024-09-13T18:45:32.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.792+0000 7f57b759c640 1 -- 172.21.15.29:0/1619189455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b01dea00 con 0x7f57b0071900 2024-09-13T18:45:32.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.793+0000 7f57a5ffb640 1 -- 172.21.15.29:0/1619189455 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f57ac039040 con 0x7f57b0071900 2024-09-13T18:45:32.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.793+0000 7f57a5ffb640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f579406ac00 0x7f579406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.793+0000 7f57a5ffb640 1 -- 172.21.15.29:0/1619189455 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57ac0aa0e0 con 0x7f57b0071900 2024-09-13T18:45:32.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.794+0000 7f57b4b37640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f579406ac00 0x7f579406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.794+0000 7f57b4b37640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f579406ac00 0x7f579406d0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f57b006fdc0 tx=0x7f57a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.798+0000 7f57a5ffb640 1 -- 172.21.15.29:0/1619189455 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f57b01dea00 con 0x7f57b0071900 2024-09-13T18:45:32.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.971+0000 7f57b759c640 1 -- 172.21.15.29:0/1619189455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57b01dea00 con 0x7f57b0071900 2024-09-13T18:45:32.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.972+0000 7f57a5ffb640 1 -- 172.21.15.29:0/1619189455 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7f57b01dea00 con 0x7f57b0071900 2024-09-13T18:45:32.975 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:32.975 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:32.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.974+0000 7f57b759c640 1 -- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f579406ac00 msgr2=0x7f579406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.974+0000 7f57b759c640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f579406ac00 0x7f579406d0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f57b006fdc0 tx=0x7f57a0008040 comp rx=0 tx=0).stop 2024-09-13T18:45:32.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.974+0000 7f57b759c640 1 -- 172.21.15.29:0/1619189455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b0071900 msgr2=0x7f57b00ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.974+0000 7f57b759c640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b0071900 0x7f57b00ae210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57ac000c00 tx=0x7f57ac0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.974+0000 7f57b759c640 1 -- 172.21.15.29:0/1619189455 shutdown_connections 2024-09-13T18:45:32.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.974+0000 7f57b759c640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f579406ac00 0x7f579406d0c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.974+0000 7f57b759c640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57b013d4f0 0x7f57b01dece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.974+0000 7f57b759c640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57b00b0cd0 0x7f57b01cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.974+0000 7f57b759c640 1 --2- 172.21.15.29:0/1619189455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b0071900 0x7f57b00ae210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.974+0000 7f57b759c640 1 -- 172.21.15.29:0/1619189455 >> 172.21.15.29:0/1619189455 conn(0x7f57b006a890 msgr2=0x7f57b00b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:32.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.974+0000 7f57b759c640 1 -- 172.21.15.29:0/1619189455 shutdown_connections 2024-09-13T18:45:32.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:32.974+0000 7f57b759c640 1 -- 172.21.15.29:0/1619189455 wait complete. 2024-09-13T18:45:32.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:45:17.630827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:45:20.113248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:20.978194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:24.059966+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:45:32.988 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:33.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.090+0000 7f55e7d65640 1 Processor -- start 2024-09-13T18:45:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.090+0000 7f55e7d65640 1 -- start start 2024-09-13T18:45:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e7d65640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55e00b7b10 0x7f55e00b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e7d65640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f55e0146540 0x7f55e014d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e7d65640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e00b39a0 con 0x7f55e00b4310 2024-09-13T18:45:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e7d65640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e0072580 con 0x7f55e0146540 2024-09-13T18:45:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e7d65640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e00b6b80 con 0x7f55e00b7b10 2024-09-13T18:45:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e6302640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f55e0146540 0x7f55e014d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e5300640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f55e00b4310 0x7f55e0145e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:44986/0 (socket says 172.21.15.29:44986) 2024-09-13T18:45:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e5300640 1 -- 172.21.15.29:0/576576951 learned_addr learned my addr 172.21.15.29:0/576576951 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e5b01640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55e00b7b10 0x7f55e00b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e6302640 1 -- 172.21.15.29:0/576576951 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55e00b7b10 msgr2=0x7f55e00b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e6302640 1 --2- 172.21.15.29:0/576576951 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55e00b7b10 0x7f55e00b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e6302640 1 -- 172.21.15.29:0/576576951 >> v1:172.21.15.96:6789/0 conn(0x7f55e00b4310 legacy=0x7f55e0145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e6302640 1 -- 172.21.15.29:0/576576951 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e009d7e0 con 0x7f55e0146540 2024-09-13T18:45:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.091+0000 7f55e4aff640 1 -- 172.21.15.29:0/576576951 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862237940 0 0) 0x7f55e00b39a0 con 0x7f55e00b4310 2024-09-13T18:45:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.092+0000 7f55e6302640 1 --2- 172.21.15.29:0/576576951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e0146540 0x7f55e014d370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009dc0 tx=0x7f55d802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0026a967d4042ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.092+0000 7f55e4aff640 1 -- 172.21.15.29:0/576576951 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8007740 con 0x7f55e0146540 2024-09-13T18:45:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.092+0000 7f55e4aff640 1 -- 172.21.15.29:0/576576951 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d802d050 con 0x7f55e0146540 2024-09-13T18:45:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.092+0000 7f55e4aff640 1 -- 172.21.15.29:0/576576951 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8007ac0 con 0x7f55e0146540 2024-09-13T18:45:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.093+0000 7f55e7d65640 1 -- 172.21.15.29:0/576576951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e0146540 msgr2=0x7f55e014d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.093+0000 7f55e7d65640 1 --2- 172.21.15.29:0/576576951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e0146540 0x7f55e014d370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009dc0 tx=0x7f55d802a5f0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.093+0000 7f55e7d65640 1 -- 172.21.15.29:0/576576951 shutdown_connections 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.093+0000 7f55e7d65640 1 --2- 172.21.15.29:0/576576951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e0146540 0x7f55e014d370 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.093+0000 7f55e7d65640 1 --2- 172.21.15.29:0/576576951 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55e00b7b10 0x7f55e00b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.093+0000 7f55e7d65640 1 -- 172.21.15.29:0/576576951 >> 172.21.15.29:0/576576951 conn(0x7f55e006a2f0 msgr2=0x7f55e006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.093+0000 7f55e7d65640 1 -- 172.21.15.29:0/576576951 shutdown_connections 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.093+0000 7f55e7d65640 1 -- 172.21.15.29:0/576576951 wait complete. 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.094+0000 7f55e7d65640 1 Processor -- start 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.094+0000 7f55e7d65640 1 -- start start 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.094+0000 7f55e7d65640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55e00b4310 0x7f55e006b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.094+0000 7f55e7d65640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e00b7b10 0x7f55e008a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.094+0000 7f55e7d65640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e0146540 0x7f55e01db110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.094+0000 7f55e7d65640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e006bcd0 con 0x7f55e00b7b10 2024-09-13T18:45:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.094+0000 7f55e7d65640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e008af20 con 0x7f55e0146540 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.094+0000 7f55e7d65640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e0090b00 con 0x7f55e00b4310 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e5300640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e00b7b10 0x7f55e008a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e5b01640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55e00b4310 0x7f55e006b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e5300640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e00b7b10 0x7f55e008a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43132/0 (socket says 172.21.15.29:43132) 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e5b01640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55e00b4310 0x7f55e006b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:58524/0 (socket says 172.21.15.29:58524) 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e5300640 1 -- 172.21.15.29:0/637701623 learned_addr learned my addr 172.21.15.29:0/637701623 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e6302640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e0146540 0x7f55e01db110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e5b01640 1 -- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e0146540 msgr2=0x7f55e01db110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e5b01640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e0146540 0x7f55e01db110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e5b01640 1 -- 172.21.15.29:0/637701623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e00b7b10 msgr2=0x7f55e008a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e5b01640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e00b7b10 0x7f55e008a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e5b01640 1 -- 172.21.15.29:0/637701623 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d8009a70 con 0x7f55e00b4310 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e5300640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e00b7b10 0x7f55e008a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e5b01640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55e00b4310 0x7f55e006b790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00e850 tx=0x7f55dc00ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55d67fc640 1 -- 172.21.15.29:0/637701623 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0095b0 con 0x7f55e00b4310 2024-09-13T18:45:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55d67fc640 1 -- 172.21.15.29:0/637701623 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc00c940 con 0x7f55e00b4310 2024-09-13T18:45:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e7d65640 1 -- 172.21.15.29:0/637701623 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e008b170 con 0x7f55e00b4310 2024-09-13T18:45:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55d67fc640 1 -- 172.21.15.29:0/637701623 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00ccd0 con 0x7f55e00b4310 2024-09-13T18:45:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.095+0000 7f55e7d65640 1 -- 172.21.15.29:0/637701623 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e0089fd0 con 0x7f55e00b4310 2024-09-13T18:45:33.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.096+0000 7f55e7d65640 1 -- 172.21.15.29:0/637701623 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e00672b0 con 0x7f55e00b4310 2024-09-13T18:45:33.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.097+0000 7f55d67fc640 1 -- 172.21.15.29:0/637701623 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f55dc013470 con 0x7f55e00b4310 2024-09-13T18:45:33.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.097+0000 7f55d67fc640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f55c406ac00 0x7f55c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.097+0000 7f55d67fc640 1 -- 172.21.15.29:0/637701623 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f55dc089710 con 0x7f55e00b4310 2024-09-13T18:45:33.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.097+0000 7f55e5300640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f55c406ac00 0x7f55c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.098+0000 7f55e5300640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f55c406ac00 0x7f55c406d0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f55e008c170 tx=0x7f55d0007e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.102+0000 7f55d67fc640 1 -- 172.21.15.29:0/637701623 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f55dc0546e0 con 0x7f55e00b4310 2024-09-13T18:45:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.270+0000 7f55e7d65640 1 -- 172.21.15.29:0/637701623 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55e00b2e50 con 0x7f55e00b4310 2024-09-13T18:45:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.270+0000 7f55d67fc640 1 -- 172.21.15.29:0/637701623 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55dc057d00 con 0x7f55e00b4310 2024-09-13T18:45:33.273 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-09-13T18:45:33.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.272+0000 7f55e7d65640 1 -- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f55c406ac00 msgr2=0x7f55c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.272+0000 7f55e7d65640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f55c406ac00 0x7f55c406d0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f55e008c170 tx=0x7f55d0007e10 comp rx=0 tx=0).stop 2024-09-13T18:45:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.272+0000 7f55e7d65640 1 -- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55e00b4310 msgr2=0x7f55e006b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.272+0000 7f55e7d65640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55e00b4310 0x7f55e006b790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00e850 tx=0x7f55dc00ed10 comp rx=0 tx=0).stop 2024-09-13T18:45:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.272+0000 7f55e7d65640 1 -- 172.21.15.29:0/637701623 shutdown_connections 2024-09-13T18:45:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.272+0000 7f55e7d65640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f55c406ac00 0x7f55c406d0c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.272+0000 7f55e7d65640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55e0146540 0x7f55e01db110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.272+0000 7f55e7d65640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e00b7b10 0x7f55e008a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.272+0000 7f55e7d65640 1 --2- 172.21.15.29:0/637701623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55e00b4310 0x7f55e006b790 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.272+0000 7f55e7d65640 1 -- 172.21.15.29:0/637701623 >> 172.21.15.29:0/637701623 conn(0x7f55e006a2f0 msgr2=0x7f55e00b6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.272+0000 7f55e7d65640 1 -- 172.21.15.29:0/637701623 shutdown_connections 2024-09-13T18:45:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.272+0000 7f55e7d65640 1 -- 172.21.15.29:0/637701623 wait complete. 2024-09-13T18:45:33.285 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:45:33.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.387+0000 7f4046308640 1 Processor -- start 2024-09-13T18:45:33.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.387+0000 7f4046308640 1 -- start start 2024-09-13T18:45:33.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.387+0000 7f4046308640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f404013f5b0 0x7f40400b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.387+0000 7f4046308640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f40400b5280 0x7f4040145640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.387+0000 7f4046308640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40400b5d60 con 0x7f4040145b80 2024-09-13T18:45:33.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.387+0000 7f4046308640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404006d0c0 con 0x7f404013f5b0 2024-09-13T18:45:33.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.387+0000 7f4046308640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4040145fb0 con 0x7f40400b5280 2024-09-13T18:45:33.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.388+0000 7f403ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f404013f5b0 0x7f40400b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.388+0000 7f40448a5640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4040145b80 0x7f404006b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42890/0 (socket says 172.21.15.29:42890) 2024-09-13T18:45:33.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.388+0000 7f403ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f404013f5b0 0x7f40400b6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43146/0 (socket says 172.21.15.29:43146) 2024-09-13T18:45:33.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.388+0000 7f40448a5640 1 -- 172.21.15.29:0/753060758 learned_addr learned my addr 172.21.15.29:0/753060758 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:33.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.388+0000 7f403f7fe640 1 --2- 172.21.15.29:0/753060758 >> v2:172.21.15.96:3300/0 conn(0x7f40400b5280 0x7f4040145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.388+0000 7f403ffff640 1 -- 172.21.15.29:0/753060758 >> v2:172.21.15.96:3300/0 conn(0x7f40400b5280 msgr2=0x7f4040145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:33.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.388+0000 7f403ffff640 1 --2- 172.21.15.29:0/753060758 >> v2:172.21.15.96:3300/0 conn(0x7f40400b5280 0x7f4040145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.388+0000 7f403ffff640 1 -- 172.21.15.29:0/753060758 >> v1:172.21.15.29:6789/0 conn(0x7f4040145b80 legacy=0x7f404006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.388+0000 7f403ffff640 1 -- 172.21.15.29:0/753060758 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40400b5710 con 0x7f404013f5b0 2024-09-13T18:45:33.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.388+0000 7f403effd640 1 -- 172.21.15.29:0/753060758 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342207958 0 0) 0x7f40400b5d60 con 0x7f4040145b80 2024-09-13T18:45:33.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.389+0000 7f403ffff640 1 --2- 172.21.15.29:0/753060758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f404013f5b0 0x7f40400b6a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f404006c650 tx=0x7f403002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b8a7f82756339b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.389+0000 7f403effd640 1 -- 172.21.15.29:0/753060758 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403002ae60 con 0x7f404013f5b0 2024-09-13T18:45:33.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.389+0000 7f403effd640 1 -- 172.21.15.29:0/753060758 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4030032440 con 0x7f404013f5b0 2024-09-13T18:45:33.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.389+0000 7f403effd640 1 -- 172.21.15.29:0/753060758 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40300327d0 con 0x7f404013f5b0 2024-09-13T18:45:33.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.389+0000 7f4046308640 1 -- 172.21.15.29:0/753060758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f404013f5b0 msgr2=0x7f40400b6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.389+0000 7f4046308640 1 --2- 172.21.15.29:0/753060758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f404013f5b0 0x7f40400b6a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f404006c650 tx=0x7f403002a110 comp rx=0 tx=0).stop 2024-09-13T18:45:33.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.389+0000 7f4046308640 1 -- 172.21.15.29:0/753060758 shutdown_connections 2024-09-13T18:45:33.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.389+0000 7f4046308640 1 --2- 172.21.15.29:0/753060758 >> v2:172.21.15.96:3300/0 conn(0x7f40400b5280 0x7f4040145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.389+0000 7f4046308640 1 --2- 172.21.15.29:0/753060758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f404013f5b0 0x7f40400b6a60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.389+0000 7f4046308640 1 -- 172.21.15.29:0/753060758 >> 172.21.15.29:0/753060758 conn(0x7f404006a2f0 msgr2=0x7f404006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:33.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.389+0000 7f4046308640 1 -- 172.21.15.29:0/753060758 shutdown_connections 2024-09-13T18:45:33.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.389+0000 7f4046308640 1 -- 172.21.15.29:0/753060758 wait complete. 2024-09-13T18:45:33.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.390+0000 7f4046308640 1 Processor -- start 2024-09-13T18:45:33.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.391+0000 7f4046308640 1 -- start start 2024-09-13T18:45:33.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.391+0000 7f4046308640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f404013f5b0 0x7f4040141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.391+0000 7f4046308640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4040145b80 0x7f404006fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.391+0000 7f4046308640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40400b1580 0x7f4040070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.391+0000 7f4046308640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404013cf10 con 0x7f40400b1580 2024-09-13T18:45:33.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.391+0000 7f4046308640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404006f790 con 0x7f4040145b80 2024-09-13T18:45:33.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.391+0000 7f4046308640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404006e6f0 con 0x7f404013f5b0 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.391+0000 7f40448a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40400b1580 0x7f4040070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.391+0000 7f40448a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40400b1580 0x7f4040070160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43162/0 (socket says 172.21.15.29:43162) 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.391+0000 7f40448a5640 1 -- 172.21.15.29:0/2415860542 learned_addr learned my addr 172.21.15.29:0/2415860542 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.391+0000 7f403ffff640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f404013f5b0 0x7f4040141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.392+0000 7f403f7fe640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4040145b80 0x7f404006fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.392+0000 7f40448a5640 1 -- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f404013f5b0 msgr2=0x7f4040141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.392+0000 7f40448a5640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f404013f5b0 0x7f4040141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.392+0000 7f40448a5640 1 -- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4040145b80 msgr2=0x7f404006fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.392+0000 7f40448a5640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4040145b80 0x7f404006fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.392+0000 7f40448a5640 1 -- 172.21.15.29:0/2415860542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4030009400 con 0x7f40400b1580 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.392+0000 7f40448a5640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40400b1580 0x7f4040070160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f403800c730 tx=0x7f403800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.392+0000 7f403cff9640 1 -- 172.21.15.29:0/2415860542 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403800ce40 con 0x7f40400b1580 2024-09-13T18:45:33.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.392+0000 7f403cff9640 1 -- 172.21.15.29:0/2415860542 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403800a640 con 0x7f40400b1580 2024-09-13T18:45:33.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.392+0000 7f4046308640 1 -- 172.21.15.29:0/2415860542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404006e9d0 con 0x7f40400b1580 2024-09-13T18:45:33.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.392+0000 7f403cff9640 1 -- 172.21.15.29:0/2415860542 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403800aa30 con 0x7f40400b1580 2024-09-13T18:45:33.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.392+0000 7f4046308640 1 -- 172.21.15.29:0/2415860542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404006f420 con 0x7f40400b1580 2024-09-13T18:45:33.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.393+0000 7f4046308640 1 -- 172.21.15.29:0/2415860542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404006f8d0 con 0x7f40400b1580 2024-09-13T18:45:33.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.394+0000 7f403cff9640 1 -- 172.21.15.29:0/2415860542 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f403800ab90 con 0x7f40400b1580 2024-09-13T18:45:33.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.394+0000 7f403cff9640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f402c06ac30 0x7f402c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.394+0000 7f403cff9640 1 -- 172.21.15.29:0/2415860542 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4038088c90 con 0x7f40400b1580 2024-09-13T18:45:33.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.394+0000 7f403ffff640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f402c06ac30 0x7f402c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.395+0000 7f403ffff640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f402c06ac30 0x7f402c06d0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4030034000 tx=0x7f403002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.399+0000 7f403cff9640 1 -- 172.21.15.29:0/2415860542 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4038053cc0 con 0x7f40400b1580 2024-09-13T18:45:33.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.572+0000 7f4046308640 1 -- 172.21.15.29:0/2415860542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4040145620 con 0x7f40400b1580 2024-09-13T18:45:33.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.573+0000 7f403cff9640 1 -- 172.21.15.29:0/2415860542 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40380180a0 con 0x7f40400b1580 2024-09-13T18:45:33.575 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-13T18:45:33.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.575+0000 7f4046308640 1 -- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f402c06ac30 msgr2=0x7f402c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.575+0000 7f4046308640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f402c06ac30 0x7f402c06d0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4030034000 tx=0x7f403002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:33.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.575+0000 7f4046308640 1 -- 172.21.15.29:0/2415860542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40400b1580 msgr2=0x7f4040070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.575+0000 7f4046308640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40400b1580 0x7f4040070160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f403800c730 tx=0x7f403800cbf0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.575+0000 7f4046308640 1 -- 172.21.15.29:0/2415860542 shutdown_connections 2024-09-13T18:45:33.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.575+0000 7f4046308640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f402c06ac30 0x7f402c06d0f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.575+0000 7f4046308640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40400b1580 0x7f4040070160 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.575+0000 7f4046308640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4040145b80 0x7f404006fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.575+0000 7f4046308640 1 --2- 172.21.15.29:0/2415860542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f404013f5b0 0x7f4040141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.575+0000 7f4046308640 1 -- 172.21.15.29:0/2415860542 >> 172.21.15.29:0/2415860542 conn(0x7f404006a2f0 msgr2=0x7f40400b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:33.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.575+0000 7f4046308640 1 -- 172.21.15.29:0/2415860542 shutdown_connections 2024-09-13T18:45:33.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.575+0000 7f4046308640 1 -- 172.21.15.29:0/2415860542 wait complete. 2024-09-13T18:45:33.588 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:45:33.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.690+0000 7f7605e3a640 1 Processor -- start 2024-09-13T18:45:33.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.690+0000 7f7605e3a640 1 -- start start 2024-09-13T18:45:33.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f7605e3a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7600071ca0 0x7f76000b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f7605e3a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76000b0ba0 con 0x7f76000b0fc0 2024-09-13T18:45:33.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f7605e3a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7600072080 con 0x7f76000b4af0 2024-09-13T18:45:33.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f7605e3a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76000b14e0 con 0x7f7600071ca0 2024-09-13T18:45:33.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f75fffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f76000b0fc0 0x7f760014e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42896/0 (socket says 172.21.15.29:42896) 2024-09-13T18:45:33.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f75fffff640 1 -- 172.21.15.29:0/1956886485 learned_addr learned my addr 172.21.15.29:0/1956886485 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:33.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f75ff7fe640 1 --2- 172.21.15.29:0/1956886485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7600071ca0 0x7f76000b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f75fe7fc640 1 -- 172.21.15.29:0/1956886485 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153494819 0 0) 0x7f76000b0ba0 con 0x7f76000b0fc0 2024-09-13T18:45:33.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f75fe7fc640 1 -- 172.21.15.29:0/1956886485 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e8003520 con 0x7f76000b0fc0 2024-09-13T18:45:33.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f75fe7fc640 1 -- 172.21.15.29:0/1956886485 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526249357 0 0) 0x7f7600072080 con 0x7f76000b4af0 2024-09-13T18:45:33.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f75fe7fc640 1 -- 172.21.15.29:0/1956886485 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76000b0ba0 con 0x7f76000b4af0 2024-09-13T18:45:33.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f75ff7fe640 1 -- 172.21.15.29:0/1956886485 >> v1:172.21.15.96:6789/0 conn(0x7f76000b4af0 legacy=0x7f760013d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f75ff7fe640 1 -- 172.21.15.29:0/1956886485 >> v1:172.21.15.29:6789/0 conn(0x7f76000b0fc0 legacy=0x7f760014e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.691+0000 7f75ff7fe640 1 -- 172.21.15.29:0/1956886485 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76000b17c0 con 0x7f7600071ca0 2024-09-13T18:45:33.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.692+0000 7f75ff7fe640 1 --2- 172.21.15.29:0/1956886485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7600071ca0 0x7f76000b21e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009800 tx=0x7f75f002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=206cfaa923c59469 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.692+0000 7f75fe7fc640 1 -- 172.21.15.29:0/1956886485 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0032440 con 0x7f7600071ca0 2024-09-13T18:45:33.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.692+0000 7f75fe7fc640 1 -- 172.21.15.29:0/1956886485 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f00325a0 con 0x7f7600071ca0 2024-09-13T18:45:33.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.692+0000 7f75fe7fc640 1 -- 172.21.15.29:0/1956886485 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0032910 con 0x7f7600071ca0 2024-09-13T18:45:33.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.693+0000 7f7605e3a640 1 -- 172.21.15.29:0/1956886485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7600071ca0 msgr2=0x7f76000b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.693+0000 7f7605e3a640 1 --2- 172.21.15.29:0/1956886485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7600071ca0 0x7f76000b21e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009800 tx=0x7f75f002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.693+0000 7f7605e3a640 1 -- 172.21.15.29:0/1956886485 shutdown_connections 2024-09-13T18:45:33.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.693+0000 7f7605e3a640 1 --2- 172.21.15.29:0/1956886485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7600071ca0 0x7f76000b21e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.693+0000 7f7605e3a640 1 -- 172.21.15.29:0/1956886485 >> 172.21.15.29:0/1956886485 conn(0x7f76000b8440 msgr2=0x7f76000b8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:33.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.693+0000 7f7605e3a640 1 -- 172.21.15.29:0/1956886485 shutdown_connections 2024-09-13T18:45:33.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.693+0000 7f7605e3a640 1 -- 172.21.15.29:0/1956886485 wait complete. 2024-09-13T18:45:33.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.694+0000 7f7605e3a640 1 Processor -- start 2024-09-13T18:45:33.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.694+0000 7f7605e3a640 1 -- start start 2024-09-13T18:45:33.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f7605e3a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7600071ca0 0x7f76001de7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f7605e3a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76000b0fc0 0x7f76001df040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f7605e3a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76000b4af0 0x7f76001db000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f7605e3a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7600071880 con 0x7f76000b0fc0 2024-09-13T18:45:33.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f7605e3a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760013f250 con 0x7f76000b4af0 2024-09-13T18:45:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f7605e3a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76000714e0 con 0x7f7600071ca0 2024-09-13T18:45:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75feffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76000b0fc0 0x7f76001df040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75feffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76000b0fc0 0x7f76001df040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43174/0 (socket says 172.21.15.29:43174) 2024-09-13T18:45:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75feffd640 1 -- 172.21.15.29:0/3095550080 learned_addr learned my addr 172.21.15.29:0/3095550080 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75ff7fe640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7600071ca0 0x7f76001de7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75fffff640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76000b4af0 0x7f76001db000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75feffd640 1 -- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7600071ca0 msgr2=0x7f76001de7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75feffd640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7600071ca0 0x7f76001de7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75feffd640 1 -- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76000b4af0 msgr2=0x7f76001db000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75feffd640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76000b4af0 0x7f76001db000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75feffd640 1 -- 172.21.15.29:0/3095550080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f0009400 con 0x7f76000b0fc0 2024-09-13T18:45:33.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75feffd640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76000b0fc0 0x7f76001df040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f75f400c3c0 tx=0x7f75f400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75e7fff640 1 -- 172.21.15.29:0/3095550080 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40052d0 con 0x7f76000b0fc0 2024-09-13T18:45:33.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75e7fff640 1 -- 172.21.15.29:0/3095550080 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f4005450 con 0x7f76000b0fc0 2024-09-13T18:45:33.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.695+0000 7f75e7fff640 1 -- 172.21.15.29:0/3095550080 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4003830 con 0x7f76000b0fc0 2024-09-13T18:45:33.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.696+0000 7f7605e3a640 1 -- 172.21.15.29:0/3095550080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760013e440 con 0x7f76000b0fc0 2024-09-13T18:45:33.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.696+0000 7f7605e3a640 1 -- 172.21.15.29:0/3095550080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760013dff0 con 0x7f76000b0fc0 2024-09-13T18:45:33.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.697+0000 7f7605e3a640 1 -- 172.21.15.29:0/3095550080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760013e270 con 0x7f76000b0fc0 2024-09-13T18:45:33.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.697+0000 7f75e7fff640 1 -- 172.21.15.29:0/3095550080 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f75f4003990 con 0x7f76000b0fc0 2024-09-13T18:45:33.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.698+0000 7f75e7fff640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f75ec06ac00 0x7f75ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.698+0000 7f75e7fff640 1 -- 172.21.15.29:0/3095550080 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75f4088a80 con 0x7f76000b0fc0 2024-09-13T18:45:33.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.698+0000 7f75ff7fe640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f75ec06ac00 0x7f75ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.698+0000 7f75ff7fe640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f75ec06ac00 0x7f75ec06d0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f75f0034000 tx=0x7f75f002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.702+0000 7f75e7fff640 1 -- 172.21.15.29:0/3095550080 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f75f4053b70 con 0x7f76000b0fc0 2024-09-13T18:45:33.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.872+0000 7f7605e3a640 1 -- 172.21.15.29:0/3095550080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f76000b21e0 con 0x7f76000b0fc0 2024-09-13T18:45:33.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.872+0000 7f75e7fff640 1 -- 172.21.15.29:0/3095550080 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f75f40170a0 con 0x7f76000b0fc0 2024-09-13T18:45:33.875 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-09-13T18:45:33.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.874+0000 7f7605e3a640 1 -- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f75ec06ac00 msgr2=0x7f75ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.874+0000 7f7605e3a640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f75ec06ac00 0x7f75ec06d0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f75f0034000 tx=0x7f75f002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:33.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.874+0000 7f7605e3a640 1 -- 172.21.15.29:0/3095550080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76000b0fc0 msgr2=0x7f76001df040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.874+0000 7f7605e3a640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76000b0fc0 0x7f76001df040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f75f400c3c0 tx=0x7f75f400c880 comp rx=0 tx=0).stop 2024-09-13T18:45:33.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.874+0000 7f7605e3a640 1 -- 172.21.15.29:0/3095550080 shutdown_connections 2024-09-13T18:45:33.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.874+0000 7f7605e3a640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f75ec06ac00 0x7f75ec06d0c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.874+0000 7f7605e3a640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76000b4af0 0x7f76001db000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.874+0000 7f7605e3a640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76000b0fc0 0x7f76001df040 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.874+0000 7f7605e3a640 1 --2- 172.21.15.29:0/3095550080 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7600071ca0 0x7f76001de7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.874+0000 7f7605e3a640 1 -- 172.21.15.29:0/3095550080 >> 172.21.15.29:0/3095550080 conn(0x7f76000b8440 msgr2=0x7f760013b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:33.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.874+0000 7f7605e3a640 1 -- 172.21.15.29:0/3095550080 shutdown_connections 2024-09-13T18:45:33.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.874+0000 7f7605e3a640 1 -- 172.21.15.29:0/3095550080 wait complete. 2024-09-13T18:45:33.888 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:45:33.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.989+0000 7f1b4bf5a640 1 Processor -- start 2024-09-13T18:45:33.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.989+0000 7f1b4bf5a640 1 -- start start 2024-09-13T18:45:33.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.990+0000 7f1b4bf5a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1b440b4ae0 0x7f1b44070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.990+0000 7f1b4bf5a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b44140290 con 0x7f1b4413f6f0 2024-09-13T18:45:33.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.990+0000 7f1b4bf5a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b44071300 con 0x7f1b4406a140 2024-09-13T18:45:33.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.990+0000 7f1b4bf5a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4406a520 con 0x7f1b440b4ae0 2024-09-13T18:45:33.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.990+0000 7f1b494f5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1b440b4ae0 0x7f1b44070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.990+0000 7f1b4a4f7640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1b4413f6f0 0x7f1b4413fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42898/0 (socket says 172.21.15.29:42898) 2024-09-13T18:45:33.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.990+0000 7f1b4a4f7640 1 -- 172.21.15.29:0/3725057215 learned_addr learned my addr 172.21.15.29:0/3725057215 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:33.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.990+0000 7f1b494f5640 1 -- 172.21.15.29:0/3725057215 >> v1:172.21.15.96:6789/0 conn(0x7f1b4406a140 legacy=0x7f1b440b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:33.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.990+0000 7f1b494f5640 1 -- 172.21.15.29:0/3725057215 >> v1:172.21.15.29:6789/0 conn(0x7f1b4413f6f0 legacy=0x7f1b4413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.990+0000 7f1b494f5640 1 -- 172.21.15.29:0/3725057215 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b44071e70 con 0x7f1b440b4ae0 2024-09-13T18:45:33.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.991+0000 7f1b494f5640 1 --2- 172.21.15.29:0/3725057215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b440b4ae0 0x7f1b44070140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1b380097a0 tx=0x7f1b3802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52540605cb602ac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.991+0000 7f1b48cf4640 1 -- 172.21.15.29:0/3725057215 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3802ae50 con 0x7f1b440b4ae0 2024-09-13T18:45:33.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.991+0000 7f1b48cf4640 1 -- 172.21.15.29:0/3725057215 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b38032440 con 0x7f1b440b4ae0 2024-09-13T18:45:33.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.991+0000 7f1b48cf4640 1 -- 172.21.15.29:0/3725057215 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b380327d0 con 0x7f1b440b4ae0 2024-09-13T18:45:33.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.992+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/3725057215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b440b4ae0 msgr2=0x7f1b44070140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.992+0000 7f1b4bf5a640 1 --2- 172.21.15.29:0/3725057215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b440b4ae0 0x7f1b44070140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1b380097a0 tx=0x7f1b3802a140 comp rx=0 tx=0).stop 2024-09-13T18:45:33.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.992+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/3725057215 shutdown_connections 2024-09-13T18:45:33.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.992+0000 7f1b4bf5a640 1 --2- 172.21.15.29:0/3725057215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b440b4ae0 0x7f1b44070140 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.992+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/3725057215 >> 172.21.15.29:0/3725057215 conn(0x7f1b440b8440 msgr2=0x7f1b440b8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:33.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.992+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/3725057215 shutdown_connections 2024-09-13T18:45:33.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.992+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/3725057215 wait complete. 2024-09-13T18:45:33.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.993+0000 7f1b4bf5a640 1 Processor -- start 2024-09-13T18:45:33.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.993+0000 7f1b4bf5a640 1 -- start start 2024-09-13T18:45:33.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.993+0000 7f1b4bf5a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b4406a140 0x7f1b440b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.993+0000 7f1b4bf5a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b440b4ae0 0x7f1b44147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.993+0000 7f1b4bf5a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b4413f6f0 0x7f1b440af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.993+0000 7f1b4bf5a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b440b1ec0 con 0x7f1b4406a140 2024-09-13T18:45:33.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.993+0000 7f1b4bf5a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b440b0ea0 con 0x7f1b4413f6f0 2024-09-13T18:45:33.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.993+0000 7f1b4bf5a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b44141620 con 0x7f1b440b4ae0 2024-09-13T18:45:33.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.993+0000 7f1b49cf6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b4406a140 0x7f1b440b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.993+0000 7f1b49cf6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b4406a140 0x7f1b440b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43184/0 (socket says 172.21.15.29:43184) 2024-09-13T18:45:33.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.993+0000 7f1b49cf6640 1 -- 172.21.15.29:0/2232346133 learned_addr learned my addr 172.21.15.29:0/2232346133 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:33.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b4a4f7640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b4413f6f0 0x7f1b440af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b494f5640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b440b4ae0 0x7f1b44147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b49cf6640 1 -- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b440b4ae0 msgr2=0x7f1b44147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b49cf6640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b440b4ae0 0x7f1b44147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b49cf6640 1 -- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b4413f6f0 msgr2=0x7f1b440af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b49cf6640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b4413f6f0 0x7f1b440af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b49cf6640 1 -- 172.21.15.29:0/2232346133 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38009400 con 0x7f1b4406a140 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b49cf6640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b4406a140 0x7f1b440b2370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000c410 tx=0x7f1b4000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b367fc640 1 -- 172.21.15.29:0/2232346133 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b400035f0 con 0x7f1b4406a140 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b367fc640 1 -- 172.21.15.29:0/2232346133 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b40003750 con 0x7f1b4406a140 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/2232346133 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b440b1140 con 0x7f1b4406a140 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b367fc640 1 -- 172.21.15.29:0/2232346133 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40003b40 con 0x7f1b4406a140 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.994+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/2232346133 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b440aebc0 con 0x7f1b4406a140 2024-09-13T18:45:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.995+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/2232346133 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b44070140 con 0x7f1b4406a140 2024-09-13T18:45:34.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.996+0000 7f1b367fc640 1 -- 172.21.15.29:0/2232346133 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1b40003ca0 con 0x7f1b4406a140 2024-09-13T18:45:34.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.996+0000 7f1b367fc640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1b2806ac30 0x7f1b2806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.996+0000 7f1b367fc640 1 -- 172.21.15.29:0/2232346133 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1b40088bd0 con 0x7f1b4406a140 2024-09-13T18:45:34.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.996+0000 7f1b494f5640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1b2806ac30 0x7f1b2806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:33.997+0000 7f1b494f5640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1b2806ac30 0x7f1b2806d0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1b38034000 tx=0x7f1b3802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.000+0000 7f1b367fc640 1 -- 172.21.15.29:0/2232346133 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1b40053c00 con 0x7f1b4406a140 2024-09-13T18:45:34.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.173+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/2232346133 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1b4406bff0 con 0x7f1b4406a140 2024-09-13T18:45:34.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.174+0000 7f1b367fc640 1 -- 172.21.15.29:0/2232346133 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1b40017020 con 0x7f1b4406a140 2024-09-13T18:45:34.177 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-13T18:45:34.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.176+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1b2806ac30 msgr2=0x7f1b2806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.176+0000 7f1b4bf5a640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1b2806ac30 0x7f1b2806d0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1b38034000 tx=0x7f1b3802e000 comp rx=0 tx=0).stop 2024-09-13T18:45:34.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.176+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/2232346133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b4406a140 msgr2=0x7f1b440b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.176+0000 7f1b4bf5a640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b4406a140 0x7f1b440b2370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000c410 tx=0x7f1b4000c8d0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.176+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/2232346133 shutdown_connections 2024-09-13T18:45:34.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.176+0000 7f1b4bf5a640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1b2806ac30 0x7f1b2806d0f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.176+0000 7f1b4bf5a640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b4413f6f0 0x7f1b440af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.176+0000 7f1b4bf5a640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b440b4ae0 0x7f1b44147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.176+0000 7f1b4bf5a640 1 --2- 172.21.15.29:0/2232346133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b4406a140 0x7f1b440b2370 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.176+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/2232346133 >> 172.21.15.29:0/2232346133 conn(0x7f1b440b8440 msgr2=0x7f1b440b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:34.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.176+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/2232346133 shutdown_connections 2024-09-13T18:45:34.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.176+0000 7f1b4bf5a640 1 -- 172.21.15.29:0/2232346133 wait complete. 2024-09-13T18:45:34.190 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:45:34.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.290+0000 7f20486b1640 1 Processor -- start 2024-09-13T18:45:34.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.290+0000 7f20486b1640 1 -- start start 2024-09-13T18:45:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.291+0000 7f20486b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20401468b0 0x7f204013fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.291+0000 7f20486b1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20400b29d0 0x7f20400b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.291+0000 7f20486b1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20400b49f0 con 0x7f20400b1ff0 2024-09-13T18:45:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.291+0000 7f20486b1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2040145bc0 con 0x7f20400b29d0 2024-09-13T18:45:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.291+0000 7f20486b1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20400b23d0 con 0x7f20401468b0 2024-09-13T18:45:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.291+0000 7f2046c4e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20400b29d0 0x7f20400b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.291+0000 7f2045c4c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20401468b0 0x7f204013fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.291+0000 7f204644d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f20400b1ff0 0x7f204013f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:36678/0 (socket says 172.21.15.29:36678) 2024-09-13T18:45:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.291+0000 7f204644d640 1 -- 172.21.15.29:0/1375729850 learned_addr learned my addr 172.21.15.29:0/1375729850 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.292+0000 7f2046c4e640 1 -- 172.21.15.29:0/1375729850 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20401468b0 msgr2=0x7f204013fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.292+0000 7f2046c4e640 1 --2- 172.21.15.29:0/1375729850 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20401468b0 0x7f204013fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.292+0000 7f2046c4e640 1 -- 172.21.15.29:0/1375729850 >> v1:172.21.15.96:6789/0 conn(0x7f20400b1ff0 legacy=0x7f204013f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.292+0000 7f204544b640 1 -- 172.21.15.29:0/1375729850 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038735374 0 0) 0x7f20400b49f0 con 0x7f20400b1ff0 2024-09-13T18:45:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.292+0000 7f2046c4e640 1 -- 172.21.15.29:0/1375729850 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20400b5730 con 0x7f20400b29d0 2024-09-13T18:45:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.292+0000 7f2046c4e640 1 --2- 172.21.15.29:0/1375729850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20400b29d0 0x7f20400b44b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2038009d90 tx=0x7f203802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9db8fc1540b0264 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.293+0000 7f204544b640 1 -- 172.21.15.29:0/1375729850 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038031600 con 0x7f20400b29d0 2024-09-13T18:45:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.293+0000 7f204544b640 1 -- 172.21.15.29:0/1375729850 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203802d050 con 0x7f20400b29d0 2024-09-13T18:45:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.293+0000 7f204544b640 1 -- 172.21.15.29:0/1375729850 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038031980 con 0x7f20400b29d0 2024-09-13T18:45:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.293+0000 7f20486b1640 1 -- 172.21.15.29:0/1375729850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20400b29d0 msgr2=0x7f20400b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.293+0000 7f20486b1640 1 --2- 172.21.15.29:0/1375729850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20400b29d0 0x7f20400b44b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2038009d90 tx=0x7f203802a5d0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.293+0000 7f20486b1640 1 -- 172.21.15.29:0/1375729850 shutdown_connections 2024-09-13T18:45:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.293+0000 7f20486b1640 1 --2- 172.21.15.29:0/1375729850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20400b29d0 0x7f20400b44b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.293+0000 7f20486b1640 1 --2- 172.21.15.29:0/1375729850 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20401468b0 0x7f204013fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.293+0000 7f20486b1640 1 -- 172.21.15.29:0/1375729850 >> 172.21.15.29:0/1375729850 conn(0x7f20400bb4b0 msgr2=0x7f20400bb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.293+0000 7f20486b1640 1 -- 172.21.15.29:0/1375729850 shutdown_connections 2024-09-13T18:45:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.293+0000 7f20486b1640 1 -- 172.21.15.29:0/1375729850 wait complete. 2024-09-13T18:45:34.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.294+0000 7f20486b1640 1 Processor -- start 2024-09-13T18:45:34.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.294+0000 7f20486b1640 1 -- start start 2024-09-13T18:45:34.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f20486b1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20400b1ff0 0x7f20401428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f20486b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20400b29d0 0x7f20400aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f20486b1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20401468b0 0x7f20400a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f20486b1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20400ab3f0 con 0x7f20401468b0 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f20486b1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20401db9d0 con 0x7f20400b1ff0 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f20486b1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20401dbcb0 con 0x7f20400b29d0 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f2046c4e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20401468b0 0x7f20400a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f2046c4e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20401468b0 0x7f20400a7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58904/0 (socket says 172.21.15.29:58904) 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f2046c4e640 1 -- 172.21.15.29:0/14004846 learned_addr learned my addr 172.21.15.29:0/14004846 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f2045c4c640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20400b29d0 0x7f20400aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f204644d640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20400b1ff0 0x7f20401428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f2046c4e640 1 -- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20400b29d0 msgr2=0x7f20400aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f2046c4e640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20400b29d0 0x7f20400aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f2046c4e640 1 -- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20400b1ff0 msgr2=0x7f20401428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f2046c4e640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20400b1ff0 0x7f20401428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.295+0000 7f2046c4e640 1 -- 172.21.15.29:0/14004846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038009a70 con 0x7f20401468b0 2024-09-13T18:45:34.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.296+0000 7f2046c4e640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20401468b0 0x7f20400a7c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2038009eb0 tx=0x7f2038004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.296+0000 7f2036ffd640 1 -- 172.21.15.29:0/14004846 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203803c830 con 0x7f20401468b0 2024-09-13T18:45:34.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.296+0000 7f2036ffd640 1 -- 172.21.15.29:0/14004846 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203803c990 con 0x7f20401468b0 2024-09-13T18:45:34.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.296+0000 7f20486b1640 1 -- 172.21.15.29:0/14004846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20401dbf90 con 0x7f20401468b0 2024-09-13T18:45:34.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.296+0000 7f2036ffd640 1 -- 172.21.15.29:0/14004846 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203803cd00 con 0x7f20401468b0 2024-09-13T18:45:34.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.296+0000 7f20486b1640 1 -- 172.21.15.29:0/14004846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2040143290 con 0x7f20401468b0 2024-09-13T18:45:34.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.297+0000 7f20486b1640 1 -- 172.21.15.29:0/14004846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2040067300 con 0x7f20401468b0 2024-09-13T18:45:34.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.297+0000 7f2036ffd640 1 -- 172.21.15.29:0/14004846 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f203803b3b0 con 0x7f20401468b0 2024-09-13T18:45:34.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.298+0000 7f2036ffd640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f202406ac00 0x7f202406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.298+0000 7f2036ffd640 1 -- 172.21.15.29:0/14004846 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f20380aaef0 con 0x7f20401468b0 2024-09-13T18:45:34.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.298+0000 7f204644d640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f202406ac00 0x7f202406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.298+0000 7f204644d640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f202406ac00 0x7f202406d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f203c000f60 tx=0x7f203c007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.302+0000 7f2036ffd640 1 -- 172.21.15.29:0/14004846 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2038079930 con 0x7f20401468b0 2024-09-13T18:45:34.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.484+0000 7f20486b1640 1 -- 172.21.15.29:0/14004846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f20400b4c60 con 0x7f20401468b0 2024-09-13T18:45:34.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.485+0000 7f2036ffd640 1 -- 172.21.15.29:0/14004846 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f203803ce60 con 0x7f20401468b0 2024-09-13T18:45:34.487 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-09-13T18:45:34.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.487+0000 7f20486b1640 1 -- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f202406ac00 msgr2=0x7f202406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.487+0000 7f20486b1640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f202406ac00 0x7f202406d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f203c000f60 tx=0x7f203c007d50 comp rx=0 tx=0).stop 2024-09-13T18:45:34.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.487+0000 7f20486b1640 1 -- 172.21.15.29:0/14004846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20401468b0 msgr2=0x7f20400a7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.487+0000 7f20486b1640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20401468b0 0x7f20400a7c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2038009eb0 tx=0x7f2038004a40 comp rx=0 tx=0).stop 2024-09-13T18:45:34.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.487+0000 7f20486b1640 1 -- 172.21.15.29:0/14004846 shutdown_connections 2024-09-13T18:45:34.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.487+0000 7f20486b1640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f202406ac00 0x7f202406d0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.487+0000 7f20486b1640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20401468b0 0x7f20400a7c80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.487+0000 7f20486b1640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20400b29d0 0x7f20400aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.487+0000 7f20486b1640 1 --2- 172.21.15.29:0/14004846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20400b1ff0 0x7f20401428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.487+0000 7f20486b1640 1 -- 172.21.15.29:0/14004846 >> 172.21.15.29:0/14004846 conn(0x7f20400bb4b0 msgr2=0x7f2040144160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:34.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.487+0000 7f20486b1640 1 -- 172.21.15.29:0/14004846 shutdown_connections 2024-09-13T18:45:34.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:34.487+0000 7f20486b1640 1 -- 172.21.15.29:0/14004846 wait complete. 2024-09-13T18:45:34.500 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-09-13T18:45:34.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:34.501 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:34.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[41332]: fuse finished with error 0 and tester_r 0 2024-09-13T18:45:34.527 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:40.629 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:45:40.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:40.629 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T18:45:40.654 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:40.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.802+0000 7f0650be2640 1 Processor -- start 2024-09-13T18:45:40.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.802+0000 7f0650be2640 1 -- start start 2024-09-13T18:45:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.803+0000 7f0650be2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064c0b0cd0 0x7f064c070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.803+0000 7f0650be2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f064c071900 0x7f064c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.803+0000 7f0650be2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c06eab0 con 0x7f064c13d4f0 2024-09-13T18:45:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.803+0000 7f0650be2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c06f3c0 con 0x7f064c071900 2024-09-13T18:45:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.803+0000 7f0650be2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0b10b0 con 0x7f064c0b0cd0 2024-09-13T18:45:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.803+0000 7f0649d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f064c071900 0x7f064c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.803+0000 7f0649d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f064c071900 0x7f064c0710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58912/0 (socket says 172.21.15.29:58912) 2024-09-13T18:45:40.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.803+0000 7f0649d9b640 1 -- 172.21.15.29:0/1813352129 learned_addr learned my addr 172.21.15.29:0/1813352129 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:40.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.803+0000 7f064a59c640 1 --2- 172.21.15.29:0/1813352129 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064c0b0cd0 0x7f064c070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.804+0000 7f0649d9b640 1 -- 172.21.15.29:0/1813352129 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064c0b0cd0 msgr2=0x7f064c070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:40.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.804+0000 7f0649d9b640 1 --2- 172.21.15.29:0/1813352129 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064c0b0cd0 0x7f064c070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.804+0000 7f0649d9b640 1 -- 172.21.15.29:0/1813352129 >> v1:172.21.15.96:6789/0 conn(0x7f064c13d4f0 legacy=0x7f064c13d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.804+0000 7f0649d9b640 1 -- 172.21.15.29:0/1813352129 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c0702d0 con 0x7f064c071900 2024-09-13T18:45:40.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.804+0000 7f0649d9b640 1 --2- 172.21.15.29:0/1813352129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064c071900 0x7f064c0710f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0640009870 tx=0x7f064002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b13fbcacda06994 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.804+0000 7f064959a640 1 -- 172.21.15.29:0/1813352129 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0640032440 con 0x7f064c071900 2024-09-13T18:45:40.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.804+0000 7f064959a640 1 -- 172.21.15.29:0/1813352129 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06400325a0 con 0x7f064c071900 2024-09-13T18:45:40.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.805+0000 7f064959a640 1 -- 172.21.15.29:0/1813352129 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0640032930 con 0x7f064c071900 2024-09-13T18:45:40.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.805+0000 7f0650be2640 1 -- 172.21.15.29:0/1813352129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064c071900 msgr2=0x7f064c0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.805+0000 7f0650be2640 1 --2- 172.21.15.29:0/1813352129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064c071900 0x7f064c0710f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0640009870 tx=0x7f064002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.805+0000 7f0650be2640 1 -- 172.21.15.29:0/1813352129 shutdown_connections 2024-09-13T18:45:40.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.805+0000 7f0650be2640 1 --2- 172.21.15.29:0/1813352129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064c071900 0x7f064c0710f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.805+0000 7f0650be2640 1 --2- 172.21.15.29:0/1813352129 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064c0b0cd0 0x7f064c070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.805+0000 7f0650be2640 1 -- 172.21.15.29:0/1813352129 >> 172.21.15.29:0/1813352129 conn(0x7f064c06a890 msgr2=0x7f064c0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.805+0000 7f0650be2640 1 -- 172.21.15.29:0/1813352129 shutdown_connections 2024-09-13T18:45:40.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.805+0000 7f0650be2640 1 -- 172.21.15.29:0/1813352129 wait complete. 2024-09-13T18:45:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.806+0000 7f0650be2640 1 Processor -- start 2024-09-13T18:45:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.806+0000 7f0650be2640 1 -- start start 2024-09-13T18:45:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.807+0000 7f0650be2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064c071900 0x7f064c1cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.807+0000 7f0650be2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f064c0b0cd0 0x7f064c0a7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.807+0000 7f0650be2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064c13d4f0 0x7f064c144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.807+0000 7f0650be2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0a8f30 con 0x7f064c071900 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.807+0000 7f0650be2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c1438e0 con 0x7f064c0b0cd0 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.807+0000 7f0650be2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c1cc4e0 con 0x7f064c13d4f0 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.807+0000 7f064a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064c071900 0x7f064c1cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.807+0000 7f064a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064c071900 0x7f064c1cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58920/0 (socket says 172.21.15.29:58920) 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.807+0000 7f064a59c640 1 -- 172.21.15.29:0/327410779 learned_addr learned my addr 172.21.15.29:0/327410779 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.807+0000 7f0649d9b640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f064c0b0cd0 0x7f064c0a7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.807+0000 7f064ad9d640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064c13d4f0 0x7f064c144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.808+0000 7f064a59c640 1 -- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064c13d4f0 msgr2=0x7f064c144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.808+0000 7f064a59c640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064c13d4f0 0x7f064c144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.808+0000 7f064a59c640 1 -- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f064c0b0cd0 msgr2=0x7f064c0a7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.808+0000 7f064a59c640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f064c0b0cd0 0x7f064c0a7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.808+0000 7f064a59c640 1 -- 172.21.15.29:0/327410779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06400094d0 con 0x7f064c071900 2024-09-13T18:45:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.808+0000 7f064a59c640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064c071900 0x7f064c1cbee0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f063c00e9b0 tx=0x7f063c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.808+0000 7f063affd640 1 -- 172.21.15.29:0/327410779 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c009670 con 0x7f064c071900 2024-09-13T18:45:40.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.808+0000 7f063affd640 1 -- 172.21.15.29:0/327410779 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c00c9a0 con 0x7f064c071900 2024-09-13T18:45:40.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.808+0000 7f0650be2640 1 -- 172.21.15.29:0/327410779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c143b30 con 0x7f064c071900 2024-09-13T18:45:40.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.808+0000 7f063affd640 1 -- 172.21.15.29:0/327410779 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c00cd50 con 0x7f064c071900 2024-09-13T18:45:40.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.808+0000 7f0650be2640 1 -- 172.21.15.29:0/327410779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c144590 con 0x7f064c071900 2024-09-13T18:45:40.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.809+0000 7f0650be2640 1 -- 172.21.15.29:0/327410779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c1cc6a0 con 0x7f064c071900 2024-09-13T18:45:40.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.810+0000 7f063affd640 1 -- 172.21.15.29:0/327410779 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f063c013470 con 0x7f064c071900 2024-09-13T18:45:40.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.810+0000 7f063affd640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f062c06ac30 0x7f062c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.810+0000 7f063affd640 1 -- 172.21.15.29:0/327410779 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f063c089790 con 0x7f064c071900 2024-09-13T18:45:40.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.810+0000 7f0649d9b640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f062c06ac30 0x7f062c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.811+0000 7f0649d9b640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f062c06ac30 0x7f062c06d0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0640034000 tx=0x7f064002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.814+0000 7f063affd640 1 -- 172.21.15.29:0/327410779 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f063c0547c0 con 0x7f064c071900 2024-09-13T18:45:40.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.987+0000 7f0650be2640 1 -- 172.21.15.29:0/327410779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f064c143cf0 con 0x7f064c071900 2024-09-13T18:45:40.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.988+0000 7f063affd640 1 -- 172.21.15.29:0/327410779 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7f063c057de0 con 0x7f064c071900 2024-09-13T18:45:40.991 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:40.991 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:40.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.990+0000 7f0650be2640 1 -- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f062c06ac30 msgr2=0x7f062c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.990+0000 7f0650be2640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f062c06ac30 0x7f062c06d0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0640034000 tx=0x7f064002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.990+0000 7f0650be2640 1 -- 172.21.15.29:0/327410779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064c071900 msgr2=0x7f064c1cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.990+0000 7f0650be2640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064c071900 0x7f064c1cbee0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f063c00e9b0 tx=0x7f063c00ee70 comp rx=0 tx=0).stop 2024-09-13T18:45:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.990+0000 7f0650be2640 1 -- 172.21.15.29:0/327410779 shutdown_connections 2024-09-13T18:45:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.990+0000 7f0650be2640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f062c06ac30 0x7f062c06d0f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.990+0000 7f0650be2640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f064c13d4f0 0x7f064c144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.990+0000 7f0650be2640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f064c0b0cd0 0x7f064c0a7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.990+0000 7f0650be2640 1 --2- 172.21.15.29:0/327410779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f064c071900 0x7f064c1cbee0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.990+0000 7f0650be2640 1 -- 172.21.15.29:0/327410779 >> 172.21.15.29:0/327410779 conn(0x7f064c06a890 msgr2=0x7f064c13f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.990+0000 7f0650be2640 1 -- 172.21.15.29:0/327410779 shutdown_connections 2024-09-13T18:45:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:40.990+0000 7f0650be2640 1 -- 172.21.15.29:0/327410779 wait complete. 2024-09-13T18:45:41.004 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:41.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.103+0000 7f0aaf39c640 1 Processor -- start 2024-09-13T18:45:41.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.103+0000 7f0aaf39c640 1 -- start start 2024-09-13T18:45:41.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.103+0000 7f0aaf39c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa806b150 0x7f0aa80712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.103+0000 7f0aaf39c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0aa80717e0 0x7f0aa813f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.104+0000 7f0aaf39c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa806b530 con 0x7f0aa80aeb00 2024-09-13T18:45:41.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.104+0000 7f0aaf39c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa8070b30 con 0x7f0aa80717e0 2024-09-13T18:45:41.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.104+0000 7f0aaf39c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80b4160 con 0x7f0aa806b150 2024-09-13T18:45:41.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.104+0000 7f0aac937640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0aa80717e0 0x7f0aa813f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.104+0000 7f0aac937640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0aa80717e0 0x7f0aa813f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58922/0 (socket says 172.21.15.29:58922) 2024-09-13T18:45:41.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.104+0000 7f0aac937640 1 -- 172.21.15.29:0/992186171 learned_addr learned my addr 172.21.15.29:0/992186171 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:41.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.104+0000 7f0aad138640 1 --2- 172.21.15.29:0/992186171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa806b150 0x7f0aa80712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.104+0000 7f0aac937640 1 -- 172.21.15.29:0/992186171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa806b150 msgr2=0x7f0aa80712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:41.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.104+0000 7f0aac937640 1 --2- 172.21.15.29:0/992186171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa806b150 0x7f0aa80712a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.104+0000 7f0aac937640 1 -- 172.21.15.29:0/992186171 >> v1:172.21.15.96:6789/0 conn(0x7f0aa80aeb00 legacy=0x7f0aa8148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:41.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.104+0000 7f0aac937640 1 -- 172.21.15.29:0/992186171 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa806f780 con 0x7f0aa80717e0 2024-09-13T18:45:41.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.105+0000 7f0aac937640 1 --2- 172.21.15.29:0/992186171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80717e0 0x7f0aa813f700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009870 tx=0x7f0aa402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d880f9d59523e6c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.105+0000 7f0a9bfff640 1 -- 172.21.15.29:0/992186171 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa402ae10 con 0x7f0aa80717e0 2024-09-13T18:45:41.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.105+0000 7f0a9bfff640 1 -- 172.21.15.29:0/992186171 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa4032440 con 0x7f0aa80717e0 2024-09-13T18:45:41.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.105+0000 7f0a9bfff640 1 -- 172.21.15.29:0/992186171 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40327d0 con 0x7f0aa80717e0 2024-09-13T18:45:41.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.105+0000 7f0aaf39c640 1 -- 172.21.15.29:0/992186171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80717e0 msgr2=0x7f0aa813f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.105+0000 7f0aaf39c640 1 --2- 172.21.15.29:0/992186171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80717e0 0x7f0aa813f700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009870 tx=0x7f0aa402a100 comp rx=0 tx=0).stop 2024-09-13T18:45:41.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.105+0000 7f0aaf39c640 1 -- 172.21.15.29:0/992186171 shutdown_connections 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.105+0000 7f0aaf39c640 1 --2- 172.21.15.29:0/992186171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80717e0 0x7f0aa813f700 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.105+0000 7f0aaf39c640 1 --2- 172.21.15.29:0/992186171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa806b150 0x7f0aa80712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.105+0000 7f0aaf39c640 1 -- 172.21.15.29:0/992186171 >> 172.21.15.29:0/992186171 conn(0x7f0aa80b4780 msgr2=0x7f0aa80b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.106+0000 7f0aaf39c640 1 -- 172.21.15.29:0/992186171 shutdown_connections 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.106+0000 7f0aaf39c640 1 -- 172.21.15.29:0/992186171 wait complete. 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.107+0000 7f0aaf39c640 1 Processor -- start 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.107+0000 7f0aaf39c640 1 -- start start 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.107+0000 7f0aaf39c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa806b150 0x7f0aa81db530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.107+0000 7f0aaf39c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa80717e0 0x7f0aa813eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.107+0000 7f0aaf39c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80aeb00 0x7f0aa813a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.107+0000 7f0aaf39c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa8139ed0 con 0x7f0aa80aeb00 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.107+0000 7f0aaf39c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa813a830 con 0x7f0aa806b150 2024-09-13T18:45:41.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.107+0000 7f0aaf39c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa81d0f80 con 0x7f0aa80717e0 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.107+0000 7f0aad939640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80aeb00 0x7f0aa813a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.107+0000 7f0aad939640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80aeb00 0x7f0aa813a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58928/0 (socket says 172.21.15.29:58928) 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.107+0000 7f0aad939640 1 -- 172.21.15.29:0/1369847012 learned_addr learned my addr 172.21.15.29:0/1369847012 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0aad138640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa806b150 0x7f0aa81db530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0aad939640 1 -- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa80717e0 msgr2=0x7f0aa813eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0aac937640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa80717e0 0x7f0aa813eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0aad939640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa80717e0 0x7f0aa813eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0aad939640 1 -- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa806b150 msgr2=0x7f0aa81db530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0aad939640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa806b150 0x7f0aa81db530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0aad939640 1 -- 172.21.15.29:0/1369847012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa40094d0 con 0x7f0aa80aeb00 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0aad138640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa806b150 0x7f0aa81db530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0aac937640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa80717e0 0x7f0aa813eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:41.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0aad939640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80aeb00 0x7f0aa813a2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000b9a0 tx=0x7f0aa000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0a99ffb640 1 -- 172.21.15.29:0/1369847012 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa000cba0 con 0x7f0aa80aeb00 2024-09-13T18:45:41.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0a99ffb640 1 -- 172.21.15.29:0/1369847012 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa000cd00 con 0x7f0aa80aeb00 2024-09-13T18:45:41.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0aaf39c640 1 -- 172.21.15.29:0/1369847012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa806fe20 con 0x7f0aa80aeb00 2024-09-13T18:45:41.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0a99ffb640 1 -- 172.21.15.29:0/1369847012 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0014680 con 0x7f0aa80aeb00 2024-09-13T18:45:41.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.108+0000 7f0aaf39c640 1 -- 172.21.15.29:0/1369847012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa813c0a0 con 0x7f0aa80aeb00 2024-09-13T18:45:41.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.109+0000 7f0aaf39c640 1 -- 172.21.15.29:0/1369847012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa8067300 con 0x7f0aa80aeb00 2024-09-13T18:45:41.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.110+0000 7f0a99ffb640 1 -- 172.21.15.29:0/1369847012 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0aa001d3b0 con 0x7f0aa80aeb00 2024-09-13T18:45:41.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.110+0000 7f0a99ffb640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0a8c06ac00 0x7f0a8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.110+0000 7f0a99ffb640 1 -- 172.21.15.29:0/1369847012 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0aa0089440 con 0x7f0aa80aeb00 2024-09-13T18:45:41.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.110+0000 7f0aad138640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0a8c06ac00 0x7f0a8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.111+0000 7f0aad138640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0a8c06ac00 0x7f0a8c06d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c008890 tx=0x7f0a9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.114+0000 7f0a99ffb640 1 -- 172.21.15.29:0/1369847012 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0aa0054330 con 0x7f0aa80aeb00 2024-09-13T18:45:41.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.287+0000 7f0aaf39c640 1 -- 172.21.15.29:0/1369847012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0aa813a010 con 0x7f0aa80aeb00 2024-09-13T18:45:41.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.288+0000 7f0a99ffb640 1 -- 172.21.15.29:0/1369847012 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7f0aa0057950 con 0x7f0aa80aeb00 2024-09-13T18:45:41.291 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:41.292 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:41.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.290+0000 7f0aaf39c640 1 -- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0a8c06ac00 msgr2=0x7f0a8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.290+0000 7f0aaf39c640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0a8c06ac00 0x7f0a8c06d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c008890 tx=0x7f0a9c008040 comp rx=0 tx=0).stop 2024-09-13T18:45:41.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.290+0000 7f0aaf39c640 1 -- 172.21.15.29:0/1369847012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80aeb00 msgr2=0x7f0aa813a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.290+0000 7f0aaf39c640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80aeb00 0x7f0aa813a2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000b9a0 tx=0x7f0aa000be60 comp rx=0 tx=0).stop 2024-09-13T18:45:41.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.290+0000 7f0aaf39c640 1 -- 172.21.15.29:0/1369847012 shutdown_connections 2024-09-13T18:45:41.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.290+0000 7f0aaf39c640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0a8c06ac00 0x7f0a8c06d0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.290+0000 7f0aaf39c640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80aeb00 0x7f0aa813a2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.290+0000 7f0aaf39c640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa80717e0 0x7f0aa813eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.290+0000 7f0aaf39c640 1 --2- 172.21.15.29:0/1369847012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa806b150 0x7f0aa81db530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.290+0000 7f0aaf39c640 1 -- 172.21.15.29:0/1369847012 >> 172.21.15.29:0/1369847012 conn(0x7f0aa80b4780 msgr2=0x7f0aa8144900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:41.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.290+0000 7f0aaf39c640 1 -- 172.21.15.29:0/1369847012 shutdown_connections 2024-09-13T18:45:41.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.290+0000 7f0aaf39c640 1 -- 172.21.15.29:0/1369847012 wait complete. 2024-09-13T18:45:41.304 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:45:41.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.406+0000 7f6d9d376640 1 Processor -- start 2024-09-13T18:45:41.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.406+0000 7f6d9d376640 1 -- start start 2024-09-13T18:45:41.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d9d376640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6d980b9e40 0x7f6d9813fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d9d376640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d9813ffd0 0x7f6d9806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d9d376640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d980b44d0 con 0x7f6d9806cb70 2024-09-13T18:45:41.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d9d376640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9806bf30 con 0x7f6d980b9e40 2024-09-13T18:45:41.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d9d376640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980b5960 con 0x7f6d9813ffd0 2024-09-13T18:45:41.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d977fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6d9806cb70 0x7f6d98070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53990/0 (socket says 172.21.15.29:53990) 2024-09-13T18:45:41.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d977fe640 1 -- 172.21.15.29:0/3259961746 learned_addr learned my addr 172.21.15.29:0/3259961746 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:41.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d96ffd640 1 --2- 172.21.15.29:0/3259961746 >> v2:172.21.15.29:3300/0 conn(0x7f6d980b9e40 0x7f6d9813fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d967fc640 1 --2- 172.21.15.29:0/3259961746 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d9813ffd0 0x7f6d9806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d96ffd640 1 -- 172.21.15.29:0/3259961746 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d9813ffd0 msgr2=0x7f6d9806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:41.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d96ffd640 1 --2- 172.21.15.29:0/3259961746 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d9813ffd0 0x7f6d9806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d96ffd640 1 -- 172.21.15.29:0/3259961746 >> v1:172.21.15.29:6789/0 conn(0x7f6d9806cb70 legacy=0x7f6d98070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d96ffd640 1 -- 172.21.15.29:0/3259961746 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d980ba220 con 0x7f6d980b9e40 2024-09-13T18:45:41.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.407+0000 7f6d95ffb640 1 -- 172.21.15.29:0/3259961746 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375050001 0 0) 0x7f6d980b44d0 con 0x7f6d9806cb70 2024-09-13T18:45:41.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.408+0000 7f6d96ffd640 1 --2- 172.21.15.29:0/3259961746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d980b9e40 0x7f6d9813fa90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6d880097a0 tx=0x7f6d8802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68af0e5d56f57181 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.408+0000 7f6d95ffb640 1 -- 172.21.15.29:0/3259961746 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88032440 con 0x7f6d980b9e40 2024-09-13T18:45:41.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.408+0000 7f6d95ffb640 1 -- 172.21.15.29:0/3259961746 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d880325a0 con 0x7f6d980b9e40 2024-09-13T18:45:41.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.408+0000 7f6d95ffb640 1 -- 172.21.15.29:0/3259961746 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88032930 con 0x7f6d980b9e40 2024-09-13T18:45:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.409+0000 7f6d9d376640 1 -- 172.21.15.29:0/3259961746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d980b9e40 msgr2=0x7f6d9813fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.409+0000 7f6d9d376640 1 --2- 172.21.15.29:0/3259961746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d980b9e40 0x7f6d9813fa90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6d880097a0 tx=0x7f6d8802a180 comp rx=0 tx=0).stop 2024-09-13T18:45:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.409+0000 7f6d9d376640 1 -- 172.21.15.29:0/3259961746 shutdown_connections 2024-09-13T18:45:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.409+0000 7f6d9d376640 1 --2- 172.21.15.29:0/3259961746 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d9813ffd0 0x7f6d9806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.409+0000 7f6d9d376640 1 --2- 172.21.15.29:0/3259961746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d980b9e40 0x7f6d9813fa90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.409+0000 7f6d9d376640 1 -- 172.21.15.29:0/3259961746 >> 172.21.15.29:0/3259961746 conn(0x7f6d9806a500 msgr2=0x7f6d980b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.409+0000 7f6d9d376640 1 -- 172.21.15.29:0/3259961746 shutdown_connections 2024-09-13T18:45:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.409+0000 7f6d9d376640 1 -- 172.21.15.29:0/3259961746 wait complete. 2024-09-13T18:45:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.410+0000 7f6d9d376640 1 Processor -- start 2024-09-13T18:45:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.410+0000 7f6d9d376640 1 -- start start 2024-09-13T18:45:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d9d376640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d9806cb70 0x7f6d98143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d9d376640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d980b9e40 0x7f6d98144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d9d376640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d9813ffd0 0x7f6d981dec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d9d376640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98144310 con 0x7f6d980b9e40 2024-09-13T18:45:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d9d376640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980b3360 con 0x7f6d9806cb70 2024-09-13T18:45:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d9d376640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98145ee0 con 0x7f6d9813ffd0 2024-09-13T18:45:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d967fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d980b9e40 0x7f6d98144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d967fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d980b9e40 0x7f6d98144a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58954/0 (socket says 172.21.15.29:58954) 2024-09-13T18:45:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d967fc640 1 -- 172.21.15.29:0/1905827279 learned_addr learned my addr 172.21.15.29:0/1905827279 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d96ffd640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d9806cb70 0x7f6d98143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d977fe640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d9813ffd0 0x7f6d981dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d967fc640 1 -- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d9813ffd0 msgr2=0x7f6d981dec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d967fc640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d9813ffd0 0x7f6d981dec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d967fc640 1 -- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d9806cb70 msgr2=0x7f6d98143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d967fc640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d9806cb70 0x7f6d98143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d967fc640 1 -- 172.21.15.29:0/1905827279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d88009400 con 0x7f6d980b9e40 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d967fc640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d980b9e40 0x7f6d98144a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00d7d0 tx=0x7f6d8c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d7f7fe640 1 -- 172.21.15.29:0/1905827279 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c018070 con 0x7f6d980b9e40 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d7f7fe640 1 -- 172.21.15.29:0/1905827279 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c004020 con 0x7f6d980b9e40 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d9d376640 1 -- 172.21.15.29:0/1905827279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d981461c0 con 0x7f6d980b9e40 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d7f7fe640 1 -- 172.21.15.29:0/1905827279 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0041b0 con 0x7f6d980b9e40 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.411+0000 7f6d9d376640 1 -- 172.21.15.29:0/1905827279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d98144560 con 0x7f6d980b9e40 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.412+0000 7f6d9d376640 1 -- 172.21.15.29:0/1905827279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d980b5080 con 0x7f6d980b9e40 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.413+0000 7f6d7f7fe640 1 -- 172.21.15.29:0/1905827279 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6d8c004310 con 0x7f6d980b9e40 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.413+0000 7f6d7f7fe640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6d8406ac00 0x7f6d8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.413+0000 7f6d7f7fe640 1 -- 172.21.15.29:0/1905827279 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6d8c0894d0 con 0x7f6d980b9e40 2024-09-13T18:45:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.414+0000 7f6d96ffd640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6d8406ac00 0x7f6d8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.414+0000 7f6d96ffd640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6d8406ac00 0x7f6d8406d0c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6d88034000 tx=0x7f6d8802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.418+0000 7f6d7f7fe640 1 -- 172.21.15.29:0/1905827279 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6d8c0543d0 con 0x7f6d980b9e40 2024-09-13T18:45:41.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:41.627+0000 7f6d9d376640 1 -- 172.21.15.29:0/1905827279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6d980b7fc0 con 0x7f6d980b9e40 2024-09-13T18:45:42.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.067+0000 7f6d7f7fe640 1 -- 172.21.15.29:0/1905827279 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6d8c0579f0 con 0x7f6d980b9e40 2024-09-13T18:45:42.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.070+0000 7f6d9d376640 1 -- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6d8406ac00 msgr2=0x7f6d8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.070+0000 7f6d9d376640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6d8406ac00 0x7f6d8406d0c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6d88034000 tx=0x7f6d8802e000 comp rx=0 tx=0).stop 2024-09-13T18:45:42.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.070+0000 7f6d9d376640 1 -- 172.21.15.29:0/1905827279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d980b9e40 msgr2=0x7f6d98144a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.070+0000 7f6d9d376640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d980b9e40 0x7f6d98144a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00d7d0 tx=0x7f6d8c00dc90 comp rx=0 tx=0).stop 2024-09-13T18:45:42.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.070+0000 7f6d9d376640 1 -- 172.21.15.29:0/1905827279 shutdown_connections 2024-09-13T18:45:42.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.070+0000 7f6d9d376640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6d8406ac00 0x7f6d8406d0c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.070+0000 7f6d9d376640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d9813ffd0 0x7f6d981dec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.070+0000 7f6d9d376640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d980b9e40 0x7f6d98144a80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.070+0000 7f6d9d376640 1 --2- 172.21.15.29:0/1905827279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d9806cb70 0x7f6d98143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.070+0000 7f6d9d376640 1 -- 172.21.15.29:0/1905827279 >> 172.21.15.29:0/1905827279 conn(0x7f6d9806a500 msgr2=0x7f6d9813ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:42.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.070+0000 7f6d9d376640 1 -- 172.21.15.29:0/1905827279 shutdown_connections 2024-09-13T18:45:42.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.070+0000 7f6d9d376640 1 -- 172.21.15.29:0/1905827279 wait complete. 2024-09-13T18:45:42.085 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-13T18:45:42.086 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:45:42.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.191+0000 7ff300212640 1 Processor -- start 2024-09-13T18:45:42.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.191+0000 7ff300212640 1 -- start start 2024-09-13T18:45:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.192+0000 7ff300212640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff2f80ac9e0 0x7ff2f8145d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.192+0000 7ff300212640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff2f814b020 0x7ff2f814d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.192+0000 7ff300212640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f809cdb0 con 0x7ff2f80b38b0 2024-09-13T18:45:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.192+0000 7ff300212640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f80ad300 con 0x7ff2f814b020 2024-09-13T18:45:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.192+0000 7ff300212640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80adfc0 con 0x7ff2f80ac9e0 2024-09-13T18:45:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.192+0000 7ff2fe7af640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff2f814b020 0x7ff2f814d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.192+0000 7ff2fe7af640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff2f814b020 0x7ff2f814d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58956/0 (socket says 172.21.15.29:58956) 2024-09-13T18:45:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.192+0000 7ff2fe7af640 1 -- 172.21.15.29:0/3342509468 learned_addr learned my addr 172.21.15.29:0/3342509468 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.192+0000 7ff2fdfae640 1 --2- 172.21.15.29:0/3342509468 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff2f80ac9e0 0x7ff2f8145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.193+0000 7ff2fe7af640 1 -- 172.21.15.29:0/3342509468 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff2f80ac9e0 msgr2=0x7ff2f8145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.193+0000 7ff2fe7af640 1 --2- 172.21.15.29:0/3342509468 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff2f80ac9e0 0x7ff2f8145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.193+0000 7ff2fe7af640 1 -- 172.21.15.29:0/3342509468 >> v1:172.21.15.96:6789/0 conn(0x7ff2f80b38b0 legacy=0x7ff2f8071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.193+0000 7ff2fe7af640 1 -- 172.21.15.29:0/3342509468 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f8146240 con 0x7ff2f814b020 2024-09-13T18:45:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.193+0000 7ff2fdfae640 1 --2- 172.21.15.29:0/3342509468 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff2f80ac9e0 0x7ff2f8145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.193+0000 7ff2fe7af640 1 --2- 172.21.15.29:0/3342509468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f814b020 0x7ff2f814d410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009e80 tx=0x7ff2f002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb553b80641955b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.193+0000 7ff2fcfac640 1 -- 172.21.15.29:0/3342509468 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f002aea0 con 0x7ff2f814b020 2024-09-13T18:45:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.193+0000 7ff2fcfac640 1 -- 172.21.15.29:0/3342509468 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f002d050 con 0x7ff2f814b020 2024-09-13T18:45:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.193+0000 7ff2fcfac640 1 -- 172.21.15.29:0/3342509468 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0031820 con 0x7ff2f814b020 2024-09-13T18:45:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.194+0000 7ff300212640 1 -- 172.21.15.29:0/3342509468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f814b020 msgr2=0x7ff2f814d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.194+0000 7ff300212640 1 --2- 172.21.15.29:0/3342509468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f814b020 0x7ff2f814d410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009e80 tx=0x7ff2f002a6c0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.194+0000 7ff300212640 1 -- 172.21.15.29:0/3342509468 shutdown_connections 2024-09-13T18:45:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.194+0000 7ff300212640 1 --2- 172.21.15.29:0/3342509468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f814b020 0x7ff2f814d410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.194+0000 7ff300212640 1 --2- 172.21.15.29:0/3342509468 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff2f80ac9e0 0x7ff2f8145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.194+0000 7ff300212640 1 -- 172.21.15.29:0/3342509468 >> 172.21.15.29:0/3342509468 conn(0x7ff2f80b3fb0 msgr2=0x7ff2f80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.194+0000 7ff300212640 1 -- 172.21.15.29:0/3342509468 shutdown_connections 2024-09-13T18:45:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.194+0000 7ff300212640 1 -- 172.21.15.29:0/3342509468 wait complete. 2024-09-13T18:45:42.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.195+0000 7ff300212640 1 Processor -- start 2024-09-13T18:45:42.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.195+0000 7ff300212640 1 -- start start 2024-09-13T18:45:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff300212640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f80ac9e0 0x7ff2f809bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff300212640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff2f80b38b0 0x7ff2f80b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff300212640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f814b020 0x7ff2f80b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff300212640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f81db330 con 0x7ff2f814b020 2024-09-13T18:45:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff300212640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f81db610 con 0x7ff2f80ac9e0 2024-09-13T18:45:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff300212640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f81db8f0 con 0x7ff2f80b38b0 2024-09-13T18:45:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff2fe7af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f814b020 0x7ff2f80b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff2fe7af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f814b020 0x7ff2f80b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58960/0 (socket says 172.21.15.29:58960) 2024-09-13T18:45:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff2fe7af640 1 -- 172.21.15.29:0/4288263846 learned_addr learned my addr 172.21.15.29:0/4288263846 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff2fd7ad640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff2f80b38b0 0x7ff2f80b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff2fdfae640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f80ac9e0 0x7ff2f809bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff2fe7af640 1 -- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff2f80b38b0 msgr2=0x7ff2f80b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff2fe7af640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff2f80b38b0 0x7ff2f80b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff2fe7af640 1 -- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f80ac9e0 msgr2=0x7ff2f809bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff2fe7af640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f80ac9e0 0x7ff2f809bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff2fe7af640 1 -- 172.21.15.29:0/4288263846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f0009b30 con 0x7ff2f814b020 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.196+0000 7ff2fe7af640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f814b020 0x7ff2f80b0c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0034040 tx=0x7ff2f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.197+0000 7ff2ea7fc640 1 -- 172.21.15.29:0/4288263846 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f003d860 con 0x7ff2f814b020 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.197+0000 7ff2ea7fc640 1 -- 172.21.15.29:0/4288263846 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f003d9e0 con 0x7ff2f814b020 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.197+0000 7ff300212640 1 -- 172.21.15.29:0/4288263846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f80ae720 con 0x7ff2f814b020 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.197+0000 7ff2ea7fc640 1 -- 172.21.15.29:0/4288263846 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f003dd90 con 0x7ff2f814b020 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.197+0000 7ff300212640 1 -- 172.21.15.29:0/4288263846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f81dada0 con 0x7ff2f814b020 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.197+0000 7ff300212640 1 -- 172.21.15.29:0/4288263846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f80ad760 con 0x7ff2f814b020 2024-09-13T18:45:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.198+0000 7ff2ea7fc640 1 -- 172.21.15.29:0/4288263846 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff2f003b400 con 0x7ff2f814b020 2024-09-13T18:45:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.198+0000 7ff2ea7fc640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff2dc06ac00 0x7ff2dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.199+0000 7ff2ea7fc640 1 -- 172.21.15.29:0/4288263846 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff2f00aa3a0 con 0x7ff2f814b020 2024-09-13T18:45:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.199+0000 7ff2fdfae640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff2dc06ac00 0x7ff2dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.199+0000 7ff2fdfae640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff2dc06ac00 0x7ff2dc06d0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec006e80 tx=0x7ff2ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:42.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.203+0000 7ff2ea7fc640 1 -- 172.21.15.29:0/4288263846 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff2f0075220 con 0x7ff2f814b020 2024-09-13T18:45:42.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:42.408+0000 7ff300212640 1 -- 172.21.15.29:0/4288263846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff2f81db470 con 0x7ff2f814b020 2024-09-13T18:45:43.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.072+0000 7ff2ea7fc640 1 -- 172.21.15.29:0/4288263846 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff2f81db470 con 0x7ff2f814b020 2024-09-13T18:45:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.075+0000 7ff300212640 1 -- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff2dc06ac00 msgr2=0x7ff2dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.075+0000 7ff300212640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff2dc06ac00 0x7ff2dc06d0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec006e80 tx=0x7ff2ec008040 comp rx=0 tx=0).stop 2024-09-13T18:45:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.075+0000 7ff300212640 1 -- 172.21.15.29:0/4288263846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f814b020 msgr2=0x7ff2f80b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.075+0000 7ff300212640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f814b020 0x7ff2f80b0c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0034040 tx=0x7ff2f0004a40 comp rx=0 tx=0).stop 2024-09-13T18:45:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.075+0000 7ff300212640 1 -- 172.21.15.29:0/4288263846 shutdown_connections 2024-09-13T18:45:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.075+0000 7ff300212640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff2dc06ac00 0x7ff2dc06d0c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.075+0000 7ff300212640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f814b020 0x7ff2f80b0c70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.075+0000 7ff300212640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff2f80b38b0 0x7ff2f80b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.075+0000 7ff300212640 1 --2- 172.21.15.29:0/4288263846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2f80ac9e0 0x7ff2f809bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.075+0000 7ff300212640 1 -- 172.21.15.29:0/4288263846 >> 172.21.15.29:0/4288263846 conn(0x7ff2f80b3fb0 msgr2=0x7ff2f8140ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:43.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.075+0000 7ff300212640 1 -- 172.21.15.29:0/4288263846 shutdown_connections 2024-09-13T18:45:43.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.075+0000 7ff300212640 1 -- 172.21.15.29:0/4288263846 wait complete. 2024-09-13T18:45:43.091 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:45:43.091 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:43.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.197+0000 7f6139e53640 1 Processor -- start 2024-09-13T18:45:43.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.197+0000 7f6139e53640 1 -- start start 2024-09-13T18:45:43.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.197+0000 7f6139e53640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f61340b31d0 0x7f61340b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.197+0000 7f6139e53640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61340b35b0 0x7f61341498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.197+0000 7f6139e53640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6134149410 con 0x7f613413f8e0 2024-09-13T18:45:43.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.197+0000 7f6139e53640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61340b4550 con 0x7f61340b31d0 2024-09-13T18:45:43.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.197+0000 7f6139e53640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61340b4810 con 0x7f61340b35b0 2024-09-13T18:45:43.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.197+0000 7f61337fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f61340b31d0 0x7f61340b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.198+0000 7f61337fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f61340b31d0 0x7f61340b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58964/0 (socket says 172.21.15.29:58964) 2024-09-13T18:45:43.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.198+0000 7f61337fe640 1 -- 172.21.15.29:0/3716802258 learned_addr learned my addr 172.21.15.29:0/3716802258 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:43.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.198+0000 7f6132ffd640 1 --2- 172.21.15.29:0/3716802258 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61340b35b0 0x7f61341498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.198+0000 7f61337fe640 1 -- 172.21.15.29:0/3716802258 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61340b35b0 msgr2=0x7f61341498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:43.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.198+0000 7f61337fe640 1 --2- 172.21.15.29:0/3716802258 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61340b35b0 0x7f61341498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.198+0000 7f61337fe640 1 -- 172.21.15.29:0/3716802258 >> v1:172.21.15.96:6789/0 conn(0x7f613413f8e0 legacy=0x7f613413fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.198+0000 7f61337fe640 1 -- 172.21.15.29:0/3716802258 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61341490a0 con 0x7f61340b31d0 2024-09-13T18:45:43.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.199+0000 7f61337fe640 1 --2- 172.21.15.29:0/3716802258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61340b31d0 0x7f61340b4010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6124009870 tx=0x7f612402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda791ffd229a7da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.199+0000 7f61327fc640 1 -- 172.21.15.29:0/3716802258 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124032440 con 0x7f61340b31d0 2024-09-13T18:45:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.199+0000 7f61327fc640 1 -- 172.21.15.29:0/3716802258 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61240325a0 con 0x7f61340b31d0 2024-09-13T18:45:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.199+0000 7f61327fc640 1 -- 172.21.15.29:0/3716802258 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124032930 con 0x7f61340b31d0 2024-09-13T18:45:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.199+0000 7f6139e53640 1 -- 172.21.15.29:0/3716802258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61340b31d0 msgr2=0x7f61340b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.199+0000 7f6139e53640 1 --2- 172.21.15.29:0/3716802258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61340b31d0 0x7f61340b4010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6124009870 tx=0x7f612402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.199+0000 7f6139e53640 1 -- 172.21.15.29:0/3716802258 shutdown_connections 2024-09-13T18:45:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.199+0000 7f6139e53640 1 --2- 172.21.15.29:0/3716802258 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61340b35b0 0x7f61341498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.199+0000 7f6139e53640 1 --2- 172.21.15.29:0/3716802258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61340b31d0 0x7f61340b4010 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.199+0000 7f6139e53640 1 -- 172.21.15.29:0/3716802258 >> 172.21.15.29:0/3716802258 conn(0x7f61340bb590 msgr2=0x7f61340bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.199+0000 7f6139e53640 1 -- 172.21.15.29:0/3716802258 shutdown_connections 2024-09-13T18:45:43.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.199+0000 7f6139e53640 1 -- 172.21.15.29:0/3716802258 wait complete. 2024-09-13T18:45:43.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.200+0000 7f6139e53640 1 Processor -- start 2024-09-13T18:45:43.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.201+0000 7f6139e53640 1 -- start start 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.201+0000 7f6139e53640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61340b31d0 0x7f6134146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.201+0000 7f6139e53640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61340b35b0 0x7f61341de5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.201+0000 7f6139e53640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f613413f8e0 0x7f61341db140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.201+0000 7f6139e53640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61341deb00 con 0x7f613413f8e0 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.201+0000 7f6139e53640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61340a9710 con 0x7f61340b35b0 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.201+0000 7f6139e53640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61340a9bf0 con 0x7f61340b31d0 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.201+0000 7f6133fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f613413f8e0 0x7f61341db140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.201+0000 7f6133fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f613413f8e0 0x7f61341db140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58974/0 (socket says 172.21.15.29:58974) 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.201+0000 7f6133fff640 1 -- 172.21.15.29:0/863459718 learned_addr learned my addr 172.21.15.29:0/863459718 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.201+0000 7f6132ffd640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61340b35b0 0x7f61341de5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.201+0000 7f61337fe640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61340b31d0 0x7f6134146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.202+0000 7f6133fff640 1 -- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61340b31d0 msgr2=0x7f6134146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.202+0000 7f6133fff640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61340b31d0 0x7f6134146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.202+0000 7f6133fff640 1 -- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61340b35b0 msgr2=0x7f61341de5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.202+0000 7f6133fff640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61340b35b0 0x7f61341de5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.202+0000 7f6133fff640 1 -- 172.21.15.29:0/863459718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61240094d0 con 0x7f613413f8e0 2024-09-13T18:45:43.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.202+0000 7f6133fff640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f613413f8e0 0x7f61341db140 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f612c00c6b0 tx=0x7f612c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.202+0000 7f611bfff640 1 -- 172.21.15.29:0/863459718 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c003b70 con 0x7f613413f8e0 2024-09-13T18:45:43.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.202+0000 7f6139e53640 1 -- 172.21.15.29:0/863459718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61341dece0 con 0x7f613413f8e0 2024-09-13T18:45:43.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.202+0000 7f611bfff640 1 -- 172.21.15.29:0/863459718 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c003cf0 con 0x7f613413f8e0 2024-09-13T18:45:43.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.202+0000 7f611bfff640 1 -- 172.21.15.29:0/863459718 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c003ea0 con 0x7f613413f8e0 2024-09-13T18:45:43.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.202+0000 7f6139e53640 1 -- 172.21.15.29:0/863459718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61341df2a0 con 0x7f613413f8e0 2024-09-13T18:45:43.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.203+0000 7f6139e53640 1 -- 172.21.15.29:0/863459718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6134067300 con 0x7f613413f8e0 2024-09-13T18:45:43.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.204+0000 7f611bfff640 1 -- 172.21.15.29:0/863459718 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f612c005310 con 0x7f613413f8e0 2024-09-13T18:45:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.204+0000 7f611bfff640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f612006ac00 0x7f612006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.204+0000 7f611bfff640 1 -- 172.21.15.29:0/863459718 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f612c089270 con 0x7f613413f8e0 2024-09-13T18:45:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.205+0000 7f61337fe640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f612006ac00 0x7f612006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.205+0000 7f61337fe640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f612006ac00 0x7f612006d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6124034000 tx=0x7f612402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.208+0000 7f611bfff640 1 -- 172.21.15.29:0/863459718 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f612c054220 con 0x7f613413f8e0 2024-09-13T18:45:43.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.414+0000 7f6139e53640 1 -- 172.21.15.29:0/863459718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f613413f280 con 0x7f613413f8e0 2024-09-13T18:45:43.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.415+0000 7f611bfff640 1 -- 172.21.15.29:0/863459718 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3215 (secure 0 0 0) 0x7f612c057840 con 0x7f613413f8e0 2024-09-13T18:45:43.418 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:43.418 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/3867151553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3867151553},{"type":"v1","addr":"172.21.15.96:6835","nonce":3867151553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:22.006847+0000","modified":"2024-09-13T18:45:43.067420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6833/175129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":175129703},{"type":"v1","addr":"172.21.15.29:6833","nonce":175129703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:45:43.418 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-09-13T18:45:43.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.417+0000 7f6139e53640 1 -- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f612006ac00 msgr2=0x7f612006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.417+0000 7f6139e53640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f612006ac00 0x7f612006d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6124034000 tx=0x7f612402e000 comp rx=0 tx=0).stop 2024-09-13T18:45:43.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.417+0000 7f6139e53640 1 -- 172.21.15.29:0/863459718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f613413f8e0 msgr2=0x7f61341db140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.417+0000 7f6139e53640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f613413f8e0 0x7f61341db140 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f612c00c6b0 tx=0x7f612c00cb70 comp rx=0 tx=0).stop 2024-09-13T18:45:43.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.417+0000 7f6139e53640 1 -- 172.21.15.29:0/863459718 shutdown_connections 2024-09-13T18:45:43.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.417+0000 7f6139e53640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f612006ac00 0x7f612006d0c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.417+0000 7f6139e53640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f613413f8e0 0x7f61341db140 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.417+0000 7f6139e53640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61340b35b0 0x7f61341de5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.417+0000 7f6139e53640 1 --2- 172.21.15.29:0/863459718 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61340b31d0 0x7f6134146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.417+0000 7f6139e53640 1 -- 172.21.15.29:0/863459718 >> 172.21.15.29:0/863459718 conn(0x7f61340bb590 msgr2=0x7f6134148480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:43.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.417+0000 7f6139e53640 1 -- 172.21.15.29:0/863459718 shutdown_connections 2024-09-13T18:45:43.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.417+0000 7f6139e53640 1 -- 172.21.15.29:0/863459718 wait complete. 2024-09-13T18:45:43.431 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:43.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.529+0000 7f5babc4f640 1 Processor -- start 2024-09-13T18:45:43.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.529+0000 7f5babc4f640 1 -- start start 2024-09-13T18:45:43.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.530+0000 7f5babc4f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5ba40b1fc0 0x7f5ba40b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.530+0000 7f5babc4f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba406f230 con 0x7f5ba413c550 2024-09-13T18:45:43.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.530+0000 7f5babc4f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba40b23a0 con 0x7f5ba4146300 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.530+0000 7f5babc4f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba40b0d70 con 0x7f5ba40b1fc0 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.530+0000 7f5ba91ea640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5ba413c550 0x7f5ba4145bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53998/0 (socket says 172.21.15.29:53998) 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.530+0000 7f5ba91ea640 1 -- 172.21.15.29:0/1920868295 learned_addr learned my addr 172.21.15.29:0/1920868295 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.530+0000 7f5ba99eb640 1 --2- 172.21.15.29:0/1920868295 >> v2:172.21.15.96:3300/0 conn(0x7f5ba40b1fc0 0x7f5ba40b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.530+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783295905 0 0) 0x7f5ba406f230 con 0x7f5ba413c550 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.530+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b90003520 con 0x7f5ba413c550 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.530+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3794039064 0 0) 0x7f5b90003520 con 0x7f5ba413c550 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 >> v2:172.21.15.96:3300/0 conn(0x7f5ba40b1fc0 msgr2=0x7f5ba40b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba89e9640 1 --2- 172.21.15.29:0/1920868295 >> v2:172.21.15.96:3300/0 conn(0x7f5ba40b1fc0 0x7f5ba40b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 >> v1:172.21.15.96:6789/0 conn(0x7f5ba4146300 legacy=0x7f5ba414cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba40b1050 con 0x7f5ba413c550 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f5b94001670 con 0x7f5ba413c550 2024-09-13T18:45:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 >> v1:172.21.15.29:6789/0 conn(0x7f5ba413c550 legacy=0x7f5ba4145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba89e9640 1 --2- 172.21.15.29:0/1920868295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b90003970 0x7f5b90003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba89e9640 1 --2- 172.21.15.29:0/1920868295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b90004370 0x7f5b90004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba89e9640 1 --2- 172.21.15.29:0/1920868295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b90005040 0x7f5b9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40b0d70 con 0x7f5b90004370 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9000bfa0 con 0x7f5b90003970 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9000c160 con 0x7f5b90005040 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba91ea640 1 --2- 172.21.15.29:0/1920868295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b90004370 0x7f5b90004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba99eb640 1 --2- 172.21.15.29:0/1920868295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b90003970 0x7f5b90003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5baa1ec640 1 --2- 172.21.15.29:0/1920868295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b90005040 0x7f5b9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba91ea640 1 -- 172.21.15.29:0/1920868295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b90005040 msgr2=0x7f5b9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba91ea640 1 --2- 172.21.15.29:0/1920868295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b90005040 0x7f5b9000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba91ea640 1 -- 172.21.15.29:0/1920868295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b90003970 msgr2=0x7f5b90003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba91ea640 1 --2- 172.21.15.29:0/1920868295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b90003970 0x7f5b90003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5ba91ea640 1 -- 172.21.15.29:0/1920868295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b90003520 con 0x7f5b90004370 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.531+0000 7f5baa1ec640 1 -- 172.21.15.29:0/1920868295 reap_dead start 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.532+0000 7f5ba91ea640 1 --2- 172.21.15.29:0/1920868295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b90004370 0x7f5b90004840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400c210 tx=0x7f5b900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec648323c42c542 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.532+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94005ad0 con 0x7f5b90004370 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.532+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9402d070 con 0x7f5b90004370 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.532+0000 7f5ba89e9640 1 -- 172.21.15.29:0/1920868295 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94007070 con 0x7f5b90004370 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.532+0000 7f5babc4f640 1 -- 172.21.15.29:0/1920868295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b90004370 msgr2=0x7f5b90004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.532+0000 7f5babc4f640 1 --2- 172.21.15.29:0/1920868295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b90004370 0x7f5b90004840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400c210 tx=0x7f5b900057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.533+0000 7f5babc4f640 1 -- 172.21.15.29:0/1920868295 shutdown_connections 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.533+0000 7f5babc4f640 1 --2- 172.21.15.29:0/1920868295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b90004370 0x7f5b90004840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.533+0000 7f5babc4f640 1 -- 172.21.15.29:0/1920868295 >> 172.21.15.29:0/1920868295 conn(0x7f5ba406a890 msgr2=0x7f5ba40b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.533+0000 7f5babc4f640 1 -- 172.21.15.29:0/1920868295 shutdown_connections 2024-09-13T18:45:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.533+0000 7f5babc4f640 1 -- 172.21.15.29:0/1920868295 wait complete. 2024-09-13T18:45:43.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.534+0000 7f5babc4f640 1 Processor -- start 2024-09-13T18:45:43.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.534+0000 7f5babc4f640 1 -- start start 2024-09-13T18:45:43.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.534+0000 7f5babc4f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b90004370 0x7f5ba40a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.534+0000 7f5babc4f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ba413f3a0 0x7f5ba41d9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.534+0000 7f5babc4f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba4142a00 0x7f5ba40ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.534+0000 7f5babc4f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba4142e90 con 0x7f5ba4142a00 2024-09-13T18:45:43.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.534+0000 7f5babc4f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba41daeb0 con 0x7f5ba413f3a0 2024-09-13T18:45:43.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.534+0000 7f5babc4f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40a75c0 con 0x7f5b90004370 2024-09-13T18:45:43.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.534+0000 7f5baa1ec640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba4142a00 0x7f5ba40ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.534+0000 7f5baa1ec640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba4142a00 0x7f5ba40ada60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58986/0 (socket says 172.21.15.29:58986) 2024-09-13T18:45:43.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.534+0000 7f5baa1ec640 1 -- 172.21.15.29:0/771429014 learned_addr learned my addr 172.21.15.29:0/771429014 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:43.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5ba91ea640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ba413f3a0 0x7f5ba41d9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5ba99eb640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b90004370 0x7f5ba40a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5baa1ec640 1 -- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b90004370 msgr2=0x7f5ba40a7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5baa1ec640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b90004370 0x7f5ba40a7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5baa1ec640 1 -- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ba413f3a0 msgr2=0x7f5ba41d9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5baa1ec640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ba413f3a0 0x7f5ba41d9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5baa1ec640 1 -- 172.21.15.29:0/771429014 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba40a78a0 con 0x7f5ba4142a00 2024-09-13T18:45:43.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5ba91ea640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ba413f3a0 0x7f5ba41d9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:43.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5ba99eb640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b90004370 0x7f5ba40a7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:43.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5baa1ec640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba4142a00 0x7f5ba40ada60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4066ac0 tx=0x7f5b9c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5b9a7fc640 1 -- 172.21.15.29:0/771429014 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c006e20 con 0x7f5ba4142a00 2024-09-13T18:45:43.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5b9a7fc640 1 -- 172.21.15.29:0/771429014 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9c003970 con 0x7f5ba4142a00 2024-09-13T18:45:43.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5babc4f640 1 -- 172.21.15.29:0/771429014 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba40a8ff0 con 0x7f5ba4142a00 2024-09-13T18:45:43.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5b9a7fc640 1 -- 172.21.15.29:0/771429014 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c003d20 con 0x7f5ba4142a00 2024-09-13T18:45:43.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.535+0000 7f5babc4f640 1 -- 172.21.15.29:0/771429014 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba40aff20 con 0x7f5ba4142a00 2024-09-13T18:45:43.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.536+0000 7f5babc4f640 1 -- 172.21.15.29:0/771429014 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba40a7ae0 con 0x7f5ba4142a00 2024-09-13T18:45:43.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.537+0000 7f5b9a7fc640 1 -- 172.21.15.29:0/771429014 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b9c00d6e0 con 0x7f5ba4142a00 2024-09-13T18:45:43.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.537+0000 7f5b9a7fc640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5b8806ac00 0x7f5b8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.537+0000 7f5b9a7fc640 1 -- 172.21.15.29:0/771429014 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b9c088a80 con 0x7f5ba4142a00 2024-09-13T18:45:43.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.537+0000 7f5ba99eb640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5b8806ac00 0x7f5b8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.538+0000 7f5ba99eb640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5b8806ac00 0x7f5b8806d0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009ab0 tx=0x7f5ba0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.541+0000 7f5b9a7fc640 1 -- 172.21.15.29:0/771429014 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5ba40a7ae0 con 0x7f5ba4142a00 2024-09-13T18:45:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.714+0000 7f5babc4f640 1 -- 172.21.15.29:0/771429014 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ba40a7ae0 con 0x7f5ba4142a00 2024-09-13T18:45:43.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.715+0000 7f5b9a7fc640 1 -- 172.21.15.29:0/771429014 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7f5ba40a7ae0 con 0x7f5ba4142a00 2024-09-13T18:45:43.718 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:43.718 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:43.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.717+0000 7f5babc4f640 1 -- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5b8806ac00 msgr2=0x7f5b8806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.717+0000 7f5babc4f640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5b8806ac00 0x7f5b8806d0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009ab0 tx=0x7f5ba0008040 comp rx=0 tx=0).stop 2024-09-13T18:45:43.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.717+0000 7f5babc4f640 1 -- 172.21.15.29:0/771429014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba4142a00 msgr2=0x7f5ba40ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.717+0000 7f5babc4f640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba4142a00 0x7f5ba40ada60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4066ac0 tx=0x7f5b9c00ff70 comp rx=0 tx=0).stop 2024-09-13T18:45:43.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.717+0000 7f5babc4f640 1 -- 172.21.15.29:0/771429014 shutdown_connections 2024-09-13T18:45:43.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.717+0000 7f5babc4f640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5b8806ac00 0x7f5b8806d0c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.717+0000 7f5babc4f640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba4142a00 0x7f5ba40ada60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.717+0000 7f5babc4f640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ba413f3a0 0x7f5ba41d9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.717+0000 7f5babc4f640 1 --2- 172.21.15.29:0/771429014 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b90004370 0x7f5ba40a7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.717+0000 7f5babc4f640 1 -- 172.21.15.29:0/771429014 >> 172.21.15.29:0/771429014 conn(0x7f5ba406a890 msgr2=0x7f5ba406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:43.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.717+0000 7f5babc4f640 1 -- 172.21.15.29:0/771429014 shutdown_connections 2024-09-13T18:45:43.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.717+0000 7f5babc4f640 1 -- 172.21.15.29:0/771429014 wait complete. 2024-09-13T18:45:43.731 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:45:43.731 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:43.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.831+0000 7fa6875c7640 1 Processor -- start 2024-09-13T18:45:43.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.832+0000 7fa6875c7640 1 -- start start 2024-09-13T18:45:43.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.832+0000 7fa6875c7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6800b31d0 0x7fa6800b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.832+0000 7fa6875c7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6800b35b0 0x7fa6801498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.832+0000 7fa6875c7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa680149410 con 0x7fa68013f8e0 2024-09-13T18:45:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.832+0000 7fa6875c7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6800b4550 con 0x7fa6800b31d0 2024-09-13T18:45:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.832+0000 7fa6875c7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800b4810 con 0x7fa6800b35b0 2024-09-13T18:45:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.832+0000 7fa685363640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6800b31d0 0x7fa6800b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.832+0000 7fa685363640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6800b31d0 0x7fa6800b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58994/0 (socket says 172.21.15.29:58994) 2024-09-13T18:45:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.832+0000 7fa685363640 1 -- 172.21.15.29:0/2534342120 learned_addr learned my addr 172.21.15.29:0/2534342120 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.833+0000 7fa684b62640 1 --2- 172.21.15.29:0/2534342120 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6800b35b0 0x7fa6801498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.833+0000 7fa685363640 1 -- 172.21.15.29:0/2534342120 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6800b35b0 msgr2=0x7fa6801498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.833+0000 7fa685363640 1 --2- 172.21.15.29:0/2534342120 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6800b35b0 0x7fa6801498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.833+0000 7fa685363640 1 -- 172.21.15.29:0/2534342120 >> v1:172.21.15.96:6789/0 conn(0x7fa68013f8e0 legacy=0x7fa68013fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.833+0000 7fa685363640 1 -- 172.21.15.29:0/2534342120 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6801490a0 con 0x7fa6800b31d0 2024-09-13T18:45:43.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.833+0000 7fa685363640 1 --2- 172.21.15.29:0/2534342120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6800b31d0 0x7fa6800b4010 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009870 tx=0x7fa67c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b6bcb53f642656 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.834+0000 7fa677fff640 1 -- 172.21.15.29:0/2534342120 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c032440 con 0x7fa6800b31d0 2024-09-13T18:45:43.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.834+0000 7fa677fff640 1 -- 172.21.15.29:0/2534342120 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c0325a0 con 0x7fa6800b31d0 2024-09-13T18:45:43.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.834+0000 7fa677fff640 1 -- 172.21.15.29:0/2534342120 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c032930 con 0x7fa6800b31d0 2024-09-13T18:45:43.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.834+0000 7fa6875c7640 1 -- 172.21.15.29:0/2534342120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6800b31d0 msgr2=0x7fa6800b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.834+0000 7fa6875c7640 1 --2- 172.21.15.29:0/2534342120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6800b31d0 0x7fa6800b4010 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009870 tx=0x7fa67c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.834+0000 7fa6875c7640 1 -- 172.21.15.29:0/2534342120 shutdown_connections 2024-09-13T18:45:43.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.834+0000 7fa6875c7640 1 --2- 172.21.15.29:0/2534342120 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6800b35b0 0x7fa6801498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.834+0000 7fa6875c7640 1 --2- 172.21.15.29:0/2534342120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6800b31d0 0x7fa6800b4010 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.834+0000 7fa6875c7640 1 -- 172.21.15.29:0/2534342120 >> 172.21.15.29:0/2534342120 conn(0x7fa6800bb590 msgr2=0x7fa6800bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:43.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.834+0000 7fa6875c7640 1 -- 172.21.15.29:0/2534342120 shutdown_connections 2024-09-13T18:45:43.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.834+0000 7fa6875c7640 1 -- 172.21.15.29:0/2534342120 wait complete. 2024-09-13T18:45:43.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.835+0000 7fa6875c7640 1 Processor -- start 2024-09-13T18:45:43.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.835+0000 7fa6875c7640 1 -- start start 2024-09-13T18:45:43.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa6875c7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6800b31d0 0x7fa68013bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa6875c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6800b35b0 0x7fa6801daa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa6875c7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa68013f8e0 0x7fa6800b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa6875c7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa680144ec0 con 0x7fa6800b35b0 2024-09-13T18:45:43.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa6875c7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa680146a10 con 0x7fa6800b31d0 2024-09-13T18:45:43.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa6875c7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa680146380 con 0x7fa68013f8e0 2024-09-13T18:45:43.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa684b62640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6800b35b0 0x7fa6801daa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa684b62640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6800b35b0 0x7fa6801daa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58998/0 (socket says 172.21.15.29:58998) 2024-09-13T18:45:43.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa684b62640 1 -- 172.21.15.29:0/3342706594 learned_addr learned my addr 172.21.15.29:0/3342706594 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:43.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa685363640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6800b31d0 0x7fa68013bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa685b64640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa68013f8e0 0x7fa6800b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa684b62640 1 -- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa68013f8e0 msgr2=0x7fa6800b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa684b62640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa68013f8e0 0x7fa6800b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa684b62640 1 -- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6800b31d0 msgr2=0x7fa68013bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa684b62640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6800b31d0 0x7fa68013bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.836+0000 7fa684b62640 1 -- 172.21.15.29:0/3342706594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0094d0 con 0x7fa6800b35b0 2024-09-13T18:45:43.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.837+0000 7fa684b62640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6800b35b0 0x7fa6801daa00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa67000d800 tx=0x7fa67000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.837+0000 7fa675ffb640 1 -- 172.21.15.29:0/3342706594 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670004030 con 0x7fa6800b35b0 2024-09-13T18:45:43.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.837+0000 7fa675ffb640 1 -- 172.21.15.29:0/3342706594 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa670004190 con 0x7fa6800b35b0 2024-09-13T18:45:43.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.837+0000 7fa6875c7640 1 -- 172.21.15.29:0/3342706594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6801427e0 con 0x7fa6800b35b0 2024-09-13T18:45:43.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.837+0000 7fa675ffb640 1 -- 172.21.15.29:0/3342706594 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67000b6c0 con 0x7fa6800b35b0 2024-09-13T18:45:43.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.837+0000 7fa6875c7640 1 -- 172.21.15.29:0/3342706594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa680146660 con 0x7fa6800b35b0 2024-09-13T18:45:43.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.838+0000 7fa6875c7640 1 -- 172.21.15.29:0/3342706594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa680067300 con 0x7fa6800b35b0 2024-09-13T18:45:43.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.839+0000 7fa675ffb640 1 -- 172.21.15.29:0/3342706594 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa67000b820 con 0x7fa6800b35b0 2024-09-13T18:45:43.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.839+0000 7fa675ffb640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa66406ac30 0x7fa66406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.839+0000 7fa675ffb640 1 -- 172.21.15.29:0/3342706594 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa670089670 con 0x7fa6800b35b0 2024-09-13T18:45:43.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.839+0000 7fa685363640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa66406ac30 0x7fa66406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.840+0000 7fa685363640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa66406ac30 0x7fa66406d0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa67c034000 tx=0x7fa67c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:43.843+0000 7fa675ffb640 1 -- 172.21.15.29:0/3342706594 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa6700546a0 con 0x7fa6800b35b0 2024-09-13T18:45:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.012+0000 7fa6875c7640 1 -- 172.21.15.29:0/3342706594 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6801464f0 con 0x7fa66406ac30 2024-09-13T18:45:44.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.022+0000 7fa675ffb640 1 -- 172.21.15.29:0/3342706594 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345377 (secure 0 0 0) 0x7fa6801464f0 con 0x7fa66406ac30 2024-09-13T18:45:44.030 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:44.032 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-13T18:45:44.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.026+0000 7fa6875c7640 1 -- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa66406ac30 msgr2=0x7fa66406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.026+0000 7fa6875c7640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa66406ac30 0x7fa66406d0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa67c034000 tx=0x7fa67c02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:44.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.026+0000 7fa6875c7640 1 -- 172.21.15.29:0/3342706594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6800b35b0 msgr2=0x7fa6801daa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.026+0000 7fa6875c7640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6800b35b0 0x7fa6801daa00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa67000d800 tx=0x7fa67000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.026+0000 7fa6875c7640 1 -- 172.21.15.29:0/3342706594 shutdown_connections 2024-09-13T18:45:44.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.026+0000 7fa6875c7640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa66406ac30 0x7fa66406d0f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.026+0000 7fa6875c7640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa68013f8e0 0x7fa6800b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.026+0000 7fa6875c7640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6800b35b0 0x7fa6801daa00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.026+0000 7fa6875c7640 1 --2- 172.21.15.29:0/3342706594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6800b31d0 0x7fa68013bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.026+0000 7fa6875c7640 1 -- 172.21.15.29:0/3342706594 >> 172.21.15.29:0/3342706594 conn(0x7fa6800bb590 msgr2=0x7fa68013ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:44.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.026+0000 7fa6875c7640 1 -- 172.21.15.29:0/3342706594 shutdown_connections 2024-09-13T18:45:44.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.026+0000 7fa6875c7640 1 -- 172.21.15.29:0/3342706594 wait complete. 2024-09-13T18:45:44.040 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-13T18:45:43.592196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234748,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739972,"statfs":{"total":773094113280,"available":772853731328,"internally_reserved":0,"allocated":2228224,"data_stored":1985074,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003189"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.052330+0000","last_change":"2024-09-13T18:45:21.668274+0000","last_active":"2024-09-13T18:45:26.052330+0000","last_peered":"2024-09-13T18:45:26.052330+0000","last_clean":"2024-09-13T18:45:26.052330+0000","last_became_active":"2024-09-13T18:45:21.667985+0000","last_became_peered":"2024-09-13T18:45:21.667985+0000","last_unstale":"2024-09-13T18:45:26.052330+0000","last_undegraded":"2024-09-13T18:45:26.052330+0000","last_fullsized":"2024-09-13T18:45:26.052330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:45.703424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601092+0000","last_change":"2024-09-13T18:45:22.034389+0000","last_active":"2024-09-13T18:45:26.601092+0000","last_peered":"2024-09-13T18:45:26.601092+0000","last_clean":"2024-09-13T18:45:26.601092+0000","last_became_active":"2024-09-13T18:45:22.034125+0000","last_became_peered":"2024-09-13T18:45:22.034125+0000","last_unstale":"2024-09-13T18:45:26.601092+0000","last_undegraded":"2024-09-13T18:45:26.601092+0000","last_fullsized":"2024-09-13T18:45:26.601092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600983+0000","last_change":"2024-09-13T18:45:26.253118+0000","last_active":"2024-09-13T18:45:26.600983+0000","last_peered":"2024-09-13T18:45:26.600983+0000","last_clean":"2024-09-13T18:45:26.600983+0000","last_became_active":"2024-09-13T18:45:26.252747+0000","last_became_peered":"2024-09-13T18:45:26.252747+0000","last_unstale":"2024-09-13T18:45:26.600983+0000","last_undegraded":"2024-09-13T18:45:26.600983+0000","last_fullsized":"2024-09-13T18:45:26.600983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:11.065130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.036006+0000","last_change":"2024-09-13T18:45:21.666664+0000","last_active":"2024-09-13T18:45:26.036006+0000","last_peered":"2024-09-13T18:45:26.036006+0000","last_clean":"2024-09-13T18:45:26.036006+0000","last_became_active":"2024-09-13T18:45:21.666398+0000","last_became_peered":"2024-09-13T18:45:21.666398+0000","last_unstale":"2024-09-13T18:45:26.036006+0000","last_undegraded":"2024-09-13T18:45:26.036006+0000","last_fullsized":"2024-09-13T18:45:26.036006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:06.210838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599906+0000","last_change":"2024-09-13T18:45:22.024774+0000","last_active":"2024-09-13T18:45:26.599906+0000","last_peered":"2024-09-13T18:45:26.599906+0000","last_clean":"2024-09-13T18:45:26.599906+0000","last_became_active":"2024-09-13T18:45:22.024424+0000","last_became_peered":"2024-09-13T18:45:22.024424+0000","last_unstale":"2024-09-13T18:45:26.599906+0000","last_undegraded":"2024-09-13T18:45:26.599906+0000","last_fullsized":"2024-09-13T18:45:26.599906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409608+0000","last_change":"2024-09-13T18:45:26.050411+0000","last_active":"2024-09-13T18:45:26.409608+0000","last_peered":"2024-09-13T18:45:26.409608+0000","last_clean":"2024-09-13T18:45:26.409608+0000","last_became_active":"2024-09-13T18:45:26.049414+0000","last_became_peered":"2024-09-13T18:45:26.049414+0000","last_unstale":"2024-09-13T18:45:26.409608+0000","last_undegraded":"2024-09-13T18:45:26.409608+0000","last_fullsized":"2024-09-13T18:45:26.409608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.251372+0000","last_change":"2024-09-13T18:45:21.667928+0000","last_active":"2024-09-13T18:45:26.251372+0000","last_peered":"2024-09-13T18:45:26.251372+0000","last_clean":"2024-09-13T18:45:26.251372+0000","last_became_active":"2024-09-13T18:45:21.667602+0000","last_became_peered":"2024-09-13T18:45:21.667602+0000","last_unstale":"2024-09-13T18:45:26.251372+0000","last_undegraded":"2024-09-13T18:45:26.251372+0000","last_fullsized":"2024-09-13T18:45:26.251372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:53.936326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600361+0000","last_change":"2024-09-13T18:45:22.036952+0000","last_active":"2024-09-13T18:45:26.600361+0000","last_peered":"2024-09-13T18:45:26.600361+0000","last_clean":"2024-09-13T18:45:26.600361+0000","last_became_active":"2024-09-13T18:45:22.035790+0000","last_became_peered":"2024-09-13T18:45:22.035790+0000","last_unstale":"2024-09-13T18:45:26.600361+0000","last_undegraded":"2024-09-13T18:45:26.600361+0000","last_fullsized":"2024-09-13T18:45:26.600361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410405+0000","last_change":"2024-09-13T18:45:26.052333+0000","last_active":"2024-09-13T18:45:26.410405+0000","last_peered":"2024-09-13T18:45:26.410405+0000","last_clean":"2024-09-13T18:45:26.410405+0000","last_became_active":"2024-09-13T18:45:26.051873+0000","last_became_peered":"2024-09-13T18:45:26.051873+0000","last_unstale":"2024-09-13T18:45:26.410405+0000","last_undegraded":"2024-09-13T18:45:26.410405+0000","last_fullsized":"2024-09-13T18:45:26.410405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:03.925946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.250039+0000","last_change":"2024-09-13T18:45:21.669914+0000","last_active":"2024-09-13T18:45:26.250039+0000","last_peered":"2024-09-13T18:45:26.250039+0000","last_clean":"2024-09-13T18:45:26.250039+0000","last_became_active":"2024-09-13T18:45:21.669622+0000","last_became_peered":"2024-09-13T18:45:21.669622+0000","last_unstale":"2024-09-13T18:45:26.250039+0000","last_undegraded":"2024-09-13T18:45:26.250039+0000","last_fullsized":"2024-09-13T18:45:26.250039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.765670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600397+0000","last_change":"2024-09-13T18:45:22.035675+0000","last_active":"2024-09-13T18:45:26.600397+0000","last_peered":"2024-09-13T18:45:26.600397+0000","last_clean":"2024-09-13T18:45:26.600397+0000","last_became_active":"2024-09-13T18:45:22.034431+0000","last_became_peered":"2024-09-13T18:45:22.034431+0000","last_unstale":"2024-09-13T18:45:26.600397+0000","last_undegraded":"2024-09-13T18:45:26.600397+0000","last_fullsized":"2024-09-13T18:45:26.600397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410278+0000","last_change":"2024-09-13T18:45:26.052892+0000","last_active":"2024-09-13T18:45:26.410278+0000","last_peered":"2024-09-13T18:45:26.410278+0000","last_clean":"2024-09-13T18:45:26.410278+0000","last_became_active":"2024-09-13T18:45:26.052441+0000","last_became_peered":"2024-09-13T18:45:26.052441+0000","last_unstale":"2024-09-13T18:45:26.410278+0000","last_undegraded":"2024-09-13T18:45:26.410278+0000","last_fullsized":"2024-09-13T18:45:26.410278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:26.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409959+0000","last_change":"2024-09-13T18:45:22.017741+0000","last_active":"2024-09-13T18:45:26.409959+0000","last_peered":"2024-09-13T18:45:26.409959+0000","last_clean":"2024-09-13T18:45:26.409959+0000","last_became_active":"2024-09-13T18:45:22.015758+0000","last_became_peered":"2024-09-13T18:45:22.015758+0000","last_unstale":"2024-09-13T18:45:26.409959+0000","last_undegraded":"2024-09-13T18:45:26.409959+0000","last_fullsized":"2024-09-13T18:45:26.409959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.250273+0000","last_change":"2024-09-13T18:45:21.672627+0000","last_active":"2024-09-13T18:45:26.250273+0000","last_peered":"2024-09-13T18:45:26.250273+0000","last_clean":"2024-09-13T18:45:26.250273+0000","last_became_active":"2024-09-13T18:45:21.672388+0000","last_became_peered":"2024-09-13T18:45:21.672388+0000","last_unstale":"2024-09-13T18:45:26.250273+0000","last_undegraded":"2024-09-13T18:45:26.250273+0000","last_fullsized":"2024-09-13T18:45:26.250273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410013+0000","last_change":"2024-09-13T18:45:26.052609+0000","last_active":"2024-09-13T18:45:26.410013+0000","last_peered":"2024-09-13T18:45:26.410013+0000","last_clean":"2024-09-13T18:45:26.410013+0000","last_became_active":"2024-09-13T18:45:26.052245+0000","last_became_peered":"2024-09-13T18:45:26.052245+0000","last_unstale":"2024-09-13T18:45:26.410013+0000","last_undegraded":"2024-09-13T18:45:26.410013+0000","last_fullsized":"2024-09-13T18:45:26.410013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:50.583636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601039+0000","last_change":"2024-09-13T18:45:22.028858+0000","last_active":"2024-09-13T18:45:26.601039+0000","last_peered":"2024-09-13T18:45:26.601039+0000","last_clean":"2024-09-13T18:45:26.601039+0000","last_became_active":"2024-09-13T18:45:22.028336+0000","last_became_peered":"2024-09-13T18:45:22.028336+0000","last_unstale":"2024-09-13T18:45:26.601039+0000","last_undegraded":"2024-09-13T18:45:26.601039+0000","last_fullsized":"2024-09-13T18:45:26.601039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.046785+0000","last_change":"2024-09-13T18:45:21.667983+0000","last_active":"2024-09-13T18:45:26.046785+0000","last_peered":"2024-09-13T18:45:26.046785+0000","last_clean":"2024-09-13T18:45:26.046785+0000","last_became_active":"2024-09-13T18:45:21.667625+0000","last_became_peered":"2024-09-13T18:45:21.667625+0000","last_unstale":"2024-09-13T18:45:26.046785+0000","last_undegraded":"2024-09-13T18:45:26.046785+0000","last_fullsized":"2024-09-13T18:45:26.046785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409827+0000","last_change":"2024-09-13T18:45:26.050576+0000","last_active":"2024-09-13T18:45:26.409827+0000","last_peered":"2024-09-13T18:45:26.409827+0000","last_clean":"2024-09-13T18:45:26.409827+0000","last_became_active":"2024-09-13T18:45:26.049129+0000","last_became_peered":"2024-09-13T18:45:26.049129+0000","last_unstale":"2024-09-13T18:45:26.409827+0000","last_undegraded":"2024-09-13T18:45:26.409827+0000","last_fullsized":"2024-09-13T18:45:26.409827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600972+0000","last_change":"2024-09-13T18:45:22.025900+0000","last_active":"2024-09-13T18:45:26.600972+0000","last_peered":"2024-09-13T18:45:26.600972+0000","last_clean":"2024-09-13T18:45:26.600972+0000","last_became_active":"2024-09-13T18:45:22.025624+0000","last_became_peered":"2024-09-13T18:45:22.025624+0000","last_unstale":"2024-09-13T18:45:26.600972+0000","last_undegraded":"2024-09-13T18:45:26.600972+0000","last_fullsized":"2024-09-13T18:45:26.600972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.045814+0000","last_change":"2024-09-13T18:45:21.668525+0000","last_active":"2024-09-13T18:45:26.045814+0000","last_peered":"2024-09-13T18:45:26.045814+0000","last_clean":"2024-09-13T18:45:26.045814+0000","last_became_active":"2024-09-13T18:45:21.668242+0000","last_became_peered":"2024-09-13T18:45:21.668242+0000","last_unstale":"2024-09-13T18:45:26.045814+0000","last_undegraded":"2024-09-13T18:45:26.045814+0000","last_fullsized":"2024-09-13T18:45:26.045814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605435+0000","last_change":"2024-09-13T18:45:26.255263+0000","last_active":"2024-09-13T18:45:26.605435+0000","last_peered":"2024-09-13T18:45:26.605435+0000","last_clean":"2024-09-13T18:45:26.605435+0000","last_became_active":"2024-09-13T18:45:26.254886+0000","last_became_peered":"2024-09-13T18:45:26.254886+0000","last_unstale":"2024-09-13T18:45:26.605435+0000","last_undegraded":"2024-09-13T18:45:26.605435+0000","last_fullsized":"2024-09-13T18:45:26.605435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410916+0000","last_change":"2024-09-13T18:45:22.029624+0000","last_active":"2024-09-13T18:45:26.410916+0000","last_peered":"2024-09-13T18:45:26.410916+0000","last_clean":"2024-09-13T18:45:26.410916+0000","last_became_active":"2024-09-13T18:45:22.027835+0000","last_became_peered":"2024-09-13T18:45:22.027835+0000","last_unstale":"2024-09-13T18:45:26.410916+0000","last_undegraded":"2024-09-13T18:45:26.410916+0000","last_fullsized":"2024-09-13T18:45:26.410916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:16.317986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.249681+0000","last_change":"2024-09-13T18:45:21.669073+0000","last_active":"2024-09-13T18:45:26.249681+0000","last_peered":"2024-09-13T18:45:26.249681+0000","last_clean":"2024-09-13T18:45:26.249681+0000","last_became_active":"2024-09-13T18:45:21.668765+0000","last_became_peered":"2024-09-13T18:45:21.668765+0000","last_unstale":"2024-09-13T18:45:26.249681+0000","last_undegraded":"2024-09-13T18:45:26.249681+0000","last_fullsized":"2024-09-13T18:45:26.249681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409880+0000","last_change":"2024-09-13T18:45:26.050623+0000","last_active":"2024-09-13T18:45:26.409880+0000","last_peered":"2024-09-13T18:45:26.409880+0000","last_clean":"2024-09-13T18:45:26.409880+0000","last_became_active":"2024-09-13T18:45:26.049408+0000","last_became_peered":"2024-09-13T18:45:26.049408+0000","last_unstale":"2024-09-13T18:45:26.409880+0000","last_undegraded":"2024-09-13T18:45:26.409880+0000","last_fullsized":"2024-09-13T18:45:26.409880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:14.574386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599890+0000","last_change":"2024-09-13T18:45:22.022220+0000","last_active":"2024-09-13T18:45:26.599890+0000","last_peered":"2024-09-13T18:45:26.599890+0000","last_clean":"2024-09-13T18:45:26.599890+0000","last_became_active":"2024-09-13T18:45:22.021976+0000","last_became_peered":"2024-09-13T18:45:22.021976+0000","last_unstale":"2024-09-13T18:45:26.599890+0000","last_undegraded":"2024-09-13T18:45:26.599890+0000","last_fullsized":"2024-09-13T18:45:26.599890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.037252+0000","last_change":"2024-09-13T18:45:21.667931+0000","last_active":"2024-09-13T18:45:26.037252+0000","last_peered":"2024-09-13T18:45:26.037252+0000","last_clean":"2024-09-13T18:45:26.037252+0000","last_became_active":"2024-09-13T18:45:21.667680+0000","last_became_peered":"2024-09-13T18:45:21.667680+0000","last_unstale":"2024-09-13T18:45:26.037252+0000","last_undegraded":"2024-09-13T18:45:26.037252+0000","last_fullsized":"2024-09-13T18:45:26.037252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410658+0000","last_change":"2024-09-13T18:45:26.255088+0000","last_active":"2024-09-13T18:45:26.410658+0000","last_peered":"2024-09-13T18:45:26.410658+0000","last_clean":"2024-09-13T18:45:26.410658+0000","last_became_active":"2024-09-13T18:45:26.254662+0000","last_became_peered":"2024-09-13T18:45:26.254662+0000","last_unstale":"2024-09-13T18:45:26.410658+0000","last_undegraded":"2024-09-13T18:45:26.410658+0000","last_fullsized":"2024-09-13T18:45:26.410658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601131+0000","last_change":"2024-09-13T18:45:22.026678+0000","last_active":"2024-09-13T18:45:26.601131+0000","last_peered":"2024-09-13T18:45:26.601131+0000","last_clean":"2024-09-13T18:45:26.601131+0000","last_became_active":"2024-09-13T18:45:22.026419+0000","last_became_peered":"2024-09-13T18:45:22.026419+0000","last_unstale":"2024-09-13T18:45:26.601131+0000","last_undegraded":"2024-09-13T18:45:26.601131+0000","last_fullsized":"2024-09-13T18:45:26.601131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.043788+0000","last_change":"2024-09-13T18:45:21.664622+0000","last_active":"2024-09-13T18:45:26.043788+0000","last_peered":"2024-09-13T18:45:26.043788+0000","last_clean":"2024-09-13T18:45:26.043788+0000","last_became_active":"2024-09-13T18:45:21.664066+0000","last_became_peered":"2024-09-13T18:45:21.664066+0000","last_unstale":"2024-09-13T18:45:26.043788+0000","last_undegraded":"2024-09-13T18:45:26.043788+0000","last_fullsized":"2024-09-13T18:45:26.043788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600919+0000","last_change":"2024-09-13T18:45:26.253888+0000","last_active":"2024-09-13T18:45:26.600919+0000","last_peered":"2024-09-13T18:45:26.600919+0000","last_clean":"2024-09-13T18:45:26.600919+0000","last_became_active":"2024-09-13T18:45:26.253488+0000","last_became_peered":"2024-09-13T18:45:26.253488+0000","last_unstale":"2024-09-13T18:45:26.600919+0000","last_undegraded":"2024-09-13T18:45:26.600919+0000","last_fullsized":"2024-09-13T18:45:26.600919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:44.826493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605373+0000","last_change":"2024-09-13T18:45:22.022940+0000","last_active":"2024-09-13T18:45:26.605373+0000","last_peered":"2024-09-13T18:45:26.605373+0000","last_clean":"2024-09-13T18:45:26.605373+0000","last_became_active":"2024-09-13T18:45:22.022628+0000","last_became_peered":"2024-09-13T18:45:22.022628+0000","last_unstale":"2024-09-13T18:45:26.605373+0000","last_undegraded":"2024-09-13T18:45:26.605373+0000","last_fullsized":"2024-09-13T18:45:26.605373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.251762+0000","last_change":"2024-09-13T18:45:21.668903+0000","last_active":"2024-09-13T18:45:26.251762+0000","last_peered":"2024-09-13T18:45:26.251762+0000","last_clean":"2024-09-13T18:45:26.251762+0000","last_became_active":"2024-09-13T18:45:21.668645+0000","last_became_peered":"2024-09-13T18:45:21.668645+0000","last_unstale":"2024-09-13T18:45:26.251762+0000","last_undegraded":"2024-09-13T18:45:26.251762+0000","last_fullsized":"2024-09-13T18:45:26.251762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599791+0000","last_change":"2024-09-13T18:45:26.250454+0000","last_active":"2024-09-13T18:45:26.599791+0000","last_peered":"2024-09-13T18:45:26.599791+0000","last_clean":"2024-09-13T18:45:26.599791+0000","last_became_active":"2024-09-13T18:45:26.250034+0000","last_became_peered":"2024-09-13T18:45:26.250034+0000","last_unstale":"2024-09-13T18:45:26.599791+0000","last_undegraded":"2024-09-13T18:45:26.599791+0000","last_fullsized":"2024-09-13T18:45:26.599791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.971516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600409+0000","last_change":"2024-09-13T18:45:22.032362+0000","last_active":"2024-09-13T18:45:26.600409+0000","last_peered":"2024-09-13T18:45:26.600409+0000","last_clean":"2024-09-13T18:45:26.600409+0000","last_became_active":"2024-09-13T18:45:22.032022+0000","last_became_peered":"2024-09-13T18:45:22.032022+0000","last_unstale":"2024-09-13T18:45:26.600409+0000","last_undegraded":"2024-09-13T18:45:26.600409+0000","last_fullsized":"2024-09-13T18:45:26.600409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.046217+0000","last_change":"2024-09-13T18:45:21.661117+0000","last_active":"2024-09-13T18:45:26.046217+0000","last_peered":"2024-09-13T18:45:26.046217+0000","last_clean":"2024-09-13T18:45:26.046217+0000","last_became_active":"2024-09-13T18:45:21.660577+0000","last_became_peered":"2024-09-13T18:45:21.660577+0000","last_unstale":"2024-09-13T18:45:26.046217+0000","last_undegraded":"2024-09-13T18:45:26.046217+0000","last_fullsized":"2024-09-13T18:45:26.046217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605338+0000","last_change":"2024-09-13T18:45:26.056021+0000","last_active":"2024-09-13T18:45:26.605338+0000","last_peered":"2024-09-13T18:45:26.605338+0000","last_clean":"2024-09-13T18:45:26.605338+0000","last_became_active":"2024-09-13T18:45:26.053877+0000","last_became_peered":"2024-09-13T18:45:26.053877+0000","last_unstale":"2024-09-13T18:45:26.605338+0000","last_undegraded":"2024-09-13T18:45:26.605338+0000","last_fullsized":"2024-09-13T18:45:26.605338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:51.489422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.411006+0000","last_change":"2024-09-13T18:45:22.029936+0000","last_active":"2024-09-13T18:45:26.411006+0000","last_peered":"2024-09-13T18:45:26.411006+0000","last_clean":"2024-09-13T18:45:26.411006+0000","last_became_active":"2024-09-13T18:45:22.028714+0000","last_became_peered":"2024-09-13T18:45:22.028714+0000","last_unstale":"2024-09-13T18:45:26.411006+0000","last_undegraded":"2024-09-13T18:45:26.411006+0000","last_fullsized":"2024-09-13T18:45:26.411006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:35.746368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044364+0000","last_change":"2024-09-13T18:45:21.667926+0000","last_active":"2024-09-13T18:45:26.044364+0000","last_peered":"2024-09-13T18:45:26.044364+0000","last_clean":"2024-09-13T18:45:26.044364+0000","last_became_active":"2024-09-13T18:45:21.667320+0000","last_became_peered":"2024-09-13T18:45:21.667320+0000","last_unstale":"2024-09-13T18:45:26.044364+0000","last_undegraded":"2024-09-13T18:45:26.044364+0000","last_fullsized":"2024-09-13T18:45:26.044364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605364+0000","last_change":"2024-09-13T18:45:26.055615+0000","last_active":"2024-09-13T18:45:26.605364+0000","last_peered":"2024-09-13T18:45:26.605364+0000","last_clean":"2024-09-13T18:45:26.605364+0000","last_became_active":"2024-09-13T18:45:26.053681+0000","last_became_peered":"2024-09-13T18:45:26.053681+0000","last_unstale":"2024-09-13T18:45:26.605364+0000","last_undegraded":"2024-09-13T18:45:26.605364+0000","last_fullsized":"2024-09-13T18:45:26.605364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605300+0000","last_change":"2024-09-13T18:45:22.023623+0000","last_active":"2024-09-13T18:45:26.605300+0000","last_peered":"2024-09-13T18:45:26.605300+0000","last_clean":"2024-09-13T18:45:26.605300+0000","last_became_active":"2024-09-13T18:45:22.023357+0000","last_became_peered":"2024-09-13T18:45:22.023357+0000","last_unstale":"2024-09-13T18:45:26.605300+0000","last_undegraded":"2024-09-13T18:45:26.605300+0000","last_fullsized":"2024-09-13T18:45:26.605300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.039394+0000","last_change":"2024-09-13T18:45:21.668065+0000","last_active":"2024-09-13T18:45:26.039394+0000","last_peered":"2024-09-13T18:45:26.039394+0000","last_clean":"2024-09-13T18:45:26.039394+0000","last_became_active":"2024-09-13T18:45:21.667768+0000","last_became_peered":"2024-09-13T18:45:21.667768+0000","last_unstale":"2024-09-13T18:45:26.039394+0000","last_undegraded":"2024-09-13T18:45:26.039394+0000","last_fullsized":"2024-09-13T18:45:26.039394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605444+0000","last_change":"2024-09-13T18:45:26.057274+0000","last_active":"2024-09-13T18:45:26.605444+0000","last_peered":"2024-09-13T18:45:26.605444+0000","last_clean":"2024-09-13T18:45:26.605444+0000","last_became_active":"2024-09-13T18:45:26.056850+0000","last_became_peered":"2024-09-13T18:45:26.056850+0000","last_unstale":"2024-09-13T18:45:26.605444+0000","last_undegraded":"2024-09-13T18:45:26.605444+0000","last_fullsized":"2024-09-13T18:45:26.605444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.971516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599753+0000","last_change":"2024-09-13T18:45:22.020577+0000","last_active":"2024-09-13T18:45:26.599753+0000","last_peered":"2024-09-13T18:45:26.599753+0000","last_clean":"2024-09-13T18:45:26.599753+0000","last_became_active":"2024-09-13T18:45:22.020317+0000","last_became_peered":"2024-09-13T18:45:22.020317+0000","last_unstale":"2024-09-13T18:45:26.599753+0000","last_undegraded":"2024-09-13T18:45:26.599753+0000","last_fullsized":"2024-09-13T18:45:26.599753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.249771+0000","last_change":"2024-09-13T18:45:21.667753+0000","last_active":"2024-09-13T18:45:26.249771+0000","last_peered":"2024-09-13T18:45:26.249771+0000","last_clean":"2024-09-13T18:45:26.249771+0000","last_became_active":"2024-09-13T18:45:21.667483+0000","last_became_peered":"2024-09-13T18:45:21.667483+0000","last_unstale":"2024-09-13T18:45:26.249771+0000","last_undegraded":"2024-09-13T18:45:26.249771+0000","last_fullsized":"2024-09-13T18:45:26.249771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:22.171336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599881+0000","last_change":"2024-09-13T18:45:26.254703+0000","last_active":"2024-09-13T18:45:26.599881+0000","last_peered":"2024-09-13T18:45:26.599881+0000","last_clean":"2024-09-13T18:45:26.599881+0000","last_became_active":"2024-09-13T18:45:26.253533+0000","last_became_peered":"2024-09-13T18:45:26.253533+0000","last_unstale":"2024-09-13T18:45:26.599881+0000","last_undegraded":"2024-09-13T18:45:26.599881+0000","last_fullsized":"2024-09-13T18:45:26.599881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601018+0000","last_change":"2024-09-13T18:45:22.032365+0000","last_active":"2024-09-13T18:45:26.601018+0000","last_peered":"2024-09-13T18:45:26.601018+0000","last_clean":"2024-09-13T18:45:26.601018+0000","last_became_active":"2024-09-13T18:45:22.032109+0000","last_became_peered":"2024-09-13T18:45:22.032109+0000","last_unstale":"2024-09-13T18:45:26.601018+0000","last_undegraded":"2024-09-13T18:45:26.601018+0000","last_fullsized":"2024-09-13T18:45:26.601018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044305+0000","last_change":"2024-09-13T18:45:21.662636+0000","last_active":"2024-09-13T18:45:26.044305+0000","last_peered":"2024-09-13T18:45:26.044305+0000","last_clean":"2024-09-13T18:45:26.044305+0000","last_became_active":"2024-09-13T18:45:21.662344+0000","last_became_peered":"2024-09-13T18:45:21.662344+0000","last_unstale":"2024-09-13T18:45:26.044305+0000","last_undegraded":"2024-09-13T18:45:26.044305+0000","last_fullsized":"2024-09-13T18:45:26.044305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.249885+0000","last_change":"2024-09-13T18:45:19.778048+0000","last_active":"2024-09-13T18:45:26.249885+0000","last_peered":"2024-09-13T18:45:26.249885+0000","last_clean":"2024-09-13T18:45:26.249885+0000","last_became_active":"2024-09-13T18:45:19.777172+0000","last_became_peered":"2024-09-13T18:45:19.777172+0000","last_unstale":"2024-09-13T18:45:26.249885+0000","last_undegraded":"2024-09-13T18:45:26.249885+0000","last_fullsized":"2024-09-13T18:45:26.249885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_clean_scrub_stamp":"2024-09-13T18:45:17.981407+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:51.905955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410145+0000","last_change":"2024-09-13T18:45:26.253260+0000","last_active":"2024-09-13T18:45:26.410145+0000","last_peered":"2024-09-13T18:45:26.410145+0000","last_clean":"2024-09-13T18:45:26.410145+0000","last_became_active":"2024-09-13T18:45:26.252890+0000","last_became_peered":"2024-09-13T18:45:26.252890+0000","last_unstale":"2024-09-13T18:45:26.410145+0000","last_undegraded":"2024-09-13T18:45:26.410145+0000","last_fullsized":"2024-09-13T18:45:26.410145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599981+0000","last_change":"2024-09-13T18:45:22.036446+0000","last_active":"2024-09-13T18:45:26.599981+0000","last_peered":"2024-09-13T18:45:26.599981+0000","last_clean":"2024-09-13T18:45:26.599981+0000","last_became_active":"2024-09-13T18:45:22.036153+0000","last_became_peered":"2024-09-13T18:45:22.036153+0000","last_unstale":"2024-09-13T18:45:26.599981+0000","last_undegraded":"2024-09-13T18:45:26.599981+0000","last_fullsized":"2024-09-13T18:45:26.599981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.041776+0000","last_change":"2024-09-13T18:45:21.665847+0000","last_active":"2024-09-13T18:45:26.041776+0000","last_peered":"2024-09-13T18:45:26.041776+0000","last_clean":"2024-09-13T18:45:26.041776+0000","last_became_active":"2024-09-13T18:45:21.665582+0000","last_became_peered":"2024-09-13T18:45:21.665582+0000","last_unstale":"2024-09-13T18:45:26.041776+0000","last_undegraded":"2024-09-13T18:45:26.041776+0000","last_fullsized":"2024-09-13T18:45:26.041776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409441+0000","last_change":"2024-09-13T18:45:26.250391+0000","last_active":"2024-09-13T18:45:26.409441+0000","last_peered":"2024-09-13T18:45:26.409441+0000","last_clean":"2024-09-13T18:45:26.409441+0000","last_became_active":"2024-09-13T18:45:26.249986+0000","last_became_peered":"2024-09-13T18:45:26.249986+0000","last_unstale":"2024-09-13T18:45:26.409441+0000","last_undegraded":"2024-09-13T18:45:26.409441+0000","last_fullsized":"2024-09-13T18:45:26.409441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600372+0000","last_change":"2024-09-13T18:45:22.037142+0000","last_active":"2024-09-13T18:45:26.600372+0000","last_peered":"2024-09-13T18:45:26.600372+0000","last_clean":"2024-09-13T18:45:26.600372+0000","last_became_active":"2024-09-13T18:45:22.036523+0000","last_became_peered":"2024-09-13T18:45:22.036523+0000","last_unstale":"2024-09-13T18:45:26.600372+0000","last_undegraded":"2024-09-13T18:45:26.600372+0000","last_fullsized":"2024-09-13T18:45:26.600372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.045297+0000","last_change":"2024-09-13T18:45:21.662924+0000","last_active":"2024-09-13T18:45:26.045297+0000","last_peered":"2024-09-13T18:45:26.045297+0000","last_clean":"2024-09-13T18:45:26.045297+0000","last_became_active":"2024-09-13T18:45:21.662405+0000","last_became_peered":"2024-09-13T18:45:21.662405+0000","last_unstale":"2024-09-13T18:45:26.045297+0000","last_undegraded":"2024-09-13T18:45:26.045297+0000","last_fullsized":"2024-09-13T18:45:26.045297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599813+0000","last_change":"2024-09-13T18:45:26.055309+0000","last_active":"2024-09-13T18:45:26.599813+0000","last_peered":"2024-09-13T18:45:26.599813+0000","last_clean":"2024-09-13T18:45:26.599813+0000","last_became_active":"2024-09-13T18:45:26.054449+0000","last_became_peered":"2024-09-13T18:45:26.054449+0000","last_unstale":"2024-09-13T18:45:26.599813+0000","last_undegraded":"2024-09-13T18:45:26.599813+0000","last_fullsized":"2024-09-13T18:45:26.599813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600056+0000","last_change":"2024-09-13T18:45:22.034277+0000","last_active":"2024-09-13T18:45:26.600056+0000","last_peered":"2024-09-13T18:45:26.600056+0000","last_clean":"2024-09-13T18:45:26.600056+0000","last_became_active":"2024-09-13T18:45:22.033562+0000","last_became_peered":"2024-09-13T18:45:22.033562+0000","last_unstale":"2024-09-13T18:45:26.600056+0000","last_undegraded":"2024-09-13T18:45:26.600056+0000","last_fullsized":"2024-09-13T18:45:26.600056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:07.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.041599+0000","last_change":"2024-09-13T18:45:21.667622+0000","last_active":"2024-09-13T18:45:26.041599+0000","last_peered":"2024-09-13T18:45:26.041599+0000","last_clean":"2024-09-13T18:45:26.041599+0000","last_became_active":"2024-09-13T18:45:21.667340+0000","last_became_peered":"2024-09-13T18:45:21.667340+0000","last_unstale":"2024-09-13T18:45:26.041599+0000","last_undegraded":"2024-09-13T18:45:26.041599+0000","last_fullsized":"2024-09-13T18:45:26.041599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600221+0000","last_change":"2024-09-13T18:45:26.250450+0000","last_active":"2024-09-13T18:45:26.600221+0000","last_peered":"2024-09-13T18:45:26.600221+0000","last_clean":"2024-09-13T18:45:26.600221+0000","last_became_active":"2024-09-13T18:45:26.250020+0000","last_became_peered":"2024-09-13T18:45:26.250020+0000","last_unstale":"2024-09-13T18:45:26.600221+0000","last_undegraded":"2024-09-13T18:45:26.600221+0000","last_fullsized":"2024-09-13T18:45:26.600221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:46.567482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600026+0000","last_change":"2024-09-13T18:45:22.030584+0000","last_active":"2024-09-13T18:45:26.600026+0000","last_peered":"2024-09-13T18:45:26.600026+0000","last_clean":"2024-09-13T18:45:26.600026+0000","last_became_active":"2024-09-13T18:45:22.030275+0000","last_became_peered":"2024-09-13T18:45:22.030275+0000","last_unstale":"2024-09-13T18:45:26.600026+0000","last_undegraded":"2024-09-13T18:45:26.600026+0000","last_fullsized":"2024-09-13T18:45:26.600026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.038135+0000","last_change":"2024-09-13T18:45:21.662490+0000","last_active":"2024-09-13T18:45:26.038135+0000","last_peered":"2024-09-13T18:45:26.038135+0000","last_clean":"2024-09-13T18:45:26.038135+0000","last_became_active":"2024-09-13T18:45:21.662210+0000","last_became_peered":"2024-09-13T18:45:21.662210+0000","last_unstale":"2024-09-13T18:45:26.038135+0000","last_undegraded":"2024-09-13T18:45:26.038135+0000","last_fullsized":"2024-09-13T18:45:26.038135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410593+0000","last_change":"2024-09-13T18:45:26.053575+0000","last_active":"2024-09-13T18:45:26.410593+0000","last_peered":"2024-09-13T18:45:26.410593+0000","last_clean":"2024-09-13T18:45:26.410593+0000","last_became_active":"2024-09-13T18:45:26.053195+0000","last_became_peered":"2024-09-13T18:45:26.053195+0000","last_unstale":"2024-09-13T18:45:26.410593+0000","last_undegraded":"2024-09-13T18:45:26.410593+0000","last_fullsized":"2024-09-13T18:45:26.410593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:28.745002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599910+0000","last_change":"2024-09-13T18:45:22.031817+0000","last_active":"2024-09-13T18:45:26.599910+0000","last_peered":"2024-09-13T18:45:26.599910+0000","last_clean":"2024-09-13T18:45:26.599910+0000","last_became_active":"2024-09-13T18:45:22.031312+0000","last_became_peered":"2024-09-13T18:45:22.031312+0000","last_unstale":"2024-09-13T18:45:26.599910+0000","last_undegraded":"2024-09-13T18:45:26.599910+0000","last_fullsized":"2024-09-13T18:45:26.599910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.039206+0000","last_change":"2024-09-13T18:45:21.655353+0000","last_active":"2024-09-13T18:45:26.039206+0000","last_peered":"2024-09-13T18:45:26.039206+0000","last_clean":"2024-09-13T18:45:26.039206+0000","last_became_active":"2024-09-13T18:45:21.654844+0000","last_became_peered":"2024-09-13T18:45:21.654844+0000","last_unstale":"2024-09-13T18:45:26.039206+0000","last_undegraded":"2024-09-13T18:45:26.039206+0000","last_fullsized":"2024-09-13T18:45:26.039206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599871+0000","last_change":"2024-09-13T18:45:26.056440+0000","last_active":"2024-09-13T18:45:26.599871+0000","last_peered":"2024-09-13T18:45:26.599871+0000","last_clean":"2024-09-13T18:45:26.599871+0000","last_became_active":"2024-09-13T18:45:26.055955+0000","last_became_peered":"2024-09-13T18:45:26.055955+0000","last_unstale":"2024-09-13T18:45:26.599871+0000","last_undegraded":"2024-09-13T18:45:26.599871+0000","last_fullsized":"2024-09-13T18:45:26.599871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:38.309349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409660+0000","last_change":"2024-09-13T18:45:22.027821+0000","last_active":"2024-09-13T18:45:26.409660+0000","last_peered":"2024-09-13T18:45:26.409660+0000","last_clean":"2024-09-13T18:45:26.409660+0000","last_became_active":"2024-09-13T18:45:22.027172+0000","last_became_peered":"2024-09-13T18:45:22.027172+0000","last_unstale":"2024-09-13T18:45:26.409660+0000","last_undegraded":"2024-09-13T18:45:26.409660+0000","last_fullsized":"2024-09-13T18:45:26.409660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.035641+0000","last_change":"2024-09-13T18:45:21.664084+0000","last_active":"2024-09-13T18:45:26.035641+0000","last_peered":"2024-09-13T18:45:26.035641+0000","last_clean":"2024-09-13T18:45:26.035641+0000","last_became_active":"2024-09-13T18:45:21.663746+0000","last_became_peered":"2024-09-13T18:45:21.663746+0000","last_unstale":"2024-09-13T18:45:26.035641+0000","last_undegraded":"2024-09-13T18:45:26.035641+0000","last_fullsized":"2024-09-13T18:45:26.035641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601109+0000","last_change":"2024-09-13T18:45:26.253221+0000","last_active":"2024-09-13T18:45:26.601109+0000","last_peered":"2024-09-13T18:45:26.601109+0000","last_clean":"2024-09-13T18:45:26.601109+0000","last_became_active":"2024-09-13T18:45:26.252841+0000","last_became_peered":"2024-09-13T18:45:26.252841+0000","last_unstale":"2024-09-13T18:45:26.601109+0000","last_undegraded":"2024-09-13T18:45:26.601109+0000","last_fullsized":"2024-09-13T18:45:26.601109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:26.396713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599947+0000","last_change":"2024-09-13T18:45:22.033554+0000","last_active":"2024-09-13T18:45:26.599947+0000","last_peered":"2024-09-13T18:45:26.599947+0000","last_clean":"2024-09-13T18:45:26.599947+0000","last_became_active":"2024-09-13T18:45:22.032862+0000","last_became_peered":"2024-09-13T18:45:22.032862+0000","last_unstale":"2024-09-13T18:45:26.599947+0000","last_undegraded":"2024-09-13T18:45:26.599947+0000","last_fullsized":"2024-09-13T18:45:26.599947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044282+0000","last_change":"2024-09-13T18:45:21.668025+0000","last_active":"2024-09-13T18:45:26.044282+0000","last_peered":"2024-09-13T18:45:26.044282+0000","last_clean":"2024-09-13T18:45:26.044282+0000","last_became_active":"2024-09-13T18:45:21.667457+0000","last_became_peered":"2024-09-13T18:45:21.667457+0000","last_unstale":"2024-09-13T18:45:26.044282+0000","last_undegraded":"2024-09-13T18:45:26.044282+0000","last_fullsized":"2024-09-13T18:45:26.044282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601060+0000","last_change":"2024-09-13T18:45:26.250464+0000","last_active":"2024-09-13T18:45:26.601060+0000","last_peered":"2024-09-13T18:45:26.601060+0000","last_clean":"2024-09-13T18:45:26.601060+0000","last_became_active":"2024-09-13T18:45:26.250041+0000","last_became_peered":"2024-09-13T18:45:26.250041+0000","last_unstale":"2024-09-13T18:45:26.601060+0000","last_undegraded":"2024-09-13T18:45:26.601060+0000","last_fullsized":"2024-09-13T18:45:26.601060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:20.013806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599781+0000","last_change":"2024-09-13T18:45:22.024133+0000","last_active":"2024-09-13T18:45:26.599781+0000","last_peered":"2024-09-13T18:45:26.599781+0000","last_clean":"2024-09-13T18:45:26.599781+0000","last_became_active":"2024-09-13T18:45:22.023882+0000","last_became_peered":"2024-09-13T18:45:22.023882+0000","last_unstale":"2024-09-13T18:45:26.599781+0000","last_undegraded":"2024-09-13T18:45:26.599781+0000","last_fullsized":"2024-09-13T18:45:26.599781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.053020+0000","last_change":"2024-09-13T18:45:21.663297+0000","last_active":"2024-09-13T18:45:26.053020+0000","last_peered":"2024-09-13T18:45:26.053020+0000","last_clean":"2024-09-13T18:45:26.053020+0000","last_became_active":"2024-09-13T18:45:21.662980+0000","last_became_peered":"2024-09-13T18:45:21.662980+0000","last_unstale":"2024-09-13T18:45:26.053020+0000","last_undegraded":"2024-09-13T18:45:26.053020+0000","last_fullsized":"2024-09-13T18:45:26.053020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600385+0000","last_change":"2024-09-13T18:45:26.253184+0000","last_active":"2024-09-13T18:45:26.600385+0000","last_peered":"2024-09-13T18:45:26.600385+0000","last_clean":"2024-09-13T18:45:26.600385+0000","last_became_active":"2024-09-13T18:45:26.252786+0000","last_became_peered":"2024-09-13T18:45:26.252786+0000","last_unstale":"2024-09-13T18:45:26.600385+0000","last_undegraded":"2024-09-13T18:45:26.600385+0000","last_fullsized":"2024-09-13T18:45:26.600385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599971+0000","last_change":"2024-09-13T18:45:22.035052+0000","last_active":"2024-09-13T18:45:26.599971+0000","last_peered":"2024-09-13T18:45:26.599971+0000","last_clean":"2024-09-13T18:45:26.599971+0000","last_became_active":"2024-09-13T18:45:22.034765+0000","last_became_peered":"2024-09-13T18:45:22.034765+0000","last_unstale":"2024-09-13T18:45:26.599971+0000","last_undegraded":"2024-09-13T18:45:26.599971+0000","last_fullsized":"2024-09-13T18:45:26.599971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:28.674827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:30.681690+0000","last_change":"2024-09-13T18:45:21.668054+0000","last_active":"2024-09-13T18:45:30.681690+0000","last_peered":"2024-09-13T18:45:30.681690+0000","last_clean":"2024-09-13T18:45:30.681690+0000","last_became_active":"2024-09-13T18:45:21.667587+0000","last_became_peered":"2024-09-13T18:45:21.667587+0000","last_unstale":"2024-09-13T18:45:30.681690+0000","last_undegraded":"2024-09-13T18:45:30.681690+0000","last_fullsized":"2024-09-13T18:45:30.681690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605348+0000","last_change":"2024-09-13T18:45:26.052997+0000","last_active":"2024-09-13T18:45:26.605348+0000","last_peered":"2024-09-13T18:45:26.605348+0000","last_clean":"2024-09-13T18:45:26.605348+0000","last_became_active":"2024-09-13T18:45:26.052614+0000","last_became_peered":"2024-09-13T18:45:26.052614+0000","last_unstale":"2024-09-13T18:45:26.605348+0000","last_undegraded":"2024-09-13T18:45:26.605348+0000","last_fullsized":"2024-09-13T18:45:26.605348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410522+0000","last_change":"2024-09-13T18:45:22.020754+0000","last_active":"2024-09-13T18:45:26.410522+0000","last_peered":"2024-09-13T18:45:26.410522+0000","last_clean":"2024-09-13T18:45:26.410522+0000","last_became_active":"2024-09-13T18:45:22.020461+0000","last_became_peered":"2024-09-13T18:45:22.020461+0000","last_unstale":"2024-09-13T18:45:26.410522+0000","last_undegraded":"2024-09-13T18:45:26.410522+0000","last_fullsized":"2024-09-13T18:45:26.410522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.045194+0000","last_change":"2024-09-13T18:45:21.664387+0000","last_active":"2024-09-13T18:45:26.045194+0000","last_peered":"2024-09-13T18:45:26.045194+0000","last_clean":"2024-09-13T18:45:26.045194+0000","last_became_active":"2024-09-13T18:45:21.663941+0000","last_became_peered":"2024-09-13T18:45:21.663941+0000","last_unstale":"2024-09-13T18:45:26.045194+0000","last_undegraded":"2024-09-13T18:45:26.045194+0000","last_fullsized":"2024-09-13T18:45:26.045194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410895+0000","last_change":"2024-09-13T18:45:26.051227+0000","last_active":"2024-09-13T18:45:26.410895+0000","last_peered":"2024-09-13T18:45:26.410895+0000","last_clean":"2024-09-13T18:45:26.410895+0000","last_became_active":"2024-09-13T18:45:26.050757+0000","last_became_peered":"2024-09-13T18:45:26.050757+0000","last_unstale":"2024-09-13T18:45:26.410895+0000","last_undegraded":"2024-09-13T18:45:26.410895+0000","last_fullsized":"2024-09-13T18:45:26.410895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:59.045390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599915+0000","last_change":"2024-09-13T18:45:22.025223+0000","last_active":"2024-09-13T18:45:26.599915+0000","last_peered":"2024-09-13T18:45:26.599915+0000","last_clean":"2024-09-13T18:45:26.599915+0000","last_became_active":"2024-09-13T18:45:22.024972+0000","last_became_peered":"2024-09-13T18:45:22.024972+0000","last_unstale":"2024-09-13T18:45:26.599915+0000","last_undegraded":"2024-09-13T18:45:26.599915+0000","last_fullsized":"2024-09-13T18:45:26.599915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044352+0000","last_change":"2024-09-13T18:45:21.666814+0000","last_active":"2024-09-13T18:45:26.044352+0000","last_peered":"2024-09-13T18:45:26.044352+0000","last_clean":"2024-09-13T18:45:26.044352+0000","last_became_active":"2024-09-13T18:45:21.666516+0000","last_became_peered":"2024-09-13T18:45:21.666516+0000","last_unstale":"2024-09-13T18:45:26.044352+0000","last_undegraded":"2024-09-13T18:45:26.044352+0000","last_fullsized":"2024-09-13T18:45:26.044352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600944+0000","last_change":"2024-09-13T18:45:26.057746+0000","last_active":"2024-09-13T18:45:26.600944+0000","last_peered":"2024-09-13T18:45:26.600944+0000","last_clean":"2024-09-13T18:45:26.600944+0000","last_became_active":"2024-09-13T18:45:26.057285+0000","last_became_peered":"2024-09-13T18:45:26.057285+0000","last_unstale":"2024-09-13T18:45:26.600944+0000","last_undegraded":"2024-09-13T18:45:26.600944+0000","last_fullsized":"2024-09-13T18:45:26.600944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600419+0000","last_change":"2024-09-13T18:45:22.031653+0000","last_active":"2024-09-13T18:45:26.600419+0000","last_peered":"2024-09-13T18:45:26.600419+0000","last_clean":"2024-09-13T18:45:26.600419+0000","last_became_active":"2024-09-13T18:45:22.031341+0000","last_became_peered":"2024-09-13T18:45:22.031341+0000","last_unstale":"2024-09-13T18:45:26.600419+0000","last_undegraded":"2024-09-13T18:45:26.600419+0000","last_fullsized":"2024-09-13T18:45:26.600419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.037413+0000","last_change":"2024-09-13T18:45:21.664695+0000","last_active":"2024-09-13T18:45:26.037413+0000","last_peered":"2024-09-13T18:45:26.037413+0000","last_clean":"2024-09-13T18:45:26.037413+0000","last_became_active":"2024-09-13T18:45:21.664401+0000","last_became_peered":"2024-09-13T18:45:21.664401+0000","last_unstale":"2024-09-13T18:45:26.037413+0000","last_undegraded":"2024-09-13T18:45:26.037413+0000","last_fullsized":"2024-09-13T18:45:26.037413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600992+0000","last_change":"2024-09-13T18:45:26.254041+0000","last_active":"2024-09-13T18:45:26.600992+0000","last_peered":"2024-09-13T18:45:26.600992+0000","last_clean":"2024-09-13T18:45:26.600992+0000","last_became_active":"2024-09-13T18:45:26.253579+0000","last_became_peered":"2024-09-13T18:45:26.253579+0000","last_unstale":"2024-09-13T18:45:26.600992+0000","last_undegraded":"2024-09-13T18:45:26.600992+0000","last_fullsized":"2024-09-13T18:45:26.600992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:19.171737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599855+0000","last_change":"2024-09-13T18:45:26.253962+0000","last_active":"2024-09-13T18:45:26.599855+0000","last_peered":"2024-09-13T18:45:26.599855+0000","last_clean":"2024-09-13T18:45:26.599855+0000","last_became_active":"2024-09-13T18:45:26.252979+0000","last_became_peered":"2024-09-13T18:45:26.252979+0000","last_unstale":"2024-09-13T18:45:26.599855+0000","last_undegraded":"2024-09-13T18:45:26.599855+0000","last_fullsized":"2024-09-13T18:45:26.599855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605312+0000","last_change":"2024-09-13T18:45:22.030919+0000","last_active":"2024-09-13T18:45:26.605312+0000","last_peered":"2024-09-13T18:45:26.605312+0000","last_clean":"2024-09-13T18:45:26.605312+0000","last_became_active":"2024-09-13T18:45:22.030453+0000","last_became_peered":"2024-09-13T18:45:22.030453+0000","last_unstale":"2024-09-13T18:45:26.605312+0000","last_undegraded":"2024-09-13T18:45:26.605312+0000","last_fullsized":"2024-09-13T18:45:26.605312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.043671+0000","last_change":"2024-09-13T18:45:21.664824+0000","last_active":"2024-09-13T18:45:26.043671+0000","last_peered":"2024-09-13T18:45:26.043671+0000","last_clean":"2024-09-13T18:45:26.043671+0000","last_became_active":"2024-09-13T18:45:21.664571+0000","last_became_peered":"2024-09-13T18:45:21.664571+0000","last_unstale":"2024-09-13T18:45:26.043671+0000","last_undegraded":"2024-09-13T18:45:26.043671+0000","last_fullsized":"2024-09-13T18:45:26.043671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410703+0000","last_change":"2024-09-13T18:45:26.054920+0000","last_active":"2024-09-13T18:45:26.410703+0000","last_peered":"2024-09-13T18:45:26.410703+0000","last_clean":"2024-09-13T18:45:26.410703+0000","last_became_active":"2024-09-13T18:45:26.054510+0000","last_became_peered":"2024-09-13T18:45:26.054510+0000","last_unstale":"2024-09-13T18:45:26.410703+0000","last_undegraded":"2024-09-13T18:45:26.410703+0000","last_fullsized":"2024-09-13T18:45:26.410703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:32.061769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600953+0000","last_change":"2024-09-13T18:45:22.028321+0000","last_active":"2024-09-13T18:45:26.600953+0000","last_peered":"2024-09-13T18:45:26.600953+0000","last_clean":"2024-09-13T18:45:26.600953+0000","last_became_active":"2024-09-13T18:45:22.028062+0000","last_became_peered":"2024-09-13T18:45:22.028062+0000","last_unstale":"2024-09-13T18:45:26.600953+0000","last_undegraded":"2024-09-13T18:45:26.600953+0000","last_fullsized":"2024-09-13T18:45:26.600953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.036033+0000","last_change":"2024-09-13T18:45:21.672763+0000","last_active":"2024-09-13T18:45:26.036033+0000","last_peered":"2024-09-13T18:45:26.036033+0000","last_clean":"2024-09-13T18:45:26.036033+0000","last_became_active":"2024-09-13T18:45:21.672470+0000","last_became_peered":"2024-09-13T18:45:21.672470+0000","last_unstale":"2024-09-13T18:45:26.036033+0000","last_undegraded":"2024-09-13T18:45:26.036033+0000","last_fullsized":"2024-09-13T18:45:26.036033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.036402+0000","last_change":"2024-09-13T18:45:21.660195+0000","last_active":"2024-09-13T18:45:26.036402+0000","last_peered":"2024-09-13T18:45:26.036402+0000","last_clean":"2024-09-13T18:45:26.036402+0000","last_became_active":"2024-09-13T18:45:21.659912+0000","last_became_peered":"2024-09-13T18:45:21.659912+0000","last_unstale":"2024-09-13T18:45:26.036402+0000","last_undegraded":"2024-09-13T18:45:26.036402+0000","last_fullsized":"2024-09-13T18:45:26.036402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599830+0000","last_change":"2024-09-13T18:45:22.024571+0000","last_active":"2024-09-13T18:45:26.599830+0000","last_peered":"2024-09-13T18:45:26.599830+0000","last_clean":"2024-09-13T18:45:26.599830+0000","last_became_active":"2024-09-13T18:45:22.024305+0000","last_became_peered":"2024-09-13T18:45:22.024305+0000","last_unstale":"2024-09-13T18:45:26.599830+0000","last_undegraded":"2024-09-13T18:45:26.599830+0000","last_fullsized":"2024-09-13T18:45:26.599830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.408537+0000","last_change":"2024-09-13T18:45:26.056207+0000","last_active":"2024-09-13T18:45:26.408537+0000","last_peered":"2024-09-13T18:45:26.408537+0000","last_clean":"2024-09-13T18:45:26.408537+0000","last_became_active":"2024-09-13T18:45:26.055794+0000","last_became_peered":"2024-09-13T18:45:26.055794+0000","last_unstale":"2024-09-13T18:45:26.408537+0000","last_undegraded":"2024-09-13T18:45:26.408537+0000","last_fullsized":"2024-09-13T18:45:26.408537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:29.520825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.035461+0000","last_change":"2024-09-13T18:45:21.670376+0000","last_active":"2024-09-13T18:45:26.035461+0000","last_peered":"2024-09-13T18:45:26.035461+0000","last_clean":"2024-09-13T18:45:26.035461+0000","last_became_active":"2024-09-13T18:45:21.670083+0000","last_became_peered":"2024-09-13T18:45:21.670083+0000","last_unstale":"2024-09-13T18:45:26.035461+0000","last_undegraded":"2024-09-13T18:45:26.035461+0000","last_fullsized":"2024-09-13T18:45:26.035461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410560+0000","last_change":"2024-09-13T18:45:22.021774+0000","last_active":"2024-09-13T18:45:26.410560+0000","last_peered":"2024-09-13T18:45:26.410560+0000","last_clean":"2024-09-13T18:45:26.410560+0000","last_became_active":"2024-09-13T18:45:22.021496+0000","last_became_peered":"2024-09-13T18:45:22.021496+0000","last_unstale":"2024-09-13T18:45:26.410560+0000","last_undegraded":"2024-09-13T18:45:26.410560+0000","last_fullsized":"2024-09-13T18:45:26.410560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:44.234639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601081+0000","last_change":"2024-09-13T18:45:26.050478+0000","last_active":"2024-09-13T18:45:26.601081+0000","last_peered":"2024-09-13T18:45:26.601081+0000","last_clean":"2024-09-13T18:45:26.601081+0000","last_became_active":"2024-09-13T18:45:26.050095+0000","last_became_peered":"2024-09-13T18:45:26.050095+0000","last_unstale":"2024-09-13T18:45:26.601081+0000","last_undegraded":"2024-09-13T18:45:26.601081+0000","last_fullsized":"2024-09-13T18:45:26.601081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:28.276515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409518+0000","last_change":"2024-09-13T18:45:22.028025+0000","last_active":"2024-09-13T18:45:26.409518+0000","last_peered":"2024-09-13T18:45:26.409518+0000","last_clean":"2024-09-13T18:45:26.409518+0000","last_became_active":"2024-09-13T18:45:22.027528+0000","last_became_peered":"2024-09-13T18:45:22.027528+0000","last_unstale":"2024-09-13T18:45:26.409518+0000","last_undegraded":"2024-09-13T18:45:26.409518+0000","last_fullsized":"2024-09-13T18:45:26.409518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.408408+0000","last_change":"2024-09-13T18:45:22.024615+0000","last_active":"2024-09-13T18:45:26.408408+0000","last_peered":"2024-09-13T18:45:26.408408+0000","last_clean":"2024-09-13T18:45:26.408408+0000","last_became_active":"2024-09-13T18:45:22.024369+0000","last_became_peered":"2024-09-13T18:45:22.024369+0000","last_unstale":"2024-09-13T18:45:26.408408+0000","last_undegraded":"2024-09-13T18:45:26.408408+0000","last_fullsized":"2024-09-13T18:45:26.408408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600313+0000","last_change":"2024-09-13T18:45:22.035861+0000","last_active":"2024-09-13T18:45:26.600313+0000","last_peered":"2024-09-13T18:45:26.600313+0000","last_clean":"2024-09-13T18:45:26.600313+0000","last_became_active":"2024-09-13T18:45:22.034318+0000","last_became_peered":"2024-09-13T18:45:22.034318+0000","last_unstale":"2024-09-13T18:45:26.600313+0000","last_undegraded":"2024-09-13T18:45:26.600313+0000","last_fullsized":"2024-09-13T18:45:26.600313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599822+0000","last_change":"2024-09-13T18:45:22.033266+0000","last_active":"2024-09-13T18:45:26.599822+0000","last_peered":"2024-09-13T18:45:26.599822+0000","last_clean":"2024-09-13T18:45:26.599822+0000","last_became_active":"2024-09-13T18:45:22.032851+0000","last_became_peered":"2024-09-13T18:45:22.032851+0000","last_unstale":"2024-09-13T18:45:26.599822+0000","last_undegraded":"2024-09-13T18:45:26.599822+0000","last_fullsized":"2024-09-13T18:45:26.599822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601071+0000","last_change":"2024-09-13T18:45:22.033500+0000","last_active":"2024-09-13T18:45:26.601071+0000","last_peered":"2024-09-13T18:45:26.601071+0000","last_clean":"2024-09-13T18:45:26.601071+0000","last_became_active":"2024-09-13T18:45:22.033156+0000","last_became_peered":"2024-09-13T18:45:22.033156+0000","last_unstale":"2024-09-13T18:45:26.601071+0000","last_undegraded":"2024-09-13T18:45:26.601071+0000","last_fullsized":"2024-09-13T18:45:26.601071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605389+0000","last_change":"2024-09-13T18:45:22.029906+0000","last_active":"2024-09-13T18:45:26.605389+0000","last_peered":"2024-09-13T18:45:26.605389+0000","last_clean":"2024-09-13T18:45:26.605389+0000","last_became_active":"2024-09-13T18:45:22.029654+0000","last_became_peered":"2024-09-13T18:45:22.029654+0000","last_unstale":"2024-09-13T18:45:26.605389+0000","last_undegraded":"2024-09-13T18:45:26.605389+0000","last_fullsized":"2024-09-13T18:45:26.605389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410838+0000","last_change":"2024-09-13T18:45:22.028396+0000","last_active":"2024-09-13T18:45:26.410838+0000","last_peered":"2024-09-13T18:45:26.410838+0000","last_clean":"2024-09-13T18:45:26.410838+0000","last_became_active":"2024-09-13T18:45:22.028031+0000","last_became_peered":"2024-09-13T18:45:22.028031+0000","last_unstale":"2024-09-13T18:45:26.410838+0000","last_undegraded":"2024-09-13T18:45:26.410838+0000","last_fullsized":"2024-09-13T18:45:26.410838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601118+0000","last_change":"2024-09-13T18:45:22.032816+0000","last_active":"2024-09-13T18:45:26.601118+0000","last_peered":"2024-09-13T18:45:26.601118+0000","last_clean":"2024-09-13T18:45:26.601118+0000","last_became_active":"2024-09-13T18:45:22.032561+0000","last_became_peered":"2024-09-13T18:45:22.032561+0000","last_unstale":"2024-09-13T18:45:26.601118+0000","last_undegraded":"2024-09-13T18:45:26.601118+0000","last_fullsized":"2024-09-13T18:45:26.601118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600256+0000","last_change":"2024-09-13T18:45:22.036615+0000","last_active":"2024-09-13T18:45:26.600256+0000","last_peered":"2024-09-13T18:45:26.600256+0000","last_clean":"2024-09-13T18:45:26.600256+0000","last_became_active":"2024-09-13T18:45:22.036380+0000","last_became_peered":"2024-09-13T18:45:22.036380+0000","last_unstale":"2024-09-13T18:45:26.600256+0000","last_undegraded":"2024-09-13T18:45:26.600256+0000","last_fullsized":"2024-09-13T18:45:26.600256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601002+0000","last_change":"2024-09-13T18:45:22.035082+0000","last_active":"2024-09-13T18:45:26.601002+0000","last_peered":"2024-09-13T18:45:26.601002+0000","last_clean":"2024-09-13T18:45:26.601002+0000","last_became_active":"2024-09-13T18:45:22.034646+0000","last_became_peered":"2024-09-13T18:45:22.034646+0000","last_unstale":"2024-09-13T18:45:26.601002+0000","last_undegraded":"2024-09-13T18:45:26.601002+0000","last_fullsized":"2024-09-13T18:45:26.601002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600302+0000","last_change":"2024-09-13T18:45:22.029195+0000","last_active":"2024-09-13T18:45:26.600302+0000","last_peered":"2024-09-13T18:45:26.600302+0000","last_clean":"2024-09-13T18:45:26.600302+0000","last_became_active":"2024-09-13T18:45:22.028430+0000","last_became_peered":"2024-09-13T18:45:22.028430+0000","last_unstale":"2024-09-13T18:45:26.600302+0000","last_undegraded":"2024-09-13T18:45:26.600302+0000","last_fullsized":"2024-09-13T18:45:26.600302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599802+0000","last_change":"2024-09-13T18:45:22.019974+0000","last_active":"2024-09-13T18:45:26.599802+0000","last_peered":"2024-09-13T18:45:26.599802+0000","last_clean":"2024-09-13T18:45:26.599802+0000","last_became_active":"2024-09-13T18:45:22.019733+0000","last_became_peered":"2024-09-13T18:45:22.019733+0000","last_unstale":"2024-09-13T18:45:26.599802+0000","last_undegraded":"2024-09-13T18:45:26.599802+0000","last_fullsized":"2024-09-13T18:45:26.599802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410236+0000","last_change":"2024-09-13T18:45:22.016110+0000","last_active":"2024-09-13T18:45:26.410236+0000","last_peered":"2024-09-13T18:45:26.410236+0000","last_clean":"2024-09-13T18:45:26.410236+0000","last_became_active":"2024-09-13T18:45:22.015868+0000","last_became_peered":"2024-09-13T18:45:22.015868+0000","last_unstale":"2024-09-13T18:45:26.410236+0000","last_undegraded":"2024-09-13T18:45:26.410236+0000","last_fullsized":"2024-09-13T18:45:26.410236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599998+0000","last_change":"2024-09-13T18:45:22.034477+0000","last_active":"2024-09-13T18:45:26.599998+0000","last_peered":"2024-09-13T18:45:26.599998+0000","last_clean":"2024-09-13T18:45:26.599998+0000","last_became_active":"2024-09-13T18:45:22.034019+0000","last_became_peered":"2024-09-13T18:45:22.034019+0000","last_unstale":"2024-09-13T18:45:26.599998+0000","last_undegraded":"2024-09-13T18:45:26.599998+0000","last_fullsized":"2024-09-13T18:45:26.599998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.408670+0000","last_change":"2024-09-13T18:45:22.021787+0000","last_active":"2024-09-13T18:45:26.408670+0000","last_peered":"2024-09-13T18:45:26.408670+0000","last_clean":"2024-09-13T18:45:26.408670+0000","last_became_active":"2024-09-13T18:45:22.020415+0000","last_became_peered":"2024-09-13T18:45:22.020415+0000","last_unstale":"2024-09-13T18:45:26.408670+0000","last_undegraded":"2024-09-13T18:45:26.408670+0000","last_fullsized":"2024-09-13T18:45:26.408670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600442+0000","last_change":"2024-09-13T18:45:22.035941+0000","last_active":"2024-09-13T18:45:26.600442+0000","last_peered":"2024-09-13T18:45:26.600442+0000","last_clean":"2024-09-13T18:45:26.600442+0000","last_became_active":"2024-09-13T18:45:22.035491+0000","last_became_peered":"2024-09-13T18:45:22.035491+0000","last_unstale":"2024-09-13T18:45:26.600442+0000","last_undegraded":"2024-09-13T18:45:26.600442+0000","last_fullsized":"2024-09-13T18:45:26.600442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600236+0000","last_change":"2024-09-13T18:45:22.027416+0000","last_active":"2024-09-13T18:45:26.600236+0000","last_peered":"2024-09-13T18:45:26.600236+0000","last_clean":"2024-09-13T18:45:26.600236+0000","last_became_active":"2024-09-13T18:45:22.027170+0000","last_became_peered":"2024-09-13T18:45:22.027170+0000","last_unstale":"2024-09-13T18:45:26.600236+0000","last_undegraded":"2024-09-13T18:45:26.600236+0000","last_fullsized":"2024-09-13T18:45:26.600236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605321+0000","last_change":"2024-09-13T18:45:22.021298+0000","last_active":"2024-09-13T18:45:26.605321+0000","last_peered":"2024-09-13T18:45:26.605321+0000","last_clean":"2024-09-13T18:45:26.605321+0000","last_became_active":"2024-09-13T18:45:22.021042+0000","last_became_peered":"2024-09-13T18:45:22.021042+0000","last_unstale":"2024-09-13T18:45:26.605321+0000","last_undegraded":"2024-09-13T18:45:26.605321+0000","last_fullsized":"2024-09-13T18:45:26.605321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599771+0000","last_change":"2024-09-13T18:45:22.021628+0000","last_active":"2024-09-13T18:45:26.599771+0000","last_peered":"2024-09-13T18:45:26.599771+0000","last_clean":"2024-09-13T18:45:26.599771+0000","last_became_active":"2024-09-13T18:45:22.021366+0000","last_became_peered":"2024-09-13T18:45:22.021366+0000","last_unstale":"2024-09-13T18:45:26.599771+0000","last_undegraded":"2024-09-13T18:45:26.599771+0000","last_fullsized":"2024-09-13T18:45:26.599771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601029+0000","last_change":"2024-09-13T18:45:22.029051+0000","last_active":"2024-09-13T18:45:26.601029+0000","last_peered":"2024-09-13T18:45:26.601029+0000","last_clean":"2024-09-13T18:45:26.601029+0000","last_became_active":"2024-09-13T18:45:22.028594+0000","last_became_peered":"2024-09-13T18:45:22.028594+0000","last_unstale":"2024-09-13T18:45:26.601029+0000","last_undegraded":"2024-09-13T18:45:26.601029+0000","last_fullsized":"2024-09-13T18:45:26.601029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410403+0000","last_change":"2024-09-13T18:45:22.016996+0000","last_active":"2024-09-13T18:45:26.410403+0000","last_peered":"2024-09-13T18:45:26.410403+0000","last_clean":"2024-09-13T18:45:26.410403+0000","last_became_active":"2024-09-13T18:45:22.016731+0000","last_became_peered":"2024-09-13T18:45:22.016731+0000","last_unstale":"2024-09-13T18:45:26.410403+0000","last_undegraded":"2024-09-13T18:45:26.410403+0000","last_fullsized":"2024-09-13T18:45:26.410403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410341+0000","last_change":"2024-09-13T18:45:22.028649+0000","last_active":"2024-09-13T18:45:26.410341+0000","last_peered":"2024-09-13T18:45:26.410341+0000","last_clean":"2024-09-13T18:45:26.410341+0000","last_became_active":"2024-09-13T18:45:22.027899+0000","last_became_peered":"2024-09-13T18:45:22.027899+0000","last_unstale":"2024-09-13T18:45:26.410341+0000","last_undegraded":"2024-09-13T18:45:26.410341+0000","last_fullsized":"2024-09-13T18:45:26.410341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410750+0000","last_change":"2024-09-13T18:45:22.024291+0000","last_active":"2024-09-13T18:45:26.410750+0000","last_peered":"2024-09-13T18:45:26.410750+0000","last_clean":"2024-09-13T18:45:26.410750+0000","last_became_active":"2024-09-13T18:45:22.024014+0000","last_became_peered":"2024-09-13T18:45:22.024014+0000","last_unstale":"2024-09-13T18:45:26.410750+0000","last_undegraded":"2024-09-13T18:45:26.410750+0000","last_fullsized":"2024-09-13T18:45:26.410750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600045+0000","last_change":"2024-09-13T18:45:22.036551+0000","last_active":"2024-09-13T18:45:26.600045+0000","last_peered":"2024-09-13T18:45:26.600045+0000","last_clean":"2024-09-13T18:45:26.600045+0000","last_became_active":"2024-09-13T18:45:22.036269+0000","last_became_peered":"2024-09-13T18:45:22.036269+0000","last_unstale":"2024-09-13T18:45:26.600045+0000","last_undegraded":"2024-09-13T18:45:26.600045+0000","last_fullsized":"2024-09-13T18:45:26.600045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600933+0000","last_change":"2024-09-13T18:45:22.032392+0000","last_active":"2024-09-13T18:45:26.600933+0000","last_peered":"2024-09-13T18:45:26.600933+0000","last_clean":"2024-09-13T18:45:26.600933+0000","last_became_active":"2024-09-13T18:45:22.027605+0000","last_became_peered":"2024-09-13T18:45:22.027605+0000","last_unstale":"2024-09-13T18:45:26.600933+0000","last_undegraded":"2024-09-13T18:45:26.600933+0000","last_fullsized":"2024-09-13T18:45:26.600933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599883+0000","last_change":"2024-09-13T18:45:22.029307+0000","last_active":"2024-09-13T18:45:26.599883+0000","last_peered":"2024-09-13T18:45:26.599883+0000","last_clean":"2024-09-13T18:45:26.599883+0000","last_became_active":"2024-09-13T18:45:22.029018+0000","last_became_peered":"2024-09-13T18:45:22.029018+0000","last_unstale":"2024-09-13T18:45:26.599883+0000","last_undegraded":"2024-09-13T18:45:26.599883+0000","last_fullsized":"2024-09-13T18:45:26.599883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600287+0000","last_change":"2024-09-13T18:45:22.029061+0000","last_active":"2024-09-13T18:45:26.600287+0000","last_peered":"2024-09-13T18:45:26.600287+0000","last_clean":"2024-09-13T18:45:26.600287+0000","last_became_active":"2024-09-13T18:45:22.028758+0000","last_became_peered":"2024-09-13T18:45:22.028758+0000","last_unstale":"2024-09-13T18:45:26.600287+0000","last_undegraded":"2024-09-13T18:45:26.600287+0000","last_fullsized":"2024-09-13T18:45:26.600287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599926+0000","last_change":"2024-09-13T18:45:22.029690+0000","last_active":"2024-09-13T18:45:26.599926+0000","last_peered":"2024-09-13T18:45:26.599926+0000","last_clean":"2024-09-13T18:45:26.599926+0000","last_became_active":"2024-09-13T18:45:22.029403+0000","last_became_peered":"2024-09-13T18:45:22.029403+0000","last_unstale":"2024-09-13T18:45:26.599926+0000","last_undegraded":"2024-09-13T18:45:26.599926+0000","last_fullsized":"2024-09-13T18:45:26.599926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600349+0000","last_change":"2024-09-13T18:45:22.038483+0000","last_active":"2024-09-13T18:45:26.600349+0000","last_peered":"2024-09-13T18:45:26.600349+0000","last_clean":"2024-09-13T18:45:26.600349+0000","last_became_active":"2024-09-13T18:45:22.036877+0000","last_became_peered":"2024-09-13T18:45:22.036877+0000","last_unstale":"2024-09-13T18:45:26.600349+0000","last_undegraded":"2024-09-13T18:45:26.600349+0000","last_fullsized":"2024-09-13T18:45:26.600349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599845+0000","last_change":"2024-09-13T18:45:22.022846+0000","last_active":"2024-09-13T18:45:26.599845+0000","last_peered":"2024-09-13T18:45:26.599845+0000","last_clean":"2024-09-13T18:45:26.599845+0000","last_became_active":"2024-09-13T18:45:22.022618+0000","last_became_peered":"2024-09-13T18:45:22.022618+0000","last_unstale":"2024-09-13T18:45:26.599845+0000","last_undegraded":"2024-09-13T18:45:26.599845+0000","last_fullsized":"2024-09-13T18:45:26.599845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605420+0000","last_change":"2024-09-13T18:45:22.028545+0000","last_active":"2024-09-13T18:45:26.605420+0000","last_peered":"2024-09-13T18:45:26.605420+0000","last_clean":"2024-09-13T18:45:26.605420+0000","last_became_active":"2024-09-13T18:45:22.028291+0000","last_became_peered":"2024-09-13T18:45:22.028291+0000","last_unstale":"2024-09-13T18:45:26.605420+0000","last_undegraded":"2024-09-13T18:45:26.605420+0000","last_fullsized":"2024-09-13T18:45:26.605420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600036+0000","last_change":"2024-09-13T18:45:22.034460+0000","last_active":"2024-09-13T18:45:26.600036+0000","last_peered":"2024-09-13T18:45:26.600036+0000","last_clean":"2024-09-13T18:45:26.600036+0000","last_became_active":"2024-09-13T18:45:22.033974+0000","last_became_peered":"2024-09-13T18:45:22.033974+0000","last_unstale":"2024-09-13T18:45:26.600036+0000","last_undegraded":"2024-09-13T18:45:26.600036+0000","last_fullsized":"2024-09-13T18:45:26.600036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":690344,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":266240,"data_stored":103189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":253952,"data_stored":99394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":262144,"data_stored":99554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":331776,"data_stored":690400,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:45:44.046 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:44.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.179+0000 7fd3aab9d640 1 Processor -- start 2024-09-13T18:45:44.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.179+0000 7fd3aab9d640 1 -- start start 2024-09-13T18:45:44.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3aab9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd3a41457c0 0x7fd3a4145be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3aab9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3a4142930 0x7fd3a4142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3aab9d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a40b72b0 con 0x7fd3a40b8720 2024-09-13T18:45:44.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3aab9d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a4099a90 con 0x7fd3a41457c0 2024-09-13T18:45:44.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3aab9d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40b8b00 con 0x7fd3a4142930 2024-09-13T18:45:44.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3a939a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd3a41457c0 0x7fd3a4145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3a939a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd3a41457c0 0x7fd3a4145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40538/0 (socket says 172.21.15.29:40538) 2024-09-13T18:45:44.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3a939a640 1 -- 172.21.15.29:0/2233554404 learned_addr learned my addr 172.21.15.29:0/2233554404 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:44.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3aa39c640 1 --2- 172.21.15.29:0/2233554404 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3a4142930 0x7fd3a4142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3a939a640 1 -- 172.21.15.29:0/2233554404 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3a4142930 msgr2=0x7fd3a4142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3a939a640 1 --2- 172.21.15.29:0/2233554404 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3a4142930 0x7fd3a4142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3a939a640 1 -- 172.21.15.29:0/2233554404 >> v1:172.21.15.96:6789/0 conn(0x7fd3a40b8720 legacy=0x7fd3a4099380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.180+0000 7fd3a939a640 1 -- 172.21.15.29:0/2233554404 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a40b6c60 con 0x7fd3a41457c0 2024-09-13T18:45:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.181+0000 7fd3a939a640 1 --2- 172.21.15.29:0/2233554404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3a41457c0 0x7fd3a4145be0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd394009870 tx=0x7fd39402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628a767956a7d74c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.181+0000 7fd3a8b99640 1 -- 172.21.15.29:0/2233554404 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394032440 con 0x7fd3a41457c0 2024-09-13T18:45:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.181+0000 7fd3a8b99640 1 -- 172.21.15.29:0/2233554404 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3940325a0 con 0x7fd3a41457c0 2024-09-13T18:45:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.181+0000 7fd3a8b99640 1 -- 172.21.15.29:0/2233554404 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394032930 con 0x7fd3a41457c0 2024-09-13T18:45:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.182+0000 7fd3aab9d640 1 -- 172.21.15.29:0/2233554404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3a41457c0 msgr2=0x7fd3a4145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.182+0000 7fd3aab9d640 1 --2- 172.21.15.29:0/2233554404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3a41457c0 0x7fd3a4145be0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd394009870 tx=0x7fd39402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.182+0000 7fd3aab9d640 1 -- 172.21.15.29:0/2233554404 shutdown_connections 2024-09-13T18:45:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.182+0000 7fd3aab9d640 1 --2- 172.21.15.29:0/2233554404 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3a4142930 0x7fd3a4142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.182+0000 7fd3aab9d640 1 --2- 172.21.15.29:0/2233554404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3a41457c0 0x7fd3a4145be0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.182+0000 7fd3aab9d640 1 -- 172.21.15.29:0/2233554404 >> 172.21.15.29:0/2233554404 conn(0x7fd3a4071c30 msgr2=0x7fd3a40b7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:44.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.182+0000 7fd3aab9d640 1 -- 172.21.15.29:0/2233554404 shutdown_connections 2024-09-13T18:45:44.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.182+0000 7fd3aab9d640 1 -- 172.21.15.29:0/2233554404 wait complete. 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.183+0000 7fd3aab9d640 1 Processor -- start 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.183+0000 7fd3aab9d640 1 -- start start 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3aab9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3a40b8720 0x7fd3a409d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3aab9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a4142930 0x7fd3a40b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3aab9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3a41457c0 0x7fd3a41dea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3aab9d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a41400c0 con 0x7fd3a40b8720 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3aab9d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40b3c90 con 0x7fd3a4142930 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3aab9d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40b1fc0 con 0x7fd3a41457c0 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3a9b9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3a40b8720 0x7fd3a409d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3a9b9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3a40b8720 0x7fd3a409d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40554/0 (socket says 172.21.15.29:40554) 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3a9b9b640 1 -- 172.21.15.29:0/3212809277 learned_addr learned my addr 172.21.15.29:0/3212809277 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3aa39c640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3a41457c0 0x7fd3a41dea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3a939a640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a4142930 0x7fd3a40b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3a9b9b640 1 -- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3a41457c0 msgr2=0x7fd3a41dea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3a9b9b640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3a41457c0 0x7fd3a41dea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3a9b9b640 1 -- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a4142930 msgr2=0x7fd3a40b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3a9b9b640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a4142930 0x7fd3a40b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3a9b9b640 1 -- 172.21.15.29:0/3212809277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3940094d0 con 0x7fd3a40b8720 2024-09-13T18:45:44.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.184+0000 7fd3a9b9b640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3a40b8720 0x7fd3a409d3e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000c400 tx=0x7fd3a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.185+0000 7fd39a7fc640 1 -- 172.21.15.29:0/3212809277 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00052d0 con 0x7fd3a40b8720 2024-09-13T18:45:44.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.185+0000 7fd39a7fc640 1 -- 172.21.15.29:0/3212809277 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a0005430 con 0x7fd3a40b8720 2024-09-13T18:45:44.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.185+0000 7fd3aab9d640 1 -- 172.21.15.29:0/3212809277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a40b22a0 con 0x7fd3a40b8720 2024-09-13T18:45:44.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.185+0000 7fd39a7fc640 1 -- 172.21.15.29:0/3212809277 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0003830 con 0x7fd3a40b8720 2024-09-13T18:45:44.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.185+0000 7fd3aab9d640 1 -- 172.21.15.29:0/3212809277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a40b02c0 con 0x7fd3a40b8720 2024-09-13T18:45:44.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.186+0000 7fd3aab9d640 1 -- 172.21.15.29:0/3212809277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a4142dc0 con 0x7fd3a40b8720 2024-09-13T18:45:44.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.186+0000 7fd39a7fc640 1 -- 172.21.15.29:0/3212809277 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd3a0003990 con 0x7fd3a40b8720 2024-09-13T18:45:44.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.187+0000 7fd39a7fc640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd38806ac00 0x7fd38806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.187+0000 7fd39a7fc640 1 -- 172.21.15.29:0/3212809277 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3a0088a80 con 0x7fd3a40b8720 2024-09-13T18:45:44.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.187+0000 7fd3a939a640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd38806ac00 0x7fd38806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.187+0000 7fd3a939a640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd38806ac00 0x7fd38806d0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd394034000 tx=0x7fd39402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.191+0000 7fd39a7fc640 1 -- 172.21.15.29:0/3212809277 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd3a0053ab0 con 0x7fd3a40b8720 2024-09-13T18:45:44.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.359+0000 7fd3aab9d640 1 -- 172.21.15.29:0/3212809277 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3a40a07a0 con 0x7fd38806ac00 2024-09-13T18:45:44.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.368+0000 7fd39a7fc640 1 -- 172.21.15.29:0/3212809277 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345377 (secure 0 0 0) 0x7fd3940329c0 con 0x7fd38806ac00 2024-09-13T18:45:44.376 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:44.378 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-13T18:45:44.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.371+0000 7fd3aab9d640 1 -- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd38806ac00 msgr2=0x7fd38806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.371+0000 7fd3aab9d640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd38806ac00 0x7fd38806d0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd394034000 tx=0x7fd39402e000 comp rx=0 tx=0).stop 2024-09-13T18:45:44.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.371+0000 7fd3aab9d640 1 -- 172.21.15.29:0/3212809277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3a40b8720 msgr2=0x7fd3a409d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.372+0000 7fd3aab9d640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3a40b8720 0x7fd3a409d3e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000c400 tx=0x7fd3a000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.372+0000 7fd3aab9d640 1 -- 172.21.15.29:0/3212809277 shutdown_connections 2024-09-13T18:45:44.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.372+0000 7fd3aab9d640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd38806ac00 0x7fd38806d0c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.372+0000 7fd3aab9d640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3a41457c0 0x7fd3a41dea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.372+0000 7fd3aab9d640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a4142930 0x7fd3a40b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.372+0000 7fd3aab9d640 1 --2- 172.21.15.29:0/3212809277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3a40b8720 0x7fd3a409d3e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.372+0000 7fd3aab9d640 1 -- 172.21.15.29:0/3212809277 >> 172.21.15.29:0/3212809277 conn(0x7fd3a4071c30 msgr2=0x7fd3a4098ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:44.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.372+0000 7fd3aab9d640 1 -- 172.21.15.29:0/3212809277 shutdown_connections 2024-09-13T18:45:44.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.372+0000 7fd3aab9d640 1 -- 172.21.15.29:0/3212809277 wait complete. 2024-09-13T18:45:44.385 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-13T18:45:43.592196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234748,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739972,"statfs":{"total":773094113280,"available":772853731328,"internally_reserved":0,"allocated":2228224,"data_stored":1985074,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003189"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.052330+0000","last_change":"2024-09-13T18:45:21.668274+0000","last_active":"2024-09-13T18:45:26.052330+0000","last_peered":"2024-09-13T18:45:26.052330+0000","last_clean":"2024-09-13T18:45:26.052330+0000","last_became_active":"2024-09-13T18:45:21.667985+0000","last_became_peered":"2024-09-13T18:45:21.667985+0000","last_unstale":"2024-09-13T18:45:26.052330+0000","last_undegraded":"2024-09-13T18:45:26.052330+0000","last_fullsized":"2024-09-13T18:45:26.052330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:45.703424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601092+0000","last_change":"2024-09-13T18:45:22.034389+0000","last_active":"2024-09-13T18:45:26.601092+0000","last_peered":"2024-09-13T18:45:26.601092+0000","last_clean":"2024-09-13T18:45:26.601092+0000","last_became_active":"2024-09-13T18:45:22.034125+0000","last_became_peered":"2024-09-13T18:45:22.034125+0000","last_unstale":"2024-09-13T18:45:26.601092+0000","last_undegraded":"2024-09-13T18:45:26.601092+0000","last_fullsized":"2024-09-13T18:45:26.601092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600983+0000","last_change":"2024-09-13T18:45:26.253118+0000","last_active":"2024-09-13T18:45:26.600983+0000","last_peered":"2024-09-13T18:45:26.600983+0000","last_clean":"2024-09-13T18:45:26.600983+0000","last_became_active":"2024-09-13T18:45:26.252747+0000","last_became_peered":"2024-09-13T18:45:26.252747+0000","last_unstale":"2024-09-13T18:45:26.600983+0000","last_undegraded":"2024-09-13T18:45:26.600983+0000","last_fullsized":"2024-09-13T18:45:26.600983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:11.065130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.036006+0000","last_change":"2024-09-13T18:45:21.666664+0000","last_active":"2024-09-13T18:45:26.036006+0000","last_peered":"2024-09-13T18:45:26.036006+0000","last_clean":"2024-09-13T18:45:26.036006+0000","last_became_active":"2024-09-13T18:45:21.666398+0000","last_became_peered":"2024-09-13T18:45:21.666398+0000","last_unstale":"2024-09-13T18:45:26.036006+0000","last_undegraded":"2024-09-13T18:45:26.036006+0000","last_fullsized":"2024-09-13T18:45:26.036006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:06.210838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599906+0000","last_change":"2024-09-13T18:45:22.024774+0000","last_active":"2024-09-13T18:45:26.599906+0000","last_peered":"2024-09-13T18:45:26.599906+0000","last_clean":"2024-09-13T18:45:26.599906+0000","last_became_active":"2024-09-13T18:45:22.024424+0000","last_became_peered":"2024-09-13T18:45:22.024424+0000","last_unstale":"2024-09-13T18:45:26.599906+0000","last_undegraded":"2024-09-13T18:45:26.599906+0000","last_fullsized":"2024-09-13T18:45:26.599906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409608+0000","last_change":"2024-09-13T18:45:26.050411+0000","last_active":"2024-09-13T18:45:26.409608+0000","last_peered":"2024-09-13T18:45:26.409608+0000","last_clean":"2024-09-13T18:45:26.409608+0000","last_became_active":"2024-09-13T18:45:26.049414+0000","last_became_peered":"2024-09-13T18:45:26.049414+0000","last_unstale":"2024-09-13T18:45:26.409608+0000","last_undegraded":"2024-09-13T18:45:26.409608+0000","last_fullsized":"2024-09-13T18:45:26.409608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.251372+0000","last_change":"2024-09-13T18:45:21.667928+0000","last_active":"2024-09-13T18:45:26.251372+0000","last_peered":"2024-09-13T18:45:26.251372+0000","last_clean":"2024-09-13T18:45:26.251372+0000","last_became_active":"2024-09-13T18:45:21.667602+0000","last_became_peered":"2024-09-13T18:45:21.667602+0000","last_unstale":"2024-09-13T18:45:26.251372+0000","last_undegraded":"2024-09-13T18:45:26.251372+0000","last_fullsized":"2024-09-13T18:45:26.251372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:53.936326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600361+0000","last_change":"2024-09-13T18:45:22.036952+0000","last_active":"2024-09-13T18:45:26.600361+0000","last_peered":"2024-09-13T18:45:26.600361+0000","last_clean":"2024-09-13T18:45:26.600361+0000","last_became_active":"2024-09-13T18:45:22.035790+0000","last_became_peered":"2024-09-13T18:45:22.035790+0000","last_unstale":"2024-09-13T18:45:26.600361+0000","last_undegraded":"2024-09-13T18:45:26.600361+0000","last_fullsized":"2024-09-13T18:45:26.600361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410405+0000","last_change":"2024-09-13T18:45:26.052333+0000","last_active":"2024-09-13T18:45:26.410405+0000","last_peered":"2024-09-13T18:45:26.410405+0000","last_clean":"2024-09-13T18:45:26.410405+0000","last_became_active":"2024-09-13T18:45:26.051873+0000","last_became_peered":"2024-09-13T18:45:26.051873+0000","last_unstale":"2024-09-13T18:45:26.410405+0000","last_undegraded":"2024-09-13T18:45:26.410405+0000","last_fullsized":"2024-09-13T18:45:26.410405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:03.925946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.250039+0000","last_change":"2024-09-13T18:45:21.669914+0000","last_active":"2024-09-13T18:45:26.250039+0000","last_peered":"2024-09-13T18:45:26.250039+0000","last_clean":"2024-09-13T18:45:26.250039+0000","last_became_active":"2024-09-13T18:45:21.669622+0000","last_became_peered":"2024-09-13T18:45:21.669622+0000","last_unstale":"2024-09-13T18:45:26.250039+0000","last_undegraded":"2024-09-13T18:45:26.250039+0000","last_fullsized":"2024-09-13T18:45:26.250039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.765670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600397+0000","last_change":"2024-09-13T18:45:22.035675+0000","last_active":"2024-09-13T18:45:26.600397+0000","last_peered":"2024-09-13T18:45:26.600397+0000","last_clean":"2024-09-13T18:45:26.600397+0000","last_became_active":"2024-09-13T18:45:22.034431+0000","last_became_peered":"2024-09-13T18:45:22.034431+0000","last_unstale":"2024-09-13T18:45:26.600397+0000","last_undegraded":"2024-09-13T18:45:26.600397+0000","last_fullsized":"2024-09-13T18:45:26.600397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410278+0000","last_change":"2024-09-13T18:45:26.052892+0000","last_active":"2024-09-13T18:45:26.410278+0000","last_peered":"2024-09-13T18:45:26.410278+0000","last_clean":"2024-09-13T18:45:26.410278+0000","last_became_active":"2024-09-13T18:45:26.052441+0000","last_became_peered":"2024-09-13T18:45:26.052441+0000","last_unstale":"2024-09-13T18:45:26.410278+0000","last_undegraded":"2024-09-13T18:45:26.410278+0000","last_fullsized":"2024-09-13T18:45:26.410278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:26.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409959+0000","last_change":"2024-09-13T18:45:22.017741+0000","last_active":"2024-09-13T18:45:26.409959+0000","last_peered":"2024-09-13T18:45:26.409959+0000","last_clean":"2024-09-13T18:45:26.409959+0000","last_became_active":"2024-09-13T18:45:22.015758+0000","last_became_peered":"2024-09-13T18:45:22.015758+0000","last_unstale":"2024-09-13T18:45:26.409959+0000","last_undegraded":"2024-09-13T18:45:26.409959+0000","last_fullsized":"2024-09-13T18:45:26.409959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.250273+0000","last_change":"2024-09-13T18:45:21.672627+0000","last_active":"2024-09-13T18:45:26.250273+0000","last_peered":"2024-09-13T18:45:26.250273+0000","last_clean":"2024-09-13T18:45:26.250273+0000","last_became_active":"2024-09-13T18:45:21.672388+0000","last_became_peered":"2024-09-13T18:45:21.672388+0000","last_unstale":"2024-09-13T18:45:26.250273+0000","last_undegraded":"2024-09-13T18:45:26.250273+0000","last_fullsized":"2024-09-13T18:45:26.250273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410013+0000","last_change":"2024-09-13T18:45:26.052609+0000","last_active":"2024-09-13T18:45:26.410013+0000","last_peered":"2024-09-13T18:45:26.410013+0000","last_clean":"2024-09-13T18:45:26.410013+0000","last_became_active":"2024-09-13T18:45:26.052245+0000","last_became_peered":"2024-09-13T18:45:26.052245+0000","last_unstale":"2024-09-13T18:45:26.410013+0000","last_undegraded":"2024-09-13T18:45:26.410013+0000","last_fullsized":"2024-09-13T18:45:26.410013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:50.583636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601039+0000","last_change":"2024-09-13T18:45:22.028858+0000","last_active":"2024-09-13T18:45:26.601039+0000","last_peered":"2024-09-13T18:45:26.601039+0000","last_clean":"2024-09-13T18:45:26.601039+0000","last_became_active":"2024-09-13T18:45:22.028336+0000","last_became_peered":"2024-09-13T18:45:22.028336+0000","last_unstale":"2024-09-13T18:45:26.601039+0000","last_undegraded":"2024-09-13T18:45:26.601039+0000","last_fullsized":"2024-09-13T18:45:26.601039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.046785+0000","last_change":"2024-09-13T18:45:21.667983+0000","last_active":"2024-09-13T18:45:26.046785+0000","last_peered":"2024-09-13T18:45:26.046785+0000","last_clean":"2024-09-13T18:45:26.046785+0000","last_became_active":"2024-09-13T18:45:21.667625+0000","last_became_peered":"2024-09-13T18:45:21.667625+0000","last_unstale":"2024-09-13T18:45:26.046785+0000","last_undegraded":"2024-09-13T18:45:26.046785+0000","last_fullsized":"2024-09-13T18:45:26.046785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409827+0000","last_change":"2024-09-13T18:45:26.050576+0000","last_active":"2024-09-13T18:45:26.409827+0000","last_peered":"2024-09-13T18:45:26.409827+0000","last_clean":"2024-09-13T18:45:26.409827+0000","last_became_active":"2024-09-13T18:45:26.049129+0000","last_became_peered":"2024-09-13T18:45:26.049129+0000","last_unstale":"2024-09-13T18:45:26.409827+0000","last_undegraded":"2024-09-13T18:45:26.409827+0000","last_fullsized":"2024-09-13T18:45:26.409827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600972+0000","last_change":"2024-09-13T18:45:22.025900+0000","last_active":"2024-09-13T18:45:26.600972+0000","last_peered":"2024-09-13T18:45:26.600972+0000","last_clean":"2024-09-13T18:45:26.600972+0000","last_became_active":"2024-09-13T18:45:22.025624+0000","last_became_peered":"2024-09-13T18:45:22.025624+0000","last_unstale":"2024-09-13T18:45:26.600972+0000","last_undegraded":"2024-09-13T18:45:26.600972+0000","last_fullsized":"2024-09-13T18:45:26.600972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.045814+0000","last_change":"2024-09-13T18:45:21.668525+0000","last_active":"2024-09-13T18:45:26.045814+0000","last_peered":"2024-09-13T18:45:26.045814+0000","last_clean":"2024-09-13T18:45:26.045814+0000","last_became_active":"2024-09-13T18:45:21.668242+0000","last_became_peered":"2024-09-13T18:45:21.668242+0000","last_unstale":"2024-09-13T18:45:26.045814+0000","last_undegraded":"2024-09-13T18:45:26.045814+0000","last_fullsized":"2024-09-13T18:45:26.045814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605435+0000","last_change":"2024-09-13T18:45:26.255263+0000","last_active":"2024-09-13T18:45:26.605435+0000","last_peered":"2024-09-13T18:45:26.605435+0000","last_clean":"2024-09-13T18:45:26.605435+0000","last_became_active":"2024-09-13T18:45:26.254886+0000","last_became_peered":"2024-09-13T18:45:26.254886+0000","last_unstale":"2024-09-13T18:45:26.605435+0000","last_undegraded":"2024-09-13T18:45:26.605435+0000","last_fullsized":"2024-09-13T18:45:26.605435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410916+0000","last_change":"2024-09-13T18:45:22.029624+0000","last_active":"2024-09-13T18:45:26.410916+0000","last_peered":"2024-09-13T18:45:26.410916+0000","last_clean":"2024-09-13T18:45:26.410916+0000","last_became_active":"2024-09-13T18:45:22.027835+0000","last_became_peered":"2024-09-13T18:45:22.027835+0000","last_unstale":"2024-09-13T18:45:26.410916+0000","last_undegraded":"2024-09-13T18:45:26.410916+0000","last_fullsized":"2024-09-13T18:45:26.410916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:16.317986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.249681+0000","last_change":"2024-09-13T18:45:21.669073+0000","last_active":"2024-09-13T18:45:26.249681+0000","last_peered":"2024-09-13T18:45:26.249681+0000","last_clean":"2024-09-13T18:45:26.249681+0000","last_became_active":"2024-09-13T18:45:21.668765+0000","last_became_peered":"2024-09-13T18:45:21.668765+0000","last_unstale":"2024-09-13T18:45:26.249681+0000","last_undegraded":"2024-09-13T18:45:26.249681+0000","last_fullsized":"2024-09-13T18:45:26.249681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409880+0000","last_change":"2024-09-13T18:45:26.050623+0000","last_active":"2024-09-13T18:45:26.409880+0000","last_peered":"2024-09-13T18:45:26.409880+0000","last_clean":"2024-09-13T18:45:26.409880+0000","last_became_active":"2024-09-13T18:45:26.049408+0000","last_became_peered":"2024-09-13T18:45:26.049408+0000","last_unstale":"2024-09-13T18:45:26.409880+0000","last_undegraded":"2024-09-13T18:45:26.409880+0000","last_fullsized":"2024-09-13T18:45:26.409880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:14.574386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599890+0000","last_change":"2024-09-13T18:45:22.022220+0000","last_active":"2024-09-13T18:45:26.599890+0000","last_peered":"2024-09-13T18:45:26.599890+0000","last_clean":"2024-09-13T18:45:26.599890+0000","last_became_active":"2024-09-13T18:45:22.021976+0000","last_became_peered":"2024-09-13T18:45:22.021976+0000","last_unstale":"2024-09-13T18:45:26.599890+0000","last_undegraded":"2024-09-13T18:45:26.599890+0000","last_fullsized":"2024-09-13T18:45:26.599890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.037252+0000","last_change":"2024-09-13T18:45:21.667931+0000","last_active":"2024-09-13T18:45:26.037252+0000","last_peered":"2024-09-13T18:45:26.037252+0000","last_clean":"2024-09-13T18:45:26.037252+0000","last_became_active":"2024-09-13T18:45:21.667680+0000","last_became_peered":"2024-09-13T18:45:21.667680+0000","last_unstale":"2024-09-13T18:45:26.037252+0000","last_undegraded":"2024-09-13T18:45:26.037252+0000","last_fullsized":"2024-09-13T18:45:26.037252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410658+0000","last_change":"2024-09-13T18:45:26.255088+0000","last_active":"2024-09-13T18:45:26.410658+0000","last_peered":"2024-09-13T18:45:26.410658+0000","last_clean":"2024-09-13T18:45:26.410658+0000","last_became_active":"2024-09-13T18:45:26.254662+0000","last_became_peered":"2024-09-13T18:45:26.254662+0000","last_unstale":"2024-09-13T18:45:26.410658+0000","last_undegraded":"2024-09-13T18:45:26.410658+0000","last_fullsized":"2024-09-13T18:45:26.410658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601131+0000","last_change":"2024-09-13T18:45:22.026678+0000","last_active":"2024-09-13T18:45:26.601131+0000","last_peered":"2024-09-13T18:45:26.601131+0000","last_clean":"2024-09-13T18:45:26.601131+0000","last_became_active":"2024-09-13T18:45:22.026419+0000","last_became_peered":"2024-09-13T18:45:22.026419+0000","last_unstale":"2024-09-13T18:45:26.601131+0000","last_undegraded":"2024-09-13T18:45:26.601131+0000","last_fullsized":"2024-09-13T18:45:26.601131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.043788+0000","last_change":"2024-09-13T18:45:21.664622+0000","last_active":"2024-09-13T18:45:26.043788+0000","last_peered":"2024-09-13T18:45:26.043788+0000","last_clean":"2024-09-13T18:45:26.043788+0000","last_became_active":"2024-09-13T18:45:21.664066+0000","last_became_peered":"2024-09-13T18:45:21.664066+0000","last_unstale":"2024-09-13T18:45:26.043788+0000","last_undegraded":"2024-09-13T18:45:26.043788+0000","last_fullsized":"2024-09-13T18:45:26.043788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600919+0000","last_change":"2024-09-13T18:45:26.253888+0000","last_active":"2024-09-13T18:45:26.600919+0000","last_peered":"2024-09-13T18:45:26.600919+0000","last_clean":"2024-09-13T18:45:26.600919+0000","last_became_active":"2024-09-13T18:45:26.253488+0000","last_became_peered":"2024-09-13T18:45:26.253488+0000","last_unstale":"2024-09-13T18:45:26.600919+0000","last_undegraded":"2024-09-13T18:45:26.600919+0000","last_fullsized":"2024-09-13T18:45:26.600919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:44.826493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605373+0000","last_change":"2024-09-13T18:45:22.022940+0000","last_active":"2024-09-13T18:45:26.605373+0000","last_peered":"2024-09-13T18:45:26.605373+0000","last_clean":"2024-09-13T18:45:26.605373+0000","last_became_active":"2024-09-13T18:45:22.022628+0000","last_became_peered":"2024-09-13T18:45:22.022628+0000","last_unstale":"2024-09-13T18:45:26.605373+0000","last_undegraded":"2024-09-13T18:45:26.605373+0000","last_fullsized":"2024-09-13T18:45:26.605373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.251762+0000","last_change":"2024-09-13T18:45:21.668903+0000","last_active":"2024-09-13T18:45:26.251762+0000","last_peered":"2024-09-13T18:45:26.251762+0000","last_clean":"2024-09-13T18:45:26.251762+0000","last_became_active":"2024-09-13T18:45:21.668645+0000","last_became_peered":"2024-09-13T18:45:21.668645+0000","last_unstale":"2024-09-13T18:45:26.251762+0000","last_undegraded":"2024-09-13T18:45:26.251762+0000","last_fullsized":"2024-09-13T18:45:26.251762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599791+0000","last_change":"2024-09-13T18:45:26.250454+0000","last_active":"2024-09-13T18:45:26.599791+0000","last_peered":"2024-09-13T18:45:26.599791+0000","last_clean":"2024-09-13T18:45:26.599791+0000","last_became_active":"2024-09-13T18:45:26.250034+0000","last_became_peered":"2024-09-13T18:45:26.250034+0000","last_unstale":"2024-09-13T18:45:26.599791+0000","last_undegraded":"2024-09-13T18:45:26.599791+0000","last_fullsized":"2024-09-13T18:45:26.599791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.971516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600409+0000","last_change":"2024-09-13T18:45:22.032362+0000","last_active":"2024-09-13T18:45:26.600409+0000","last_peered":"2024-09-13T18:45:26.600409+0000","last_clean":"2024-09-13T18:45:26.600409+0000","last_became_active":"2024-09-13T18:45:22.032022+0000","last_became_peered":"2024-09-13T18:45:22.032022+0000","last_unstale":"2024-09-13T18:45:26.600409+0000","last_undegraded":"2024-09-13T18:45:26.600409+0000","last_fullsized":"2024-09-13T18:45:26.600409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.046217+0000","last_change":"2024-09-13T18:45:21.661117+0000","last_active":"2024-09-13T18:45:26.046217+0000","last_peered":"2024-09-13T18:45:26.046217+0000","last_clean":"2024-09-13T18:45:26.046217+0000","last_became_active":"2024-09-13T18:45:21.660577+0000","last_became_peered":"2024-09-13T18:45:21.660577+0000","last_unstale":"2024-09-13T18:45:26.046217+0000","last_undegraded":"2024-09-13T18:45:26.046217+0000","last_fullsized":"2024-09-13T18:45:26.046217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605338+0000","last_change":"2024-09-13T18:45:26.056021+0000","last_active":"2024-09-13T18:45:26.605338+0000","last_peered":"2024-09-13T18:45:26.605338+0000","last_clean":"2024-09-13T18:45:26.605338+0000","last_became_active":"2024-09-13T18:45:26.053877+0000","last_became_peered":"2024-09-13T18:45:26.053877+0000","last_unstale":"2024-09-13T18:45:26.605338+0000","last_undegraded":"2024-09-13T18:45:26.605338+0000","last_fullsized":"2024-09-13T18:45:26.605338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:51.489422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.411006+0000","last_change":"2024-09-13T18:45:22.029936+0000","last_active":"2024-09-13T18:45:26.411006+0000","last_peered":"2024-09-13T18:45:26.411006+0000","last_clean":"2024-09-13T18:45:26.411006+0000","last_became_active":"2024-09-13T18:45:22.028714+0000","last_became_peered":"2024-09-13T18:45:22.028714+0000","last_unstale":"2024-09-13T18:45:26.411006+0000","last_undegraded":"2024-09-13T18:45:26.411006+0000","last_fullsized":"2024-09-13T18:45:26.411006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:35.746368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044364+0000","last_change":"2024-09-13T18:45:21.667926+0000","last_active":"2024-09-13T18:45:26.044364+0000","last_peered":"2024-09-13T18:45:26.044364+0000","last_clean":"2024-09-13T18:45:26.044364+0000","last_became_active":"2024-09-13T18:45:21.667320+0000","last_became_peered":"2024-09-13T18:45:21.667320+0000","last_unstale":"2024-09-13T18:45:26.044364+0000","last_undegraded":"2024-09-13T18:45:26.044364+0000","last_fullsized":"2024-09-13T18:45:26.044364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605364+0000","last_change":"2024-09-13T18:45:26.055615+0000","last_active":"2024-09-13T18:45:26.605364+0000","last_peered":"2024-09-13T18:45:26.605364+0000","last_clean":"2024-09-13T18:45:26.605364+0000","last_became_active":"2024-09-13T18:45:26.053681+0000","last_became_peered":"2024-09-13T18:45:26.053681+0000","last_unstale":"2024-09-13T18:45:26.605364+0000","last_undegraded":"2024-09-13T18:45:26.605364+0000","last_fullsized":"2024-09-13T18:45:26.605364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605300+0000","last_change":"2024-09-13T18:45:22.023623+0000","last_active":"2024-09-13T18:45:26.605300+0000","last_peered":"2024-09-13T18:45:26.605300+0000","last_clean":"2024-09-13T18:45:26.605300+0000","last_became_active":"2024-09-13T18:45:22.023357+0000","last_became_peered":"2024-09-13T18:45:22.023357+0000","last_unstale":"2024-09-13T18:45:26.605300+0000","last_undegraded":"2024-09-13T18:45:26.605300+0000","last_fullsized":"2024-09-13T18:45:26.605300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.039394+0000","last_change":"2024-09-13T18:45:21.668065+0000","last_active":"2024-09-13T18:45:26.039394+0000","last_peered":"2024-09-13T18:45:26.039394+0000","last_clean":"2024-09-13T18:45:26.039394+0000","last_became_active":"2024-09-13T18:45:21.667768+0000","last_became_peered":"2024-09-13T18:45:21.667768+0000","last_unstale":"2024-09-13T18:45:26.039394+0000","last_undegraded":"2024-09-13T18:45:26.039394+0000","last_fullsized":"2024-09-13T18:45:26.039394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605444+0000","last_change":"2024-09-13T18:45:26.057274+0000","last_active":"2024-09-13T18:45:26.605444+0000","last_peered":"2024-09-13T18:45:26.605444+0000","last_clean":"2024-09-13T18:45:26.605444+0000","last_became_active":"2024-09-13T18:45:26.056850+0000","last_became_peered":"2024-09-13T18:45:26.056850+0000","last_unstale":"2024-09-13T18:45:26.605444+0000","last_undegraded":"2024-09-13T18:45:26.605444+0000","last_fullsized":"2024-09-13T18:45:26.605444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.971516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599753+0000","last_change":"2024-09-13T18:45:22.020577+0000","last_active":"2024-09-13T18:45:26.599753+0000","last_peered":"2024-09-13T18:45:26.599753+0000","last_clean":"2024-09-13T18:45:26.599753+0000","last_became_active":"2024-09-13T18:45:22.020317+0000","last_became_peered":"2024-09-13T18:45:22.020317+0000","last_unstale":"2024-09-13T18:45:26.599753+0000","last_undegraded":"2024-09-13T18:45:26.599753+0000","last_fullsized":"2024-09-13T18:45:26.599753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.249771+0000","last_change":"2024-09-13T18:45:21.667753+0000","last_active":"2024-09-13T18:45:26.249771+0000","last_peered":"2024-09-13T18:45:26.249771+0000","last_clean":"2024-09-13T18:45:26.249771+0000","last_became_active":"2024-09-13T18:45:21.667483+0000","last_became_peered":"2024-09-13T18:45:21.667483+0000","last_unstale":"2024-09-13T18:45:26.249771+0000","last_undegraded":"2024-09-13T18:45:26.249771+0000","last_fullsized":"2024-09-13T18:45:26.249771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:22.171336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599881+0000","last_change":"2024-09-13T18:45:26.254703+0000","last_active":"2024-09-13T18:45:26.599881+0000","last_peered":"2024-09-13T18:45:26.599881+0000","last_clean":"2024-09-13T18:45:26.599881+0000","last_became_active":"2024-09-13T18:45:26.253533+0000","last_became_peered":"2024-09-13T18:45:26.253533+0000","last_unstale":"2024-09-13T18:45:26.599881+0000","last_undegraded":"2024-09-13T18:45:26.599881+0000","last_fullsized":"2024-09-13T18:45:26.599881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601018+0000","last_change":"2024-09-13T18:45:22.032365+0000","last_active":"2024-09-13T18:45:26.601018+0000","last_peered":"2024-09-13T18:45:26.601018+0000","last_clean":"2024-09-13T18:45:26.601018+0000","last_became_active":"2024-09-13T18:45:22.032109+0000","last_became_peered":"2024-09-13T18:45:22.032109+0000","last_unstale":"2024-09-13T18:45:26.601018+0000","last_undegraded":"2024-09-13T18:45:26.601018+0000","last_fullsized":"2024-09-13T18:45:26.601018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044305+0000","last_change":"2024-09-13T18:45:21.662636+0000","last_active":"2024-09-13T18:45:26.044305+0000","last_peered":"2024-09-13T18:45:26.044305+0000","last_clean":"2024-09-13T18:45:26.044305+0000","last_became_active":"2024-09-13T18:45:21.662344+0000","last_became_peered":"2024-09-13T18:45:21.662344+0000","last_unstale":"2024-09-13T18:45:26.044305+0000","last_undegraded":"2024-09-13T18:45:26.044305+0000","last_fullsized":"2024-09-13T18:45:26.044305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.249885+0000","last_change":"2024-09-13T18:45:19.778048+0000","last_active":"2024-09-13T18:45:26.249885+0000","last_peered":"2024-09-13T18:45:26.249885+0000","last_clean":"2024-09-13T18:45:26.249885+0000","last_became_active":"2024-09-13T18:45:19.777172+0000","last_became_peered":"2024-09-13T18:45:19.777172+0000","last_unstale":"2024-09-13T18:45:26.249885+0000","last_undegraded":"2024-09-13T18:45:26.249885+0000","last_fullsized":"2024-09-13T18:45:26.249885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_clean_scrub_stamp":"2024-09-13T18:45:17.981407+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:51.905955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410145+0000","last_change":"2024-09-13T18:45:26.253260+0000","last_active":"2024-09-13T18:45:26.410145+0000","last_peered":"2024-09-13T18:45:26.410145+0000","last_clean":"2024-09-13T18:45:26.410145+0000","last_became_active":"2024-09-13T18:45:26.252890+0000","last_became_peered":"2024-09-13T18:45:26.252890+0000","last_unstale":"2024-09-13T18:45:26.410145+0000","last_undegraded":"2024-09-13T18:45:26.410145+0000","last_fullsized":"2024-09-13T18:45:26.410145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599981+0000","last_change":"2024-09-13T18:45:22.036446+0000","last_active":"2024-09-13T18:45:26.599981+0000","last_peered":"2024-09-13T18:45:26.599981+0000","last_clean":"2024-09-13T18:45:26.599981+0000","last_became_active":"2024-09-13T18:45:22.036153+0000","last_became_peered":"2024-09-13T18:45:22.036153+0000","last_unstale":"2024-09-13T18:45:26.599981+0000","last_undegraded":"2024-09-13T18:45:26.599981+0000","last_fullsized":"2024-09-13T18:45:26.599981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.041776+0000","last_change":"2024-09-13T18:45:21.665847+0000","last_active":"2024-09-13T18:45:26.041776+0000","last_peered":"2024-09-13T18:45:26.041776+0000","last_clean":"2024-09-13T18:45:26.041776+0000","last_became_active":"2024-09-13T18:45:21.665582+0000","last_became_peered":"2024-09-13T18:45:21.665582+0000","last_unstale":"2024-09-13T18:45:26.041776+0000","last_undegraded":"2024-09-13T18:45:26.041776+0000","last_fullsized":"2024-09-13T18:45:26.041776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409441+0000","last_change":"2024-09-13T18:45:26.250391+0000","last_active":"2024-09-13T18:45:26.409441+0000","last_peered":"2024-09-13T18:45:26.409441+0000","last_clean":"2024-09-13T18:45:26.409441+0000","last_became_active":"2024-09-13T18:45:26.249986+0000","last_became_peered":"2024-09-13T18:45:26.249986+0000","last_unstale":"2024-09-13T18:45:26.409441+0000","last_undegraded":"2024-09-13T18:45:26.409441+0000","last_fullsized":"2024-09-13T18:45:26.409441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600372+0000","last_change":"2024-09-13T18:45:22.037142+0000","last_active":"2024-09-13T18:45:26.600372+0000","last_peered":"2024-09-13T18:45:26.600372+0000","last_clean":"2024-09-13T18:45:26.600372+0000","last_became_active":"2024-09-13T18:45:22.036523+0000","last_became_peered":"2024-09-13T18:45:22.036523+0000","last_unstale":"2024-09-13T18:45:26.600372+0000","last_undegraded":"2024-09-13T18:45:26.600372+0000","last_fullsized":"2024-09-13T18:45:26.600372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.045297+0000","last_change":"2024-09-13T18:45:21.662924+0000","last_active":"2024-09-13T18:45:26.045297+0000","last_peered":"2024-09-13T18:45:26.045297+0000","last_clean":"2024-09-13T18:45:26.045297+0000","last_became_active":"2024-09-13T18:45:21.662405+0000","last_became_peered":"2024-09-13T18:45:21.662405+0000","last_unstale":"2024-09-13T18:45:26.045297+0000","last_undegraded":"2024-09-13T18:45:26.045297+0000","last_fullsized":"2024-09-13T18:45:26.045297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599813+0000","last_change":"2024-09-13T18:45:26.055309+0000","last_active":"2024-09-13T18:45:26.599813+0000","last_peered":"2024-09-13T18:45:26.599813+0000","last_clean":"2024-09-13T18:45:26.599813+0000","last_became_active":"2024-09-13T18:45:26.054449+0000","last_became_peered":"2024-09-13T18:45:26.054449+0000","last_unstale":"2024-09-13T18:45:26.599813+0000","last_undegraded":"2024-09-13T18:45:26.599813+0000","last_fullsized":"2024-09-13T18:45:26.599813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600056+0000","last_change":"2024-09-13T18:45:22.034277+0000","last_active":"2024-09-13T18:45:26.600056+0000","last_peered":"2024-09-13T18:45:26.600056+0000","last_clean":"2024-09-13T18:45:26.600056+0000","last_became_active":"2024-09-13T18:45:22.033562+0000","last_became_peered":"2024-09-13T18:45:22.033562+0000","last_unstale":"2024-09-13T18:45:26.600056+0000","last_undegraded":"2024-09-13T18:45:26.600056+0000","last_fullsized":"2024-09-13T18:45:26.600056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:07.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.041599+0000","last_change":"2024-09-13T18:45:21.667622+0000","last_active":"2024-09-13T18:45:26.041599+0000","last_peered":"2024-09-13T18:45:26.041599+0000","last_clean":"2024-09-13T18:45:26.041599+0000","last_became_active":"2024-09-13T18:45:21.667340+0000","last_became_peered":"2024-09-13T18:45:21.667340+0000","last_unstale":"2024-09-13T18:45:26.041599+0000","last_undegraded":"2024-09-13T18:45:26.041599+0000","last_fullsized":"2024-09-13T18:45:26.041599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600221+0000","last_change":"2024-09-13T18:45:26.250450+0000","last_active":"2024-09-13T18:45:26.600221+0000","last_peered":"2024-09-13T18:45:26.600221+0000","last_clean":"2024-09-13T18:45:26.600221+0000","last_became_active":"2024-09-13T18:45:26.250020+0000","last_became_peered":"2024-09-13T18:45:26.250020+0000","last_unstale":"2024-09-13T18:45:26.600221+0000","last_undegraded":"2024-09-13T18:45:26.600221+0000","last_fullsized":"2024-09-13T18:45:26.600221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:46.567482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600026+0000","last_change":"2024-09-13T18:45:22.030584+0000","last_active":"2024-09-13T18:45:26.600026+0000","last_peered":"2024-09-13T18:45:26.600026+0000","last_clean":"2024-09-13T18:45:26.600026+0000","last_became_active":"2024-09-13T18:45:22.030275+0000","last_became_peered":"2024-09-13T18:45:22.030275+0000","last_unstale":"2024-09-13T18:45:26.600026+0000","last_undegraded":"2024-09-13T18:45:26.600026+0000","last_fullsized":"2024-09-13T18:45:26.600026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.038135+0000","last_change":"2024-09-13T18:45:21.662490+0000","last_active":"2024-09-13T18:45:26.038135+0000","last_peered":"2024-09-13T18:45:26.038135+0000","last_clean":"2024-09-13T18:45:26.038135+0000","last_became_active":"2024-09-13T18:45:21.662210+0000","last_became_peered":"2024-09-13T18:45:21.662210+0000","last_unstale":"2024-09-13T18:45:26.038135+0000","last_undegraded":"2024-09-13T18:45:26.038135+0000","last_fullsized":"2024-09-13T18:45:26.038135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410593+0000","last_change":"2024-09-13T18:45:26.053575+0000","last_active":"2024-09-13T18:45:26.410593+0000","last_peered":"2024-09-13T18:45:26.410593+0000","last_clean":"2024-09-13T18:45:26.410593+0000","last_became_active":"2024-09-13T18:45:26.053195+0000","last_became_peered":"2024-09-13T18:45:26.053195+0000","last_unstale":"2024-09-13T18:45:26.410593+0000","last_undegraded":"2024-09-13T18:45:26.410593+0000","last_fullsized":"2024-09-13T18:45:26.410593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:28.745002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599910+0000","last_change":"2024-09-13T18:45:22.031817+0000","last_active":"2024-09-13T18:45:26.599910+0000","last_peered":"2024-09-13T18:45:26.599910+0000","last_clean":"2024-09-13T18:45:26.599910+0000","last_became_active":"2024-09-13T18:45:22.031312+0000","last_became_peered":"2024-09-13T18:45:22.031312+0000","last_unstale":"2024-09-13T18:45:26.599910+0000","last_undegraded":"2024-09-13T18:45:26.599910+0000","last_fullsized":"2024-09-13T18:45:26.599910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.039206+0000","last_change":"2024-09-13T18:45:21.655353+0000","last_active":"2024-09-13T18:45:26.039206+0000","last_peered":"2024-09-13T18:45:26.039206+0000","last_clean":"2024-09-13T18:45:26.039206+0000","last_became_active":"2024-09-13T18:45:21.654844+0000","last_became_peered":"2024-09-13T18:45:21.654844+0000","last_unstale":"2024-09-13T18:45:26.039206+0000","last_undegraded":"2024-09-13T18:45:26.039206+0000","last_fullsized":"2024-09-13T18:45:26.039206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599871+0000","last_change":"2024-09-13T18:45:26.056440+0000","last_active":"2024-09-13T18:45:26.599871+0000","last_peered":"2024-09-13T18:45:26.599871+0000","last_clean":"2024-09-13T18:45:26.599871+0000","last_became_active":"2024-09-13T18:45:26.055955+0000","last_became_peered":"2024-09-13T18:45:26.055955+0000","last_unstale":"2024-09-13T18:45:26.599871+0000","last_undegraded":"2024-09-13T18:45:26.599871+0000","last_fullsized":"2024-09-13T18:45:26.599871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:38.309349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409660+0000","last_change":"2024-09-13T18:45:22.027821+0000","last_active":"2024-09-13T18:45:26.409660+0000","last_peered":"2024-09-13T18:45:26.409660+0000","last_clean":"2024-09-13T18:45:26.409660+0000","last_became_active":"2024-09-13T18:45:22.027172+0000","last_became_peered":"2024-09-13T18:45:22.027172+0000","last_unstale":"2024-09-13T18:45:26.409660+0000","last_undegraded":"2024-09-13T18:45:26.409660+0000","last_fullsized":"2024-09-13T18:45:26.409660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.035641+0000","last_change":"2024-09-13T18:45:21.664084+0000","last_active":"2024-09-13T18:45:26.035641+0000","last_peered":"2024-09-13T18:45:26.035641+0000","last_clean":"2024-09-13T18:45:26.035641+0000","last_became_active":"2024-09-13T18:45:21.663746+0000","last_became_peered":"2024-09-13T18:45:21.663746+0000","last_unstale":"2024-09-13T18:45:26.035641+0000","last_undegraded":"2024-09-13T18:45:26.035641+0000","last_fullsized":"2024-09-13T18:45:26.035641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601109+0000","last_change":"2024-09-13T18:45:26.253221+0000","last_active":"2024-09-13T18:45:26.601109+0000","last_peered":"2024-09-13T18:45:26.601109+0000","last_clean":"2024-09-13T18:45:26.601109+0000","last_became_active":"2024-09-13T18:45:26.252841+0000","last_became_peered":"2024-09-13T18:45:26.252841+0000","last_unstale":"2024-09-13T18:45:26.601109+0000","last_undegraded":"2024-09-13T18:45:26.601109+0000","last_fullsized":"2024-09-13T18:45:26.601109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:26.396713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599947+0000","last_change":"2024-09-13T18:45:22.033554+0000","last_active":"2024-09-13T18:45:26.599947+0000","last_peered":"2024-09-13T18:45:26.599947+0000","last_clean":"2024-09-13T18:45:26.599947+0000","last_became_active":"2024-09-13T18:45:22.032862+0000","last_became_peered":"2024-09-13T18:45:22.032862+0000","last_unstale":"2024-09-13T18:45:26.599947+0000","last_undegraded":"2024-09-13T18:45:26.599947+0000","last_fullsized":"2024-09-13T18:45:26.599947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044282+0000","last_change":"2024-09-13T18:45:21.668025+0000","last_active":"2024-09-13T18:45:26.044282+0000","last_peered":"2024-09-13T18:45:26.044282+0000","last_clean":"2024-09-13T18:45:26.044282+0000","last_became_active":"2024-09-13T18:45:21.667457+0000","last_became_peered":"2024-09-13T18:45:21.667457+0000","last_unstale":"2024-09-13T18:45:26.044282+0000","last_undegraded":"2024-09-13T18:45:26.044282+0000","last_fullsized":"2024-09-13T18:45:26.044282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601060+0000","last_change":"2024-09-13T18:45:26.250464+0000","last_active":"2024-09-13T18:45:26.601060+0000","last_peered":"2024-09-13T18:45:26.601060+0000","last_clean":"2024-09-13T18:45:26.601060+0000","last_became_active":"2024-09-13T18:45:26.250041+0000","last_became_peered":"2024-09-13T18:45:26.250041+0000","last_unstale":"2024-09-13T18:45:26.601060+0000","last_undegraded":"2024-09-13T18:45:26.601060+0000","last_fullsized":"2024-09-13T18:45:26.601060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:20.013806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599781+0000","last_change":"2024-09-13T18:45:22.024133+0000","last_active":"2024-09-13T18:45:26.599781+0000","last_peered":"2024-09-13T18:45:26.599781+0000","last_clean":"2024-09-13T18:45:26.599781+0000","last_became_active":"2024-09-13T18:45:22.023882+0000","last_became_peered":"2024-09-13T18:45:22.023882+0000","last_unstale":"2024-09-13T18:45:26.599781+0000","last_undegraded":"2024-09-13T18:45:26.599781+0000","last_fullsized":"2024-09-13T18:45:26.599781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.053020+0000","last_change":"2024-09-13T18:45:21.663297+0000","last_active":"2024-09-13T18:45:26.053020+0000","last_peered":"2024-09-13T18:45:26.053020+0000","last_clean":"2024-09-13T18:45:26.053020+0000","last_became_active":"2024-09-13T18:45:21.662980+0000","last_became_peered":"2024-09-13T18:45:21.662980+0000","last_unstale":"2024-09-13T18:45:26.053020+0000","last_undegraded":"2024-09-13T18:45:26.053020+0000","last_fullsized":"2024-09-13T18:45:26.053020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600385+0000","last_change":"2024-09-13T18:45:26.253184+0000","last_active":"2024-09-13T18:45:26.600385+0000","last_peered":"2024-09-13T18:45:26.600385+0000","last_clean":"2024-09-13T18:45:26.600385+0000","last_became_active":"2024-09-13T18:45:26.252786+0000","last_became_peered":"2024-09-13T18:45:26.252786+0000","last_unstale":"2024-09-13T18:45:26.600385+0000","last_undegraded":"2024-09-13T18:45:26.600385+0000","last_fullsized":"2024-09-13T18:45:26.600385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599971+0000","last_change":"2024-09-13T18:45:22.035052+0000","last_active":"2024-09-13T18:45:26.599971+0000","last_peered":"2024-09-13T18:45:26.599971+0000","last_clean":"2024-09-13T18:45:26.599971+0000","last_became_active":"2024-09-13T18:45:22.034765+0000","last_became_peered":"2024-09-13T18:45:22.034765+0000","last_unstale":"2024-09-13T18:45:26.599971+0000","last_undegraded":"2024-09-13T18:45:26.599971+0000","last_fullsized":"2024-09-13T18:45:26.599971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:28.674827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:30.681690+0000","last_change":"2024-09-13T18:45:21.668054+0000","last_active":"2024-09-13T18:45:30.681690+0000","last_peered":"2024-09-13T18:45:30.681690+0000","last_clean":"2024-09-13T18:45:30.681690+0000","last_became_active":"2024-09-13T18:45:21.667587+0000","last_became_peered":"2024-09-13T18:45:21.667587+0000","last_unstale":"2024-09-13T18:45:30.681690+0000","last_undegraded":"2024-09-13T18:45:30.681690+0000","last_fullsized":"2024-09-13T18:45:30.681690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605348+0000","last_change":"2024-09-13T18:45:26.052997+0000","last_active":"2024-09-13T18:45:26.605348+0000","last_peered":"2024-09-13T18:45:26.605348+0000","last_clean":"2024-09-13T18:45:26.605348+0000","last_became_active":"2024-09-13T18:45:26.052614+0000","last_became_peered":"2024-09-13T18:45:26.052614+0000","last_unstale":"2024-09-13T18:45:26.605348+0000","last_undegraded":"2024-09-13T18:45:26.605348+0000","last_fullsized":"2024-09-13T18:45:26.605348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410522+0000","last_change":"2024-09-13T18:45:22.020754+0000","last_active":"2024-09-13T18:45:26.410522+0000","last_peered":"2024-09-13T18:45:26.410522+0000","last_clean":"2024-09-13T18:45:26.410522+0000","last_became_active":"2024-09-13T18:45:22.020461+0000","last_became_peered":"2024-09-13T18:45:22.020461+0000","last_unstale":"2024-09-13T18:45:26.410522+0000","last_undegraded":"2024-09-13T18:45:26.410522+0000","last_fullsized":"2024-09-13T18:45:26.410522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.045194+0000","last_change":"2024-09-13T18:45:21.664387+0000","last_active":"2024-09-13T18:45:26.045194+0000","last_peered":"2024-09-13T18:45:26.045194+0000","last_clean":"2024-09-13T18:45:26.045194+0000","last_became_active":"2024-09-13T18:45:21.663941+0000","last_became_peered":"2024-09-13T18:45:21.663941+0000","last_unstale":"2024-09-13T18:45:26.045194+0000","last_undegraded":"2024-09-13T18:45:26.045194+0000","last_fullsized":"2024-09-13T18:45:26.045194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410895+0000","last_change":"2024-09-13T18:45:26.051227+0000","last_active":"2024-09-13T18:45:26.410895+0000","last_peered":"2024-09-13T18:45:26.410895+0000","last_clean":"2024-09-13T18:45:26.410895+0000","last_became_active":"2024-09-13T18:45:26.050757+0000","last_became_peered":"2024-09-13T18:45:26.050757+0000","last_unstale":"2024-09-13T18:45:26.410895+0000","last_undegraded":"2024-09-13T18:45:26.410895+0000","last_fullsized":"2024-09-13T18:45:26.410895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:59.045390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599915+0000","last_change":"2024-09-13T18:45:22.025223+0000","last_active":"2024-09-13T18:45:26.599915+0000","last_peered":"2024-09-13T18:45:26.599915+0000","last_clean":"2024-09-13T18:45:26.599915+0000","last_became_active":"2024-09-13T18:45:22.024972+0000","last_became_peered":"2024-09-13T18:45:22.024972+0000","last_unstale":"2024-09-13T18:45:26.599915+0000","last_undegraded":"2024-09-13T18:45:26.599915+0000","last_fullsized":"2024-09-13T18:45:26.599915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044352+0000","last_change":"2024-09-13T18:45:21.666814+0000","last_active":"2024-09-13T18:45:26.044352+0000","last_peered":"2024-09-13T18:45:26.044352+0000","last_clean":"2024-09-13T18:45:26.044352+0000","last_became_active":"2024-09-13T18:45:21.666516+0000","last_became_peered":"2024-09-13T18:45:21.666516+0000","last_unstale":"2024-09-13T18:45:26.044352+0000","last_undegraded":"2024-09-13T18:45:26.044352+0000","last_fullsized":"2024-09-13T18:45:26.044352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600944+0000","last_change":"2024-09-13T18:45:26.057746+0000","last_active":"2024-09-13T18:45:26.600944+0000","last_peered":"2024-09-13T18:45:26.600944+0000","last_clean":"2024-09-13T18:45:26.600944+0000","last_became_active":"2024-09-13T18:45:26.057285+0000","last_became_peered":"2024-09-13T18:45:26.057285+0000","last_unstale":"2024-09-13T18:45:26.600944+0000","last_undegraded":"2024-09-13T18:45:26.600944+0000","last_fullsized":"2024-09-13T18:45:26.600944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600419+0000","last_change":"2024-09-13T18:45:22.031653+0000","last_active":"2024-09-13T18:45:26.600419+0000","last_peered":"2024-09-13T18:45:26.600419+0000","last_clean":"2024-09-13T18:45:26.600419+0000","last_became_active":"2024-09-13T18:45:22.031341+0000","last_became_peered":"2024-09-13T18:45:22.031341+0000","last_unstale":"2024-09-13T18:45:26.600419+0000","last_undegraded":"2024-09-13T18:45:26.600419+0000","last_fullsized":"2024-09-13T18:45:26.600419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.037413+0000","last_change":"2024-09-13T18:45:21.664695+0000","last_active":"2024-09-13T18:45:26.037413+0000","last_peered":"2024-09-13T18:45:26.037413+0000","last_clean":"2024-09-13T18:45:26.037413+0000","last_became_active":"2024-09-13T18:45:21.664401+0000","last_became_peered":"2024-09-13T18:45:21.664401+0000","last_unstale":"2024-09-13T18:45:26.037413+0000","last_undegraded":"2024-09-13T18:45:26.037413+0000","last_fullsized":"2024-09-13T18:45:26.037413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600992+0000","last_change":"2024-09-13T18:45:26.254041+0000","last_active":"2024-09-13T18:45:26.600992+0000","last_peered":"2024-09-13T18:45:26.600992+0000","last_clean":"2024-09-13T18:45:26.600992+0000","last_became_active":"2024-09-13T18:45:26.253579+0000","last_became_peered":"2024-09-13T18:45:26.253579+0000","last_unstale":"2024-09-13T18:45:26.600992+0000","last_undegraded":"2024-09-13T18:45:26.600992+0000","last_fullsized":"2024-09-13T18:45:26.600992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:19.171737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599855+0000","last_change":"2024-09-13T18:45:26.253962+0000","last_active":"2024-09-13T18:45:26.599855+0000","last_peered":"2024-09-13T18:45:26.599855+0000","last_clean":"2024-09-13T18:45:26.599855+0000","last_became_active":"2024-09-13T18:45:26.252979+0000","last_became_peered":"2024-09-13T18:45:26.252979+0000","last_unstale":"2024-09-13T18:45:26.599855+0000","last_undegraded":"2024-09-13T18:45:26.599855+0000","last_fullsized":"2024-09-13T18:45:26.599855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605312+0000","last_change":"2024-09-13T18:45:22.030919+0000","last_active":"2024-09-13T18:45:26.605312+0000","last_peered":"2024-09-13T18:45:26.605312+0000","last_clean":"2024-09-13T18:45:26.605312+0000","last_became_active":"2024-09-13T18:45:22.030453+0000","last_became_peered":"2024-09-13T18:45:22.030453+0000","last_unstale":"2024-09-13T18:45:26.605312+0000","last_undegraded":"2024-09-13T18:45:26.605312+0000","last_fullsized":"2024-09-13T18:45:26.605312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.043671+0000","last_change":"2024-09-13T18:45:21.664824+0000","last_active":"2024-09-13T18:45:26.043671+0000","last_peered":"2024-09-13T18:45:26.043671+0000","last_clean":"2024-09-13T18:45:26.043671+0000","last_became_active":"2024-09-13T18:45:21.664571+0000","last_became_peered":"2024-09-13T18:45:21.664571+0000","last_unstale":"2024-09-13T18:45:26.043671+0000","last_undegraded":"2024-09-13T18:45:26.043671+0000","last_fullsized":"2024-09-13T18:45:26.043671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410703+0000","last_change":"2024-09-13T18:45:26.054920+0000","last_active":"2024-09-13T18:45:26.410703+0000","last_peered":"2024-09-13T18:45:26.410703+0000","last_clean":"2024-09-13T18:45:26.410703+0000","last_became_active":"2024-09-13T18:45:26.054510+0000","last_became_peered":"2024-09-13T18:45:26.054510+0000","last_unstale":"2024-09-13T18:45:26.410703+0000","last_undegraded":"2024-09-13T18:45:26.410703+0000","last_fullsized":"2024-09-13T18:45:26.410703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:32.061769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600953+0000","last_change":"2024-09-13T18:45:22.028321+0000","last_active":"2024-09-13T18:45:26.600953+0000","last_peered":"2024-09-13T18:45:26.600953+0000","last_clean":"2024-09-13T18:45:26.600953+0000","last_became_active":"2024-09-13T18:45:22.028062+0000","last_became_peered":"2024-09-13T18:45:22.028062+0000","last_unstale":"2024-09-13T18:45:26.600953+0000","last_undegraded":"2024-09-13T18:45:26.600953+0000","last_fullsized":"2024-09-13T18:45:26.600953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.036033+0000","last_change":"2024-09-13T18:45:21.672763+0000","last_active":"2024-09-13T18:45:26.036033+0000","last_peered":"2024-09-13T18:45:26.036033+0000","last_clean":"2024-09-13T18:45:26.036033+0000","last_became_active":"2024-09-13T18:45:21.672470+0000","last_became_peered":"2024-09-13T18:45:21.672470+0000","last_unstale":"2024-09-13T18:45:26.036033+0000","last_undegraded":"2024-09-13T18:45:26.036033+0000","last_fullsized":"2024-09-13T18:45:26.036033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.036402+0000","last_change":"2024-09-13T18:45:21.660195+0000","last_active":"2024-09-13T18:45:26.036402+0000","last_peered":"2024-09-13T18:45:26.036402+0000","last_clean":"2024-09-13T18:45:26.036402+0000","last_became_active":"2024-09-13T18:45:21.659912+0000","last_became_peered":"2024-09-13T18:45:21.659912+0000","last_unstale":"2024-09-13T18:45:26.036402+0000","last_undegraded":"2024-09-13T18:45:26.036402+0000","last_fullsized":"2024-09-13T18:45:26.036402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599830+0000","last_change":"2024-09-13T18:45:22.024571+0000","last_active":"2024-09-13T18:45:26.599830+0000","last_peered":"2024-09-13T18:45:26.599830+0000","last_clean":"2024-09-13T18:45:26.599830+0000","last_became_active":"2024-09-13T18:45:22.024305+0000","last_became_peered":"2024-09-13T18:45:22.024305+0000","last_unstale":"2024-09-13T18:45:26.599830+0000","last_undegraded":"2024-09-13T18:45:26.599830+0000","last_fullsized":"2024-09-13T18:45:26.599830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.408537+0000","last_change":"2024-09-13T18:45:26.056207+0000","last_active":"2024-09-13T18:45:26.408537+0000","last_peered":"2024-09-13T18:45:26.408537+0000","last_clean":"2024-09-13T18:45:26.408537+0000","last_became_active":"2024-09-13T18:45:26.055794+0000","last_became_peered":"2024-09-13T18:45:26.055794+0000","last_unstale":"2024-09-13T18:45:26.408537+0000","last_undegraded":"2024-09-13T18:45:26.408537+0000","last_fullsized":"2024-09-13T18:45:26.408537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:29.520825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.035461+0000","last_change":"2024-09-13T18:45:21.670376+0000","last_active":"2024-09-13T18:45:26.035461+0000","last_peered":"2024-09-13T18:45:26.035461+0000","last_clean":"2024-09-13T18:45:26.035461+0000","last_became_active":"2024-09-13T18:45:21.670083+0000","last_became_peered":"2024-09-13T18:45:21.670083+0000","last_unstale":"2024-09-13T18:45:26.035461+0000","last_undegraded":"2024-09-13T18:45:26.035461+0000","last_fullsized":"2024-09-13T18:45:26.035461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410560+0000","last_change":"2024-09-13T18:45:22.021774+0000","last_active":"2024-09-13T18:45:26.410560+0000","last_peered":"2024-09-13T18:45:26.410560+0000","last_clean":"2024-09-13T18:45:26.410560+0000","last_became_active":"2024-09-13T18:45:22.021496+0000","last_became_peered":"2024-09-13T18:45:22.021496+0000","last_unstale":"2024-09-13T18:45:26.410560+0000","last_undegraded":"2024-09-13T18:45:26.410560+0000","last_fullsized":"2024-09-13T18:45:26.410560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:44.234639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601081+0000","last_change":"2024-09-13T18:45:26.050478+0000","last_active":"2024-09-13T18:45:26.601081+0000","last_peered":"2024-09-13T18:45:26.601081+0000","last_clean":"2024-09-13T18:45:26.601081+0000","last_became_active":"2024-09-13T18:45:26.050095+0000","last_became_peered":"2024-09-13T18:45:26.050095+0000","last_unstale":"2024-09-13T18:45:26.601081+0000","last_undegraded":"2024-09-13T18:45:26.601081+0000","last_fullsized":"2024-09-13T18:45:26.601081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:28.276515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409518+0000","last_change":"2024-09-13T18:45:22.028025+0000","last_active":"2024-09-13T18:45:26.409518+0000","last_peered":"2024-09-13T18:45:26.409518+0000","last_clean":"2024-09-13T18:45:26.409518+0000","last_became_active":"2024-09-13T18:45:22.027528+0000","last_became_peered":"2024-09-13T18:45:22.027528+0000","last_unstale":"2024-09-13T18:45:26.409518+0000","last_undegraded":"2024-09-13T18:45:26.409518+0000","last_fullsized":"2024-09-13T18:45:26.409518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.408408+0000","last_change":"2024-09-13T18:45:22.024615+0000","last_active":"2024-09-13T18:45:26.408408+0000","last_peered":"2024-09-13T18:45:26.408408+0000","last_clean":"2024-09-13T18:45:26.408408+0000","last_became_active":"2024-09-13T18:45:22.024369+0000","last_became_peered":"2024-09-13T18:45:22.024369+0000","last_unstale":"2024-09-13T18:45:26.408408+0000","last_undegraded":"2024-09-13T18:45:26.408408+0000","last_fullsized":"2024-09-13T18:45:26.408408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600313+0000","last_change":"2024-09-13T18:45:22.035861+0000","last_active":"2024-09-13T18:45:26.600313+0000","last_peered":"2024-09-13T18:45:26.600313+0000","last_clean":"2024-09-13T18:45:26.600313+0000","last_became_active":"2024-09-13T18:45:22.034318+0000","last_became_peered":"2024-09-13T18:45:22.034318+0000","last_unstale":"2024-09-13T18:45:26.600313+0000","last_undegraded":"2024-09-13T18:45:26.600313+0000","last_fullsized":"2024-09-13T18:45:26.600313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599822+0000","last_change":"2024-09-13T18:45:22.033266+0000","last_active":"2024-09-13T18:45:26.599822+0000","last_peered":"2024-09-13T18:45:26.599822+0000","last_clean":"2024-09-13T18:45:26.599822+0000","last_became_active":"2024-09-13T18:45:22.032851+0000","last_became_peered":"2024-09-13T18:45:22.032851+0000","last_unstale":"2024-09-13T18:45:26.599822+0000","last_undegraded":"2024-09-13T18:45:26.599822+0000","last_fullsized":"2024-09-13T18:45:26.599822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601071+0000","last_change":"2024-09-13T18:45:22.033500+0000","last_active":"2024-09-13T18:45:26.601071+0000","last_peered":"2024-09-13T18:45:26.601071+0000","last_clean":"2024-09-13T18:45:26.601071+0000","last_became_active":"2024-09-13T18:45:22.033156+0000","last_became_peered":"2024-09-13T18:45:22.033156+0000","last_unstale":"2024-09-13T18:45:26.601071+0000","last_undegraded":"2024-09-13T18:45:26.601071+0000","last_fullsized":"2024-09-13T18:45:26.601071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605389+0000","last_change":"2024-09-13T18:45:22.029906+0000","last_active":"2024-09-13T18:45:26.605389+0000","last_peered":"2024-09-13T18:45:26.605389+0000","last_clean":"2024-09-13T18:45:26.605389+0000","last_became_active":"2024-09-13T18:45:22.029654+0000","last_became_peered":"2024-09-13T18:45:22.029654+0000","last_unstale":"2024-09-13T18:45:26.605389+0000","last_undegraded":"2024-09-13T18:45:26.605389+0000","last_fullsized":"2024-09-13T18:45:26.605389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410838+0000","last_change":"2024-09-13T18:45:22.028396+0000","last_active":"2024-09-13T18:45:26.410838+0000","last_peered":"2024-09-13T18:45:26.410838+0000","last_clean":"2024-09-13T18:45:26.410838+0000","last_became_active":"2024-09-13T18:45:22.028031+0000","last_became_peered":"2024-09-13T18:45:22.028031+0000","last_unstale":"2024-09-13T18:45:26.410838+0000","last_undegraded":"2024-09-13T18:45:26.410838+0000","last_fullsized":"2024-09-13T18:45:26.410838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601118+0000","last_change":"2024-09-13T18:45:22.032816+0000","last_active":"2024-09-13T18:45:26.601118+0000","last_peered":"2024-09-13T18:45:26.601118+0000","last_clean":"2024-09-13T18:45:26.601118+0000","last_became_active":"2024-09-13T18:45:22.032561+0000","last_became_peered":"2024-09-13T18:45:22.032561+0000","last_unstale":"2024-09-13T18:45:26.601118+0000","last_undegraded":"2024-09-13T18:45:26.601118+0000","last_fullsized":"2024-09-13T18:45:26.601118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600256+0000","last_change":"2024-09-13T18:45:22.036615+0000","last_active":"2024-09-13T18:45:26.600256+0000","last_peered":"2024-09-13T18:45:26.600256+0000","last_clean":"2024-09-13T18:45:26.600256+0000","last_became_active":"2024-09-13T18:45:22.036380+0000","last_became_peered":"2024-09-13T18:45:22.036380+0000","last_unstale":"2024-09-13T18:45:26.600256+0000","last_undegraded":"2024-09-13T18:45:26.600256+0000","last_fullsized":"2024-09-13T18:45:26.600256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601002+0000","last_change":"2024-09-13T18:45:22.035082+0000","last_active":"2024-09-13T18:45:26.601002+0000","last_peered":"2024-09-13T18:45:26.601002+0000","last_clean":"2024-09-13T18:45:26.601002+0000","last_became_active":"2024-09-13T18:45:22.034646+0000","last_became_peered":"2024-09-13T18:45:22.034646+0000","last_unstale":"2024-09-13T18:45:26.601002+0000","last_undegraded":"2024-09-13T18:45:26.601002+0000","last_fullsized":"2024-09-13T18:45:26.601002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600302+0000","last_change":"2024-09-13T18:45:22.029195+0000","last_active":"2024-09-13T18:45:26.600302+0000","last_peered":"2024-09-13T18:45:26.600302+0000","last_clean":"2024-09-13T18:45:26.600302+0000","last_became_active":"2024-09-13T18:45:22.028430+0000","last_became_peered":"2024-09-13T18:45:22.028430+0000","last_unstale":"2024-09-13T18:45:26.600302+0000","last_undegraded":"2024-09-13T18:45:26.600302+0000","last_fullsized":"2024-09-13T18:45:26.600302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599802+0000","last_change":"2024-09-13T18:45:22.019974+0000","last_active":"2024-09-13T18:45:26.599802+0000","last_peered":"2024-09-13T18:45:26.599802+0000","last_clean":"2024-09-13T18:45:26.599802+0000","last_became_active":"2024-09-13T18:45:22.019733+0000","last_became_peered":"2024-09-13T18:45:22.019733+0000","last_unstale":"2024-09-13T18:45:26.599802+0000","last_undegraded":"2024-09-13T18:45:26.599802+0000","last_fullsized":"2024-09-13T18:45:26.599802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410236+0000","last_change":"2024-09-13T18:45:22.016110+0000","last_active":"2024-09-13T18:45:26.410236+0000","last_peered":"2024-09-13T18:45:26.410236+0000","last_clean":"2024-09-13T18:45:26.410236+0000","last_became_active":"2024-09-13T18:45:22.015868+0000","last_became_peered":"2024-09-13T18:45:22.015868+0000","last_unstale":"2024-09-13T18:45:26.410236+0000","last_undegraded":"2024-09-13T18:45:26.410236+0000","last_fullsized":"2024-09-13T18:45:26.410236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599998+0000","last_change":"2024-09-13T18:45:22.034477+0000","last_active":"2024-09-13T18:45:26.599998+0000","last_peered":"2024-09-13T18:45:26.599998+0000","last_clean":"2024-09-13T18:45:26.599998+0000","last_became_active":"2024-09-13T18:45:22.034019+0000","last_became_peered":"2024-09-13T18:45:22.034019+0000","last_unstale":"2024-09-13T18:45:26.599998+0000","last_undegraded":"2024-09-13T18:45:26.599998+0000","last_fullsized":"2024-09-13T18:45:26.599998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.408670+0000","last_change":"2024-09-13T18:45:22.021787+0000","last_active":"2024-09-13T18:45:26.408670+0000","last_peered":"2024-09-13T18:45:26.408670+0000","last_clean":"2024-09-13T18:45:26.408670+0000","last_became_active":"2024-09-13T18:45:22.020415+0000","last_became_peered":"2024-09-13T18:45:22.020415+0000","last_unstale":"2024-09-13T18:45:26.408670+0000","last_undegraded":"2024-09-13T18:45:26.408670+0000","last_fullsized":"2024-09-13T18:45:26.408670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600442+0000","last_change":"2024-09-13T18:45:22.035941+0000","last_active":"2024-09-13T18:45:26.600442+0000","last_peered":"2024-09-13T18:45:26.600442+0000","last_clean":"2024-09-13T18:45:26.600442+0000","last_became_active":"2024-09-13T18:45:22.035491+0000","last_became_peered":"2024-09-13T18:45:22.035491+0000","last_unstale":"2024-09-13T18:45:26.600442+0000","last_undegraded":"2024-09-13T18:45:26.600442+0000","last_fullsized":"2024-09-13T18:45:26.600442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600236+0000","last_change":"2024-09-13T18:45:22.027416+0000","last_active":"2024-09-13T18:45:26.600236+0000","last_peered":"2024-09-13T18:45:26.600236+0000","last_clean":"2024-09-13T18:45:26.600236+0000","last_became_active":"2024-09-13T18:45:22.027170+0000","last_became_peered":"2024-09-13T18:45:22.027170+0000","last_unstale":"2024-09-13T18:45:26.600236+0000","last_undegraded":"2024-09-13T18:45:26.600236+0000","last_fullsized":"2024-09-13T18:45:26.600236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605321+0000","last_change":"2024-09-13T18:45:22.021298+0000","last_active":"2024-09-13T18:45:26.605321+0000","last_peered":"2024-09-13T18:45:26.605321+0000","last_clean":"2024-09-13T18:45:26.605321+0000","last_became_active":"2024-09-13T18:45:22.021042+0000","last_became_peered":"2024-09-13T18:45:22.021042+0000","last_unstale":"2024-09-13T18:45:26.605321+0000","last_undegraded":"2024-09-13T18:45:26.605321+0000","last_fullsized":"2024-09-13T18:45:26.605321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599771+0000","last_change":"2024-09-13T18:45:22.021628+0000","last_active":"2024-09-13T18:45:26.599771+0000","last_peered":"2024-09-13T18:45:26.599771+0000","last_clean":"2024-09-13T18:45:26.599771+0000","last_became_active":"2024-09-13T18:45:22.021366+0000","last_became_peered":"2024-09-13T18:45:22.021366+0000","last_unstale":"2024-09-13T18:45:26.599771+0000","last_undegraded":"2024-09-13T18:45:26.599771+0000","last_fullsized":"2024-09-13T18:45:26.599771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601029+0000","last_change":"2024-09-13T18:45:22.029051+0000","last_active":"2024-09-13T18:45:26.601029+0000","last_peered":"2024-09-13T18:45:26.601029+0000","last_clean":"2024-09-13T18:45:26.601029+0000","last_became_active":"2024-09-13T18:45:22.028594+0000","last_became_peered":"2024-09-13T18:45:22.028594+0000","last_unstale":"2024-09-13T18:45:26.601029+0000","last_undegraded":"2024-09-13T18:45:26.601029+0000","last_fullsized":"2024-09-13T18:45:26.601029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410403+0000","last_change":"2024-09-13T18:45:22.016996+0000","last_active":"2024-09-13T18:45:26.410403+0000","last_peered":"2024-09-13T18:45:26.410403+0000","last_clean":"2024-09-13T18:45:26.410403+0000","last_became_active":"2024-09-13T18:45:22.016731+0000","last_became_peered":"2024-09-13T18:45:22.016731+0000","last_unstale":"2024-09-13T18:45:26.410403+0000","last_undegraded":"2024-09-13T18:45:26.410403+0000","last_fullsized":"2024-09-13T18:45:26.410403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410341+0000","last_change":"2024-09-13T18:45:22.028649+0000","last_active":"2024-09-13T18:45:26.410341+0000","last_peered":"2024-09-13T18:45:26.410341+0000","last_clean":"2024-09-13T18:45:26.410341+0000","last_became_active":"2024-09-13T18:45:22.027899+0000","last_became_peered":"2024-09-13T18:45:22.027899+0000","last_unstale":"2024-09-13T18:45:26.410341+0000","last_undegraded":"2024-09-13T18:45:26.410341+0000","last_fullsized":"2024-09-13T18:45:26.410341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410750+0000","last_change":"2024-09-13T18:45:22.024291+0000","last_active":"2024-09-13T18:45:26.410750+0000","last_peered":"2024-09-13T18:45:26.410750+0000","last_clean":"2024-09-13T18:45:26.410750+0000","last_became_active":"2024-09-13T18:45:22.024014+0000","last_became_peered":"2024-09-13T18:45:22.024014+0000","last_unstale":"2024-09-13T18:45:26.410750+0000","last_undegraded":"2024-09-13T18:45:26.410750+0000","last_fullsized":"2024-09-13T18:45:26.410750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600045+0000","last_change":"2024-09-13T18:45:22.036551+0000","last_active":"2024-09-13T18:45:26.600045+0000","last_peered":"2024-09-13T18:45:26.600045+0000","last_clean":"2024-09-13T18:45:26.600045+0000","last_became_active":"2024-09-13T18:45:22.036269+0000","last_became_peered":"2024-09-13T18:45:22.036269+0000","last_unstale":"2024-09-13T18:45:26.600045+0000","last_undegraded":"2024-09-13T18:45:26.600045+0000","last_fullsized":"2024-09-13T18:45:26.600045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600933+0000","last_change":"2024-09-13T18:45:22.032392+0000","last_active":"2024-09-13T18:45:26.600933+0000","last_peered":"2024-09-13T18:45:26.600933+0000","last_clean":"2024-09-13T18:45:26.600933+0000","last_became_active":"2024-09-13T18:45:22.027605+0000","last_became_peered":"2024-09-13T18:45:22.027605+0000","last_unstale":"2024-09-13T18:45:26.600933+0000","last_undegraded":"2024-09-13T18:45:26.600933+0000","last_fullsized":"2024-09-13T18:45:26.600933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599883+0000","last_change":"2024-09-13T18:45:22.029307+0000","last_active":"2024-09-13T18:45:26.599883+0000","last_peered":"2024-09-13T18:45:26.599883+0000","last_clean":"2024-09-13T18:45:26.599883+0000","last_became_active":"2024-09-13T18:45:22.029018+0000","last_became_peered":"2024-09-13T18:45:22.029018+0000","last_unstale":"2024-09-13T18:45:26.599883+0000","last_undegraded":"2024-09-13T18:45:26.599883+0000","last_fullsized":"2024-09-13T18:45:26.599883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600287+0000","last_change":"2024-09-13T18:45:22.029061+0000","last_active":"2024-09-13T18:45:26.600287+0000","last_peered":"2024-09-13T18:45:26.600287+0000","last_clean":"2024-09-13T18:45:26.600287+0000","last_became_active":"2024-09-13T18:45:22.028758+0000","last_became_peered":"2024-09-13T18:45:22.028758+0000","last_unstale":"2024-09-13T18:45:26.600287+0000","last_undegraded":"2024-09-13T18:45:26.600287+0000","last_fullsized":"2024-09-13T18:45:26.600287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599926+0000","last_change":"2024-09-13T18:45:22.029690+0000","last_active":"2024-09-13T18:45:26.599926+0000","last_peered":"2024-09-13T18:45:26.599926+0000","last_clean":"2024-09-13T18:45:26.599926+0000","last_became_active":"2024-09-13T18:45:22.029403+0000","last_became_peered":"2024-09-13T18:45:22.029403+0000","last_unstale":"2024-09-13T18:45:26.599926+0000","last_undegraded":"2024-09-13T18:45:26.599926+0000","last_fullsized":"2024-09-13T18:45:26.599926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600349+0000","last_change":"2024-09-13T18:45:22.038483+0000","last_active":"2024-09-13T18:45:26.600349+0000","last_peered":"2024-09-13T18:45:26.600349+0000","last_clean":"2024-09-13T18:45:26.600349+0000","last_became_active":"2024-09-13T18:45:22.036877+0000","last_became_peered":"2024-09-13T18:45:22.036877+0000","last_unstale":"2024-09-13T18:45:26.600349+0000","last_undegraded":"2024-09-13T18:45:26.600349+0000","last_fullsized":"2024-09-13T18:45:26.600349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599845+0000","last_change":"2024-09-13T18:45:22.022846+0000","last_active":"2024-09-13T18:45:26.599845+0000","last_peered":"2024-09-13T18:45:26.599845+0000","last_clean":"2024-09-13T18:45:26.599845+0000","last_became_active":"2024-09-13T18:45:22.022618+0000","last_became_peered":"2024-09-13T18:45:22.022618+0000","last_unstale":"2024-09-13T18:45:26.599845+0000","last_undegraded":"2024-09-13T18:45:26.599845+0000","last_fullsized":"2024-09-13T18:45:26.599845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605420+0000","last_change":"2024-09-13T18:45:22.028545+0000","last_active":"2024-09-13T18:45:26.605420+0000","last_peered":"2024-09-13T18:45:26.605420+0000","last_clean":"2024-09-13T18:45:26.605420+0000","last_became_active":"2024-09-13T18:45:22.028291+0000","last_became_peered":"2024-09-13T18:45:22.028291+0000","last_unstale":"2024-09-13T18:45:26.605420+0000","last_undegraded":"2024-09-13T18:45:26.605420+0000","last_fullsized":"2024-09-13T18:45:26.605420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600036+0000","last_change":"2024-09-13T18:45:22.034460+0000","last_active":"2024-09-13T18:45:26.600036+0000","last_peered":"2024-09-13T18:45:26.600036+0000","last_clean":"2024-09-13T18:45:26.600036+0000","last_became_active":"2024-09-13T18:45:22.033974+0000","last_became_peered":"2024-09-13T18:45:22.033974+0000","last_unstale":"2024-09-13T18:45:26.600036+0000","last_undegraded":"2024-09-13T18:45:26.600036+0000","last_fullsized":"2024-09-13T18:45:26.600036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":690344,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":266240,"data_stored":103189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":253952,"data_stored":99394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":262144,"data_stored":99554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":331776,"data_stored":690400,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:45:44.391 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:45:44.391 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:45:44.391 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:45:44.392 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T18:45:44.392 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T18:45:44.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.523+0000 7ff430c72640 1 Processor -- start 2024-09-13T18:45:44.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.523+0000 7ff430c72640 1 -- start start 2024-09-13T18:45:44.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.524+0000 7ff430c72640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff42c0b35b0 0x7ff42c1498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.524+0000 7ff430c72640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c149410 con 0x7ff42c13f8e0 2024-09-13T18:45:44.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.524+0000 7ff430c72640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c0b4810 con 0x7ff42c0b31d0 2024-09-13T18:45:44.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.524+0000 7ff430c72640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c1490a0 con 0x7ff42c0b35b0 2024-09-13T18:45:44.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.524+0000 7ff429d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff42c0b35b0 0x7ff42c1498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.524+0000 7ff42ad9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff42c13f8e0 0x7ff42c13fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54330/0 (socket says 172.21.15.29:54330) 2024-09-13T18:45:44.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.524+0000 7ff429d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff42c0b35b0 0x7ff42c1498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40570/0 (socket says 172.21.15.29:40570) 2024-09-13T18:45:44.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.524+0000 7ff42ad9d640 1 -- 172.21.15.29:0/500456430 learned_addr learned my addr 172.21.15.29:0/500456430 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:44.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.525+0000 7ff429d9b640 1 -- 172.21.15.29:0/500456430 >> v1:172.21.15.96:6789/0 conn(0x7ff42c0b31d0 legacy=0x7ff42c0b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:44.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.525+0000 7ff429d9b640 1 -- 172.21.15.29:0/500456430 >> v1:172.21.15.29:6789/0 conn(0x7ff42c13f8e0 legacy=0x7ff42c13fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.525+0000 7ff429d9b640 1 -- 172.21.15.29:0/500456430 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c0b5760 con 0x7ff42c0b35b0 2024-09-13T18:45:44.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.525+0000 7ff429d9b640 1 --2- 172.21.15.29:0/500456430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c0b35b0 0x7ff42c1498a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff4200097a0 tx=0x7ff42002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b534a34950c896cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.526+0000 7ff42959a640 1 -- 172.21.15.29:0/500456430 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42002ae50 con 0x7ff42c0b35b0 2024-09-13T18:45:44.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.526+0000 7ff42959a640 1 -- 172.21.15.29:0/500456430 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff420032440 con 0x7ff42c0b35b0 2024-09-13T18:45:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.526+0000 7ff42959a640 1 -- 172.21.15.29:0/500456430 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4200327d0 con 0x7ff42c0b35b0 2024-09-13T18:45:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.526+0000 7ff430c72640 1 -- 172.21.15.29:0/500456430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c0b35b0 msgr2=0x7ff42c1498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.526+0000 7ff430c72640 1 --2- 172.21.15.29:0/500456430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c0b35b0 0x7ff42c1498a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff4200097a0 tx=0x7ff42002a140 comp rx=0 tx=0).stop 2024-09-13T18:45:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.526+0000 7ff430c72640 1 -- 172.21.15.29:0/500456430 shutdown_connections 2024-09-13T18:45:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.526+0000 7ff430c72640 1 --2- 172.21.15.29:0/500456430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c0b35b0 0x7ff42c1498a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.526+0000 7ff430c72640 1 -- 172.21.15.29:0/500456430 >> 172.21.15.29:0/500456430 conn(0x7ff42c0bb590 msgr2=0x7ff42c0bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.526+0000 7ff430c72640 1 -- 172.21.15.29:0/500456430 shutdown_connections 2024-09-13T18:45:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.526+0000 7ff430c72640 1 -- 172.21.15.29:0/500456430 wait complete. 2024-09-13T18:45:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.527+0000 7ff430c72640 1 Processor -- start 2024-09-13T18:45:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff430c72640 1 -- start start 2024-09-13T18:45:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff430c72640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c0b31d0 0x7ff42c145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff430c72640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff42c0b35b0 0x7ff42c13e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff430c72640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff42c13f8e0 0x7ff42c136b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff430c72640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c13dd60 con 0x7ff42c0b31d0 2024-09-13T18:45:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff430c72640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c140d60 con 0x7ff42c13f8e0 2024-09-13T18:45:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff430c72640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c13b920 con 0x7ff42c0b35b0 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff42a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c0b31d0 0x7ff42c145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff42a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c0b31d0 0x7ff42c145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40574/0 (socket says 172.21.15.29:40574) 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff42a59c640 1 -- 172.21.15.29:0/3175425820 learned_addr learned my addr 172.21.15.29:0/3175425820 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff429d9b640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff42c0b35b0 0x7ff42c13e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff42ad9d640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff42c13f8e0 0x7ff42c136b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff42a59c640 1 -- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff42c0b35b0 msgr2=0x7ff42c13e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff42a59c640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff42c0b35b0 0x7ff42c13e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff42a59c640 1 -- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff42c13f8e0 msgr2=0x7ff42c136b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff42a59c640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff42c13f8e0 0x7ff42c136b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.528+0000 7ff42a59c640 1 -- 172.21.15.29:0/3175425820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420009400 con 0x7ff42c0b31d0 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.529+0000 7ff42a59c640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c0b31d0 0x7ff42c145ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff41c00b420 tx=0x7ff41c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.529+0000 7ff41affd640 1 -- 172.21.15.29:0/3175425820 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c011830 con 0x7ff42c0b31d0 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.529+0000 7ff41affd640 1 -- 172.21.15.29:0/3175425820 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c011990 con 0x7ff42c0b31d0 2024-09-13T18:45:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.529+0000 7ff41affd640 1 -- 172.21.15.29:0/3175425820 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c011d40 con 0x7ff42c0b31d0 2024-09-13T18:45:44.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.529+0000 7ff430c72640 1 -- 172.21.15.29:0/3175425820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c13d7a0 con 0x7ff42c0b31d0 2024-09-13T18:45:44.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.529+0000 7ff430c72640 1 -- 172.21.15.29:0/3175425820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c1416e0 con 0x7ff42c0b31d0 2024-09-13T18:45:44.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.530+0000 7ff430c72640 1 -- 172.21.15.29:0/3175425820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c067300 con 0x7ff42c0b31d0 2024-09-13T18:45:44.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.530+0000 7ff41affd640 1 -- 172.21.15.29:0/3175425820 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff41c01b460 con 0x7ff42c0b31d0 2024-09-13T18:45:44.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.531+0000 7ff41affd640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff40c06ac00 0x7ff40c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.531+0000 7ff41affd640 1 -- 172.21.15.29:0/3175425820 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff41c089170 con 0x7ff42c0b31d0 2024-09-13T18:45:44.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.531+0000 7ff429d9b640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff40c06ac00 0x7ff40c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.531+0000 7ff429d9b640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff40c06ac00 0x7ff40c06d0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff420034000 tx=0x7ff42002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.535+0000 7ff41affd640 1 -- 172.21.15.29:0/3175425820 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff41c0540f0 con 0x7ff42c0b31d0 2024-09-13T18:45:44.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.750+0000 7ff430c72640 1 -- 172.21.15.29:0/3175425820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff42c13d5d0 con 0x7ff42c0b31d0 2024-09-13T18:45:44.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.753+0000 7ff41affd640 1 -- 172.21.15.29:0/3175425820 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170952 (secure 0 0 0) 0x7ff41c057710 con 0x7ff42c0b31d0 2024-09-13T18:45:44.758 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.756+0000 7ff430c72640 1 -- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff40c06ac00 msgr2=0x7ff40c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.756+0000 7ff430c72640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff40c06ac00 0x7ff40c06d0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff420034000 tx=0x7ff42002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.756+0000 7ff430c72640 1 -- 172.21.15.29:0/3175425820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c0b31d0 msgr2=0x7ff42c145ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.756+0000 7ff430c72640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c0b31d0 0x7ff42c145ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff41c00b420 tx=0x7ff41c00b8e0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.756+0000 7ff430c72640 1 -- 172.21.15.29:0/3175425820 shutdown_connections 2024-09-13T18:45:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.756+0000 7ff430c72640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff40c06ac00 0x7ff40c06d0c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.756+0000 7ff430c72640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff42c13f8e0 0x7ff42c136b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.756+0000 7ff430c72640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff42c0b35b0 0x7ff42c13e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.756+0000 7ff430c72640 1 --2- 172.21.15.29:0/3175425820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c0b31d0 0x7ff42c145ec0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.756+0000 7ff430c72640 1 -- 172.21.15.29:0/3175425820 >> 172.21.15.29:0/3175425820 conn(0x7ff42c0bb590 msgr2=0x7ff42c0b9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:44.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.756+0000 7ff430c72640 1 -- 172.21.15.29:0/3175425820 shutdown_connections 2024-09-13T18:45:44.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.756+0000 7ff430c72640 1 -- 172.21.15.29:0/3175425820 wait complete. 2024-09-13T18:45:44.770 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4217971068},{"type":"v1","addr":"172.21.15.96:6833","nonce":4217971068}]},"active_addr":"172.21.15.96:6833/4217971068","active_change":"2024-09-13T18:45:09.576998+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3690234225}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2894440065}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3996068218}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3397274702}]}]} 2024-09-13T18:45:44.773 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T18:45:44.773 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T18:45:44.773 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:44.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.872+0000 7fa93b09c640 1 Processor -- start 2024-09-13T18:45:44.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.872+0000 7fa93b09c640 1 -- start start 2024-09-13T18:45:44.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.873+0000 7fa93b09c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa93406b150 0x7fa9340712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.873+0000 7fa93b09c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa934070b30 con 0x7fa9340717e0 2024-09-13T18:45:44.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.873+0000 7fa93b09c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9340b4160 con 0x7fa93413fe10 2024-09-13T18:45:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.873+0000 7fa93b09c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93406b5c0 con 0x7fa93406b150 2024-09-13T18:45:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.873+0000 7fa933fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa9340717e0 0x7fa93413f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54340/0 (socket says 172.21.15.29:54340) 2024-09-13T18:45:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.873+0000 7fa933fff640 1 -- 172.21.15.29:0/3175786317 learned_addr learned my addr 172.21.15.29:0/3175786317 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.873+0000 7fa938e38640 1 --2- 172.21.15.29:0/3175786317 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa93406b150 0x7fa9340712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.873+0000 7fa9337fe640 1 -- 172.21.15.29:0/3175786317 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985314687 0 0) 0x7fa934070b30 con 0x7fa9340717e0 2024-09-13T18:45:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.873+0000 7fa9337fe640 1 -- 172.21.15.29:0/3175786317 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa91c003520 con 0x7fa9340717e0 2024-09-13T18:45:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.873+0000 7fa9337fe640 1 -- 172.21.15.29:0/3175786317 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042220562 0 0) 0x7fa9340b4160 con 0x7fa93413fe10 2024-09-13T18:45:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.873+0000 7fa9337fe640 1 -- 172.21.15.29:0/3175786317 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa934070b30 con 0x7fa93413fe10 2024-09-13T18:45:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.874+0000 7fa938e38640 1 -- 172.21.15.29:0/3175786317 >> v1:172.21.15.96:6789/0 conn(0x7fa93413fe10 legacy=0x7fa934150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.874+0000 7fa938e38640 1 -- 172.21.15.29:0/3175786317 >> v1:172.21.15.29:6789/0 conn(0x7fa9340717e0 legacy=0x7fa93413f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.874+0000 7fa938e38640 1 -- 172.21.15.29:0/3175786317 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93406f780 con 0x7fa93406b150 2024-09-13T18:45:44.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.874+0000 7fa938e38640 1 --2- 172.21.15.29:0/3175786317 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa93406b150 0x7fa9340712a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9240097d0 tx=0x7fa92402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c1bd2c7dce9b17c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.875+0000 7fa9337fe640 1 -- 172.21.15.29:0/3175786317 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92402ae50 con 0x7fa93406b150 2024-09-13T18:45:44.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.875+0000 7fa9337fe640 1 -- 172.21.15.29:0/3175786317 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa924032440 con 0x7fa93406b150 2024-09-13T18:45:44.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.875+0000 7fa9337fe640 1 -- 172.21.15.29:0/3175786317 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9240327b0 con 0x7fa93406b150 2024-09-13T18:45:44.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.875+0000 7fa93b09c640 1 -- 172.21.15.29:0/3175786317 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa93406b150 msgr2=0x7fa9340712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.875+0000 7fa93b09c640 1 --2- 172.21.15.29:0/3175786317 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa93406b150 0x7fa9340712a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9240097d0 tx=0x7fa92402a100 comp rx=0 tx=0).stop 2024-09-13T18:45:44.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.875+0000 7fa93b09c640 1 -- 172.21.15.29:0/3175786317 shutdown_connections 2024-09-13T18:45:44.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.875+0000 7fa93b09c640 1 --2- 172.21.15.29:0/3175786317 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa93406b150 0x7fa9340712a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.875+0000 7fa93b09c640 1 -- 172.21.15.29:0/3175786317 >> 172.21.15.29:0/3175786317 conn(0x7fa9340b4780 msgr2=0x7fa9340b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:44.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.875+0000 7fa93b09c640 1 -- 172.21.15.29:0/3175786317 shutdown_connections 2024-09-13T18:45:44.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.875+0000 7fa93b09c640 1 -- 172.21.15.29:0/3175786317 wait complete. 2024-09-13T18:45:44.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.876+0000 7fa93b09c640 1 Processor -- start 2024-09-13T18:45:44.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.876+0000 7fa93b09c640 1 -- start start 2024-09-13T18:45:44.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.877+0000 7fa93b09c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa93406b150 0x7fa9340b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.877+0000 7fa93b09c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9340717e0 0x7fa9341db600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.877+0000 7fa93b09c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa93413fe10 0x7fa9341dbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.877+0000 7fa93b09c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9341428b0 con 0x7fa93406b150 2024-09-13T18:45:44.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.877+0000 7fa93b09c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9340b0de0 con 0x7fa9340717e0 2024-09-13T18:45:44.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.877+0000 7fa93b09c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa934143110 con 0x7fa93413fe10 2024-09-13T18:45:44.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.877+0000 7fa938e38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa93406b150 0x7fa9340b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.877+0000 7fa938e38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa93406b150 0x7fa9340b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40586/0 (socket says 172.21.15.29:40586) 2024-09-13T18:45:44.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.877+0000 7fa938e38640 1 -- 172.21.15.29:0/1553295772 learned_addr learned my addr 172.21.15.29:0/1553295772 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:44.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.877+0000 7fa933fff640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9340717e0 0x7fa9341db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.877+0000 7fa939639640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa93413fe10 0x7fa9341dbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.878+0000 7fa938e38640 1 -- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa93413fe10 msgr2=0x7fa9341dbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.878+0000 7fa938e38640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa93413fe10 0x7fa9341dbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.878+0000 7fa938e38640 1 -- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9340717e0 msgr2=0x7fa9341db600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.878+0000 7fa938e38640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9340717e0 0x7fa9341db600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.878+0000 7fa938e38640 1 -- 172.21.15.29:0/1553295772 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa924009400 con 0x7fa93406b150 2024-09-13T18:45:44.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.878+0000 7fa938e38640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa93406b150 0x7fa9340b1aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa92402a140 tx=0x7fa9240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.878+0000 7fa9317fa640 1 -- 172.21.15.29:0/1553295772 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92403c810 con 0x7fa93406b150 2024-09-13T18:45:44.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.878+0000 7fa9317fa640 1 -- 172.21.15.29:0/1553295772 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92403c970 con 0x7fa93406b150 2024-09-13T18:45:44.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.878+0000 7fa93b09c640 1 -- 172.21.15.29:0/1553295772 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa93406fe20 con 0x7fa93406b150 2024-09-13T18:45:44.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.878+0000 7fa9317fa640 1 -- 172.21.15.29:0/1553295772 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92403cce0 con 0x7fa93406b150 2024-09-13T18:45:44.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.878+0000 7fa93b09c640 1 -- 172.21.15.29:0/1553295772 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa934142ac0 con 0x7fa93406b150 2024-09-13T18:45:44.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.879+0000 7fa93b09c640 1 -- 172.21.15.29:0/1553295772 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa934067300 con 0x7fa93406b150 2024-09-13T18:45:44.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.880+0000 7fa9317fa640 1 -- 172.21.15.29:0/1553295772 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa92403b3a0 con 0x7fa93406b150 2024-09-13T18:45:44.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.880+0000 7fa9317fa640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa92006ac30 0x7fa92006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.880+0000 7fa9317fa640 1 -- 172.21.15.29:0/1553295772 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa9240a9d40 con 0x7fa93406b150 2024-09-13T18:45:44.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.880+0000 7fa933fff640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa92006ac30 0x7fa92006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.881+0000 7fa933fff640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa92006ac30 0x7fa92006d0f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa9341393d0 tx=0x7fa928001ad0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:44.884+0000 7fa9317fa640 1 -- 172.21.15.29:0/1553295772 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa924074d70 con 0x7fa93406b150 2024-09-13T18:45:45.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.057+0000 7fa93b09c640 1 -- 172.21.15.29:0/1553295772 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9340b4500 con 0x7fa93406b150 2024-09-13T18:45:45.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.058+0000 7fa9317fa640 1 -- 172.21.15.29:0/1553295772 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7fa924078390 con 0x7fa93406b150 2024-09-13T18:45:45.061 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:45.061 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:45.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.060+0000 7fa93b09c640 1 -- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa92006ac30 msgr2=0x7fa92006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.060+0000 7fa93b09c640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa92006ac30 0x7fa92006d0f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa9341393d0 tx=0x7fa928001ad0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.060+0000 7fa93b09c640 1 -- 172.21.15.29:0/1553295772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa93406b150 msgr2=0x7fa9340b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.060+0000 7fa93b09c640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa93406b150 0x7fa9340b1aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa92402a140 tx=0x7fa9240046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.060+0000 7fa93b09c640 1 -- 172.21.15.29:0/1553295772 shutdown_connections 2024-09-13T18:45:45.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.060+0000 7fa93b09c640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa92006ac30 0x7fa92006d0f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.060+0000 7fa93b09c640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa93413fe10 0x7fa9341dbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.060+0000 7fa93b09c640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9340717e0 0x7fa9341db600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.060+0000 7fa93b09c640 1 --2- 172.21.15.29:0/1553295772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa93406b150 0x7fa9340b1aa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.060+0000 7fa93b09c640 1 -- 172.21.15.29:0/1553295772 >> 172.21.15.29:0/1553295772 conn(0x7fa9340b4780 msgr2=0x7fa93406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.060+0000 7fa93b09c640 1 -- 172.21.15.29:0/1553295772 shutdown_connections 2024-09-13T18:45:45.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.060+0000 7fa93b09c640 1 -- 172.21.15.29:0/1553295772 wait complete. 2024-09-13T18:45:45.074 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T18:45:45.074 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:45.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.174+0000 7fb37eea3640 1 Processor -- start 2024-09-13T18:45:45.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.174+0000 7fb37eea3640 1 -- start start 2024-09-13T18:45:45.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.174+0000 7fb37eea3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb3780aeb00 0x7fb37813f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.174+0000 7fb37eea3640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb378140050 con 0x7fb37813fc40 2024-09-13T18:45:45.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.174+0000 7fb37eea3640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37806b530 con 0x7fb37806b150 2024-09-13T18:45:45.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.174+0000 7fb37eea3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb378070b30 con 0x7fb3780aeb00 2024-09-13T18:45:45.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.175+0000 7fb37d440640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb37813fc40 0x7fb378150270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54354/0 (socket says 172.21.15.29:54354) 2024-09-13T18:45:45.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.175+0000 7fb37d440640 1 -- 172.21.15.29:0/2827737706 learned_addr learned my addr 172.21.15.29:0/2827737706 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:45.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.175+0000 7fb377fff640 1 --2- 172.21.15.29:0/2827737706 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb3780aeb00 0x7fb37813f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.175+0000 7fb3777fe640 1 -- 172.21.15.29:0/2827737706 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062869812 0 0) 0x7fb378140050 con 0x7fb37813fc40 2024-09-13T18:45:45.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.175+0000 7fb3777fe640 1 -- 172.21.15.29:0/2827737706 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb364003520 con 0x7fb37813fc40 2024-09-13T18:45:45.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.175+0000 7fb3777fe640 1 -- 172.21.15.29:0/2827737706 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544313395 0 0) 0x7fb37806b530 con 0x7fb37806b150 2024-09-13T18:45:45.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.175+0000 7fb3777fe640 1 -- 172.21.15.29:0/2827737706 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb378140050 con 0x7fb37806b150 2024-09-13T18:45:45.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.175+0000 7fb377fff640 1 -- 172.21.15.29:0/2827737706 >> v1:172.21.15.96:6789/0 conn(0x7fb37806b150 legacy=0x7fb3780712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.175+0000 7fb377fff640 1 -- 172.21.15.29:0/2827737706 >> v1:172.21.15.29:6789/0 conn(0x7fb37813fc40 legacy=0x7fb378150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.175+0000 7fb377fff640 1 -- 172.21.15.29:0/2827737706 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3780b4160 con 0x7fb3780aeb00 2024-09-13T18:45:45.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.176+0000 7fb377fff640 1 --2- 172.21.15.29:0/2827737706 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb3780aeb00 0x7fb37813f700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb3600097d0 tx=0x7fb36002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad02ec7001d86708 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.176+0000 7fb3777fe640 1 -- 172.21.15.29:0/2827737706 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36002ae50 con 0x7fb3780aeb00 2024-09-13T18:45:45.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.176+0000 7fb3777fe640 1 -- 172.21.15.29:0/2827737706 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb360032440 con 0x7fb3780aeb00 2024-09-13T18:45:45.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.176+0000 7fb3777fe640 1 -- 172.21.15.29:0/2827737706 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3600327b0 con 0x7fb3780aeb00 2024-09-13T18:45:45.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.177+0000 7fb37eea3640 1 -- 172.21.15.29:0/2827737706 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb3780aeb00 msgr2=0x7fb37813f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.177+0000 7fb37eea3640 1 --2- 172.21.15.29:0/2827737706 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb3780aeb00 0x7fb37813f700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb3600097d0 tx=0x7fb36002a100 comp rx=0 tx=0).stop 2024-09-13T18:45:45.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.177+0000 7fb37eea3640 1 -- 172.21.15.29:0/2827737706 shutdown_connections 2024-09-13T18:45:45.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.177+0000 7fb37eea3640 1 --2- 172.21.15.29:0/2827737706 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb3780aeb00 0x7fb37813f700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.177+0000 7fb37eea3640 1 -- 172.21.15.29:0/2827737706 >> 172.21.15.29:0/2827737706 conn(0x7fb3780b4780 msgr2=0x7fb3780b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.177+0000 7fb37eea3640 1 -- 172.21.15.29:0/2827737706 shutdown_connections 2024-09-13T18:45:45.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.177+0000 7fb37eea3640 1 -- 172.21.15.29:0/2827737706 wait complete. 2024-09-13T18:45:45.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.178+0000 7fb37eea3640 1 Processor -- start 2024-09-13T18:45:45.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.178+0000 7fb37eea3640 1 -- start start 2024-09-13T18:45:45.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.178+0000 7fb37eea3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb37806b150 0x7fb3780ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.178+0000 7fb37eea3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3780aeb00 0x7fb3781db2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.178+0000 7fb37eea3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb37813fc40 0x7fb378148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.178+0000 7fb37eea3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780acd70 con 0x7fb37806b150 2024-09-13T18:45:45.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.178+0000 7fb37eea3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3781d0700 con 0x7fb3780aeb00 2024-09-13T18:45:45.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.178+0000 7fb37eea3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb378139a90 con 0x7fb37813fc40 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb37cc3f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb37806b150 0x7fb3780ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb37cc3f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb37806b150 0x7fb3780ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40592/0 (socket says 172.21.15.29:40592) 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb37cc3f640 1 -- 172.21.15.29:0/1962721680 learned_addr learned my addr 172.21.15.29:0/1962721680 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb377fff640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3780aeb00 0x7fb3781db2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb37d440640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb37813fc40 0x7fb378148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb37cc3f640 1 -- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb37813fc40 msgr2=0x7fb378148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb37cc3f640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb37813fc40 0x7fb378148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb37cc3f640 1 -- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3780aeb00 msgr2=0x7fb3781db2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb37cc3f640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3780aeb00 0x7fb3781db2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb37cc3f640 1 -- 172.21.15.29:0/1962721680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb360009400 con 0x7fb37806b150 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb37cc3f640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb37806b150 0x7fb3780ac830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb36800c530 tx=0x7fb36800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb3757fa640 1 -- 172.21.15.29:0/1962721680 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3680052d0 con 0x7fb37806b150 2024-09-13T18:45:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb3757fa640 1 -- 172.21.15.29:0/1962721680 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb368005450 con 0x7fb37806b150 2024-09-13T18:45:45.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb37eea3640 1 -- 172.21.15.29:0/1962721680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3780ac3b0 con 0x7fb37806b150 2024-09-13T18:45:45.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb3757fa640 1 -- 172.21.15.29:0/1962721680 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368012870 con 0x7fb37806b150 2024-09-13T18:45:45.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.179+0000 7fb37eea3640 1 -- 172.21.15.29:0/1962721680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb378143400 con 0x7fb37806b150 2024-09-13T18:45:45.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.180+0000 7fb37eea3640 1 -- 172.21.15.29:0/1962721680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb378067300 con 0x7fb37806b150 2024-09-13T18:45:45.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.181+0000 7fb3757fa640 1 -- 172.21.15.29:0/1962721680 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb3680129d0 con 0x7fb37806b150 2024-09-13T18:45:45.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.181+0000 7fb3757fa640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb35806ac00 0x7fb35806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.181+0000 7fb3757fa640 1 -- 172.21.15.29:0/1962721680 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb368089170 con 0x7fb37806b150 2024-09-13T18:45:45.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.182+0000 7fb377fff640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb35806ac00 0x7fb35806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.182+0000 7fb377fff640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb35806ac00 0x7fb35806d0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb360034000 tx=0x7fb36002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.186+0000 7fb3757fa640 1 -- 172.21.15.29:0/1962721680 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb368054070 con 0x7fb37806b150 2024-09-13T18:45:45.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.359+0000 7fb37eea3640 1 -- 172.21.15.29:0/1962721680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb378070370 con 0x7fb37806b150 2024-09-13T18:45:45.363 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:45.363 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.360+0000 7fb3757fa640 1 -- 172.21.15.29:0/1962721680 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7fb368057690 con 0x7fb37806b150 2024-09-13T18:45:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.362+0000 7fb37eea3640 1 -- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb35806ac00 msgr2=0x7fb35806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.362+0000 7fb37eea3640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb35806ac00 0x7fb35806d0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb360034000 tx=0x7fb36002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.362+0000 7fb37eea3640 1 -- 172.21.15.29:0/1962721680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb37806b150 msgr2=0x7fb3780ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.362+0000 7fb37eea3640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb37806b150 0x7fb3780ac830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb36800c530 tx=0x7fb36800c9f0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.363+0000 7fb37eea3640 1 -- 172.21.15.29:0/1962721680 shutdown_connections 2024-09-13T18:45:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.363+0000 7fb37eea3640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb35806ac00 0x7fb35806d0c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.363+0000 7fb37eea3640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb37813fc40 0x7fb378148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.363+0000 7fb37eea3640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3780aeb00 0x7fb3781db2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.363+0000 7fb37eea3640 1 --2- 172.21.15.29:0/1962721680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb37806b150 0x7fb3780ac830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.363+0000 7fb37eea3640 1 -- 172.21.15.29:0/1962721680 >> 172.21.15.29:0/1962721680 conn(0x7fb3780b4780 msgr2=0x7fb3780b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.363+0000 7fb37eea3640 1 -- 172.21.15.29:0/1962721680 shutdown_connections 2024-09-13T18:45:45.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.363+0000 7fb37eea3640 1 -- 172.21.15.29:0/1962721680 wait complete. 2024-09-13T18:45:45.379 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T18:45:45.379 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T18:45:45.379 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T18:45:45.380 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T18:45:45.380 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T18:45:45.381 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T18:45:45.381 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T18:45:45.381 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T18:45:45.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.555+0000 7f1ed7111640 1 Processor -- start 2024-09-13T18:45:45.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.555+0000 7f1ed7111640 1 -- start start 2024-09-13T18:45:45.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.555+0000 7fbee0e2b640 1 Processor -- start 2024-09-13T18:45:45.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.555+0000 7fc91c7ff640 1 Processor -- start 2024-09-13T18:45:45.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.555+0000 7fc91c7ff640 1 -- start start 2024-09-13T18:45:45.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.555+0000 7fbee0e2b640 1 -- start start 2024-09-13T18:45:45.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7f1ed7111640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ed00b2120 0x7f1ed0098a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7f1ed7111640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1ed01497a0 0x7f1ed0150370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7f1ed7111640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed00b3940 con 0x7f1ed00b34d0 2024-09-13T18:45:45.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7f1ed7111640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed0072570 con 0x7f1ed00b2120 2024-09-13T18:45:45.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7f1ed7111640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed00acc30 con 0x7f1ed01497a0 2024-09-13T18:45:45.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7fbee0e2b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbedc06b5d0 0x7fbedc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7fbee0e2b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbedc0b38e0 0x7fbedc099150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7fbee0e2b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc0b3d00 con 0x7fbedc0b3480 2024-09-13T18:45:45.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7fbee0e2b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbedc09d050 con 0x7fbedc0b38e0 2024-09-13T18:45:45.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7fbee0e2b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0b1eb0 con 0x7fbedc06b5d0 2024-09-13T18:45:45.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7fc91c7ff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc9140b2120 0x7fc91409c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7fc91c7ff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc914144190 0x7fc91414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7fc91c7ff640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9140b2df0 con 0x7fc91409a560 2024-09-13T18:45:45.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7fc91c7ff640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9140b34f0 con 0x7fc9140b2120 2024-09-13T18:45:45.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7fc91c7ff640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140b2500 con 0x7fc914144190 2024-09-13T18:45:45.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7f9499d33640 1 Processor -- start 2024-09-13T18:45:45.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.556+0000 7f9499d33640 1 -- start start 2024-09-13T18:45:45.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7fbed9d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbedc0b3480 0x7fbedc098a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54362/0 (socket says 172.21.15.29:54362) 2024-09-13T18:45:45.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7fbedad9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbedc0b38e0 0x7fbedc099150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7fbedad9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbedc0b38e0 0x7fbedc099150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40620/0 (socket says 172.21.15.29:40620) 2024-09-13T18:45:45.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7fbedad9d640 1 -- 172.21.15.29:0/3499130593 learned_addr learned my addr 172.21.15.29:0/3499130593 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7fbeda59c640 1 --2- 172.21.15.29:0/3499130593 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbedc06b5d0 0x7fbedc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7fc91ad9c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc914144190 0x7fc91414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7fc91ad9c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc914144190 0x7fc91414e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:43920/0 (socket says 172.21.15.29:43920) 2024-09-13T18:45:45.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7fc91ad9c640 1 -- 172.21.15.29:0/3805961934 learned_addr learned my addr 172.21.15.29:0/3805961934 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7f9499d33640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f948c03a310 0x7f948c03a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7f9499d33640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f948c03b550 0x7f948c0d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7f9499d33640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0d10a0 con 0x7f948c0d0c50 2024-09-13T18:45:45.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7f9499d33640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c03baa0 con 0x7f948c03b550 2024-09-13T18:45:45.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7f9499d33640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c038f50 con 0x7f948c03a310 2024-09-13T18:45:45.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7f1ed4ead640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ed00b2120 0x7f1ed0098a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f1ed4ead640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ed00b2120 0x7f1ed0098a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40606/0 (socket says 172.21.15.29:40606) 2024-09-13T18:45:45.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f1ed4ead640 1 -- 172.21.15.29:0/3714051729 learned_addr learned my addr 172.21.15.29:0/3714051729 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f9498d31640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f948c03a310 0x7f948c03a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f9498d31640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f948c03a310 0x7f948c03a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38490/0 (socket says 172.21.15.29:38490) 2024-09-13T18:45:45.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f9498d31640 1 -- 172.21.15.29:0/533097094 learned_addr learned my addr 172.21.15.29:0/533097094 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f9499532640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f948c0d0c50 0x7f948c0377e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:53138/0 (socket says 172.21.15.29:53138) 2024-09-13T18:45:45.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f9493fff640 1 --2- 172.21.15.29:0/533097094 >> v2:172.21.15.29:3300/0 conn(0x7f948c03b550 0x7f948c0d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7fbeda59c640 1 -- 172.21.15.29:0/3499130593 >> v2:172.21.15.29:3300/0 conn(0x7fbedc0b38e0 msgr2=0x7fbedc099150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7fbeda59c640 1 --2- 172.21.15.29:0/3499130593 >> v2:172.21.15.29:3300/0 conn(0x7fbedc0b38e0 0x7fbedc099150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7f9604680640 1 Processor -- start 2024-09-13T18:45:45.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f9604680640 1 -- start start 2024-09-13T18:45:45.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f1ed4ead640 1 -- 172.21.15.29:0/3714051729 >> v2:172.21.15.96:3300/0 conn(0x7f1ed01497a0 msgr2=0x7f1ed0150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f1ed56ae640 1 --2- 172.21.15.29:0/3714051729 >> v2:172.21.15.96:3300/0 conn(0x7f1ed01497a0 0x7f1ed0150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f1ed4ead640 1 --2- 172.21.15.29:0/3714051729 >> v2:172.21.15.96:3300/0 conn(0x7f1ed01497a0 0x7f1ed0150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f1ed4ead640 1 -- 172.21.15.29:0/3714051729 >> v1:172.21.15.29:6789/0 conn(0x7f1ed00b34d0 legacy=0x7f1ed0149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7fc91ad9c640 1 -- 172.21.15.29:0/3805961934 >> v2:172.21.15.96:3300/0 conn(0x7fc9140b2120 msgr2=0x7fc91409c7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:45:45.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7fc91ad9c640 1 --2- 172.21.15.29:0/3805961934 >> v2:172.21.15.96:3300/0 conn(0x7fc9140b2120 0x7fc91409c7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7fc91ad9c640 1 -- 172.21.15.29:0/3805961934 >> v1:172.21.15.96:6789/0 conn(0x7fc91409a560 legacy=0x7fc914143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.557+0000 7fc91ad9c640 1 -- 172.21.15.29:0/3805961934 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9140b3180 con 0x7fc914144190 2024-09-13T18:45:45.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f9498d31640 1 -- 172.21.15.29:0/533097094 >> v2:172.21.15.29:3300/0 conn(0x7f948c03b550 msgr2=0x7f948c0d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f9498d31640 1 --2- 172.21.15.29:0/533097094 >> v2:172.21.15.29:3300/0 conn(0x7f948c03b550 0x7f948c0d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f9498d31640 1 -- 172.21.15.29:0/533097094 >> v1:172.21.15.96:6789/0 conn(0x7f948c0d0c50 legacy=0x7f948c0377e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7f9498d31640 1 -- 172.21.15.29:0/533097094 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c006d30 con 0x7f948c03a310 2024-09-13T18:45:45.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f1ed4ead640 1 -- 172.21.15.29:0/3714051729 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed00ac9c0 con 0x7f1ed00b2120 2024-09-13T18:45:45.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f9493fff640 1 --2- 172.21.15.29:0/533097094 >> v2:172.21.15.29:3300/0 conn(0x7f948c03b550 0x7f948c0d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:45.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f07077ed640 1 Processor -- start 2024-09-13T18:45:45.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f1ed56ae640 1 --2- 172.21.15.29:0/3714051729 >> v2:172.21.15.96:3300/0 conn(0x7f1ed01497a0 0x7f1ed0150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:45.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7fbeda59c640 1 -- 172.21.15.29:0/3499130593 >> v1:172.21.15.29:6789/0 conn(0x7fbedc0b3480 legacy=0x7fbedc098a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7fbeda59c640 1 -- 172.21.15.29:0/3499130593 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0ad280 con 0x7fbedc06b5d0 2024-09-13T18:45:45.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.558+0000 7fbed959a640 1 -- 172.21.15.29:0/3499130593 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574802445 0 0) 0x7fbedc0b3d00 con 0x7fbedc0b3480 2024-09-13T18:45:45.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f7d39e6b640 1 Processor -- start 2024-09-13T18:45:45.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f9604680640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95fc0afb80 0x7f95fc0aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f9604680640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc0af230 con 0x7f95fc14a4e0 2024-09-13T18:45:45.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f9604680640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc149ce0 con 0x7f95fc1524b0 2024-09-13T18:45:45.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f9604680640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0b11e0 con 0x7f95fc0afb80 2024-09-13T18:45:45.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f960241c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95fc0afb80 0x7f95fc0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f9601c1b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f95fc14a4e0 0x7f95fc1439c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54374/0 (socket says 172.21.15.29:54374) 2024-09-13T18:45:45.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f9601c1b640 1 -- 172.21.15.29:0/364419842 learned_addr learned my addr 172.21.15.29:0/364419842 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:45.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7fc91ad9c640 1 --2- 172.21.15.29:0/3805961934 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc914144190 0x7fc91414e1b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009e50 tx=0x7fc90c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b54663316b349ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f960241c640 1 -- 172.21.15.29:0/364419842 >> v1:172.21.15.96:6789/0 conn(0x7f95fc1524b0 legacy=0x7f95fc1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f960241c640 1 -- 172.21.15.29:0/364419842 >> v1:172.21.15.29:6789/0 conn(0x7f95fc14a4e0 legacy=0x7f95fc1439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f960241c640 1 -- 172.21.15.29:0/364419842 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc149fc0 con 0x7f95fc0afb80 2024-09-13T18:45:45.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7fbeda59c640 1 --2- 172.21.15.29:0/3499130593 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbedc06b5d0 0x7fbedc06bdf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0097a0 tx=0x7fbecc02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baf1b4cb39653246 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f7d39e6b640 1 -- start start 2024-09-13T18:45:45.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f1ed4ead640 1 --2- 172.21.15.29:0/3714051729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ed00b2120 0x7f1ed0098a40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009870 tx=0x7f1ec002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d769f7677e584b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f9498d31640 1 --2- 172.21.15.29:0/533097094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f948c03a310 0x7f948c03a6f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f948c0417c0 tx=0x7f948802a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cc1694c48caf4c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.559+0000 7f07077ed640 1 -- start start 2024-09-13T18:45:45.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f1ecf7fe640 1 -- 172.21.15.29:0/3714051729 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0032440 con 0x7f1ed00b2120 2024-09-13T18:45:45.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f94937fe640 1 -- 172.21.15.29:0/533097094 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948802ad70 con 0x7f948c03a310 2024-09-13T18:45:45.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f94937fe640 1 -- 172.21.15.29:0/533097094 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488032440 con 0x7f948c03a310 2024-09-13T18:45:45.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7fbed959a640 1 -- 172.21.15.29:0/3499130593 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc02ae40 con 0x7fbedc06b5d0 2024-09-13T18:45:45.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f94937fe640 1 -- 172.21.15.29:0/533097094 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880327d0 con 0x7f948c03a310 2024-09-13T18:45:45.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f1ecf7fe640 1 -- 172.21.15.29:0/3714051729 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec00325a0 con 0x7f1ed00b2120 2024-09-13T18:45:45.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f1ecf7fe640 1 -- 172.21.15.29:0/3714051729 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0032930 con 0x7f1ed00b2120 2024-09-13T18:45:45.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7fbed959a640 1 -- 172.21.15.29:0/3499130593 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc032440 con 0x7fbedc06b5d0 2024-09-13T18:45:45.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7fbed959a640 1 -- 172.21.15.29:0/3499130593 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc0327d0 con 0x7fbedc06b5d0 2024-09-13T18:45:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7fc919599640 1 -- 172.21.15.29:0/3805961934 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c031600 con 0x7fc914144190 2024-09-13T18:45:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7fc919599640 1 -- 172.21.15.29:0/3805961934 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c02d050 con 0x7fc914144190 2024-09-13T18:45:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f07077ed640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f07000ae6e0 0x7f0700141830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f07077ed640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0700071dc0 0x7f070014c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f07077ed640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07000b1520 con 0x7f07000b0150 2024-09-13T18:45:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f0705589640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f07000b0150 0x7f0700070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:53162/0 (socket says 172.21.15.29:53162) 2024-09-13T18:45:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f0705589640 1 -- 172.21.15.29:0/1304677390 learned_addr learned my addr 172.21.15.29:0/1304677390 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f07077ed640 1 -- 172.21.15.29:0/1304677390 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070013c020 con 0x7f07000ae6e0 2024-09-13T18:45:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f07077ed640 1 -- 172.21.15.29:0/1304677390 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0700072210 con 0x7f0700071dc0 2024-09-13T18:45:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f0705d8a640 1 --2- 172.21.15.29:0/1304677390 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0700071dc0 0x7f070014c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595995777 0 0) 0x7f07000b1520 con 0x7f07000b0150 2024-09-13T18:45:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06ec003500 con 0x7f07000b0150 2024-09-13T18:45:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f0704d88640 1 --2- 172.21.15.29:0/1304677390 >> v2:172.21.15.29:3300/0 conn(0x7f07000ae6e0 0x7f0700141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 <== mon.1 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 278398340 0 0) 0x7f06ec003500 con 0x7f07000b0150 2024-09-13T18:45:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0700071dc0 msgr2=0x7f070014c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 --2- 172.21.15.29:0/1304677390 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0700071dc0 0x7f070014c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 >> v2:172.21.15.29:3300/0 conn(0x7f07000ae6e0 msgr2=0x7f0700141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.560+0000 7f7d39e6b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7d340afe90 0x7f7d3414a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f7d39e6b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7d34143790 0x7f7d34143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 --2- 172.21.15.29:0/1304677390 >> v2:172.21.15.29:3300/0 conn(0x7f07000ae6e0 0x7f0700141830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07000718e0 con 0x7f07000b0150 2024-09-13T18:45:45.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 <== mon.1 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f06fc001670 con 0x7f07000b0150 2024-09-13T18:45:45.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 >> v1:172.21.15.96:6789/0 conn(0x7f07000b0150 legacy=0x7f0700070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 --2- 172.21.15.29:0/1304677390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06ec003cd0 0x7f06ec0040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 --2- 172.21.15.29:0/1304677390 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06ec006f80 0x7f06ec004630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f960241c640 1 --2- 172.21.15.29:0/364419842 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95fc0afb80 0x7f95fc0aff60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f95f80097d0 tx=0x7f95f802a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ebbac81ab87273a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 --2- 172.21.15.29:0/1304677390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06ec009410 0x7f06ec009890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070013c020 con 0x7f06ec003cd0 2024-09-13T18:45:45.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0700072210 con 0x7f06ec009410 2024-09-13T18:45:45.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec00a060 con 0x7f06ec006f80 2024-09-13T18:45:45.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f0705589640 1 --2- 172.21.15.29:0/1304677390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06ec003cd0 0x7f06ec0040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7fbee0e2b640 1 -- 172.21.15.29:0/3499130593 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbedc06b5d0 msgr2=0x7fbedc06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7fbee0e2b640 1 --2- 172.21.15.29:0/3499130593 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbedc06b5d0 0x7fbedc06bdf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0097a0 tx=0x7fbecc02a0f0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f7d39e6b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3414a020 con 0x7f7d3414d190 2024-09-13T18:45:45.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f7d39e6b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d340b10a0 con 0x7f7d34143790 2024-09-13T18:45:45.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f7d39e6b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340b38d0 con 0x7f7d340afe90 2024-09-13T18:45:45.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f7d337fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7d340afe90 0x7f7d3414a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f7d337fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7d340afe90 0x7f7d3414a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:43974/0 (socket says 172.21.15.29:43974) 2024-09-13T18:45:45.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f7d337fe640 1 -- 172.21.15.29:0/1803271179 learned_addr learned my addr 172.21.15.29:0/1803271179 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f7d32ffd640 1 --2- 172.21.15.29:0/1803271179 >> v2:172.21.15.96:3300/0 conn(0x7f7d34143790 0x7f7d34143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f0704d88640 1 --2- 172.21.15.29:0/1304677390 >> v2:172.21.15.29:3300/0 conn(0x7f07000ae6e0 0x7f0700141830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:45.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f0705d8a640 1 --2- 172.21.15.29:0/1304677390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06ec009410 0x7f06ec009890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f7d337fe640 1 -- 172.21.15.29:0/1803271179 >> v2:172.21.15.96:3300/0 conn(0x7f7d34143790 msgr2=0x7f7d34143bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f7d337fe640 1 --2- 172.21.15.29:0/1803271179 >> v2:172.21.15.96:3300/0 conn(0x7f7d34143790 0x7f7d34143bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f7d337fe640 1 -- 172.21.15.29:0/1803271179 >> v1:172.21.15.96:6789/0 conn(0x7f7d3414d190 legacy=0x7f7d3414d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.561+0000 7f7d337fe640 1 -- 172.21.15.29:0/1803271179 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d340af960 con 0x7f7d340afe90 2024-09-13T18:45:45.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fc91c7ff640 1 -- 172.21.15.29:0/3805961934 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc914144190 msgr2=0x7fc91414e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fc91c7ff640 1 --2- 172.21.15.29:0/3805961934 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc914144190 0x7fc91414e1b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009e50 tx=0x7fc90c02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f1ed7111640 1 -- 172.21.15.29:0/3714051729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ed00b2120 msgr2=0x7f1ed0098a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f1ed7111640 1 --2- 172.21.15.29:0/3714051729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ed00b2120 0x7f1ed0098a40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009870 tx=0x7f1ec002a230 comp rx=0 tx=0).stop 2024-09-13T18:45:45.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fbee0e2b640 1 -- 172.21.15.29:0/3499130593 shutdown_connections 2024-09-13T18:45:45.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fbee0e2b640 1 --2- 172.21.15.29:0/3499130593 >> v2:172.21.15.29:3300/0 conn(0x7fbedc0b38e0 0x7fbedc099150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fbee0e2b640 1 --2- 172.21.15.29:0/3499130593 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbedc06b5d0 0x7fbedc06bdf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fbee0e2b640 1 -- 172.21.15.29:0/3499130593 >> 172.21.15.29:0/3499130593 conn(0x7fbedc0b78a0 msgr2=0x7fbedc0b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f9499d33640 1 -- 172.21.15.29:0/533097094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f948c03a310 msgr2=0x7f948c03a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f9499d33640 1 --2- 172.21.15.29:0/533097094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f948c03a310 0x7f948c03a6f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f948c0417c0 tx=0x7f948802a0e0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f0704d88640 1 --2- 172.21.15.29:0/1304677390 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06ec006f80 0x7f06ec004630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f0705589640 1 -- 172.21.15.29:0/1304677390 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06ec006f80 msgr2=0x7f06ec004630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f0705589640 1 --2- 172.21.15.29:0/1304677390 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06ec006f80 0x7f06ec004630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fc91c7ff640 1 -- 172.21.15.29:0/3805961934 shutdown_connections 2024-09-13T18:45:45.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fc91c7ff640 1 --2- 172.21.15.29:0/3805961934 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc914144190 0x7fc91414e1b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fc91c7ff640 1 --2- 172.21.15.29:0/3805961934 >> v2:172.21.15.96:3300/0 conn(0x7fc9140b2120 0x7fc91409c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fc91c7ff640 1 -- 172.21.15.29:0/3805961934 >> 172.21.15.29:0/3805961934 conn(0x7fc9140b3fb0 msgr2=0x7fc9140b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f1ed7111640 1 -- 172.21.15.29:0/3714051729 shutdown_connections 2024-09-13T18:45:45.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f1ed7111640 1 --2- 172.21.15.29:0/3714051729 >> v2:172.21.15.96:3300/0 conn(0x7f1ed01497a0 0x7f1ed0150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f1ed7111640 1 --2- 172.21.15.29:0/3714051729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ed00b2120 0x7f1ed0098a40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f1ed7111640 1 -- 172.21.15.29:0/3714051729 >> 172.21.15.29:0/3714051729 conn(0x7f1ed00b3fb0 msgr2=0x7f1ed00b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f9499d33640 1 -- 172.21.15.29:0/533097094 shutdown_connections 2024-09-13T18:45:45.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f9499d33640 1 --2- 172.21.15.29:0/533097094 >> v2:172.21.15.29:3300/0 conn(0x7f948c03b550 0x7f948c0d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f9499d33640 1 --2- 172.21.15.29:0/533097094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f948c03a310 0x7f948c03a6f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f9499d33640 1 -- 172.21.15.29:0/533097094 >> 172.21.15.29:0/533097094 conn(0x7f948c03e310 msgr2=0x7f948c03e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f1ed7111640 1 -- 172.21.15.29:0/3714051729 shutdown_connections 2024-09-13T18:45:45.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fbee0e2b640 1 -- 172.21.15.29:0/3499130593 shutdown_connections 2024-09-13T18:45:45.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fc91c7ff640 1 -- 172.21.15.29:0/3805961934 shutdown_connections 2024-09-13T18:45:45.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f0705589640 1 -- 172.21.15.29:0/1304677390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06ec009410 msgr2=0x7f06ec009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f0705589640 1 --2- 172.21.15.29:0/1304677390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06ec009410 0x7f06ec009890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f0705589640 1 -- 172.21.15.29:0/1304677390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07000718e0 con 0x7f06ec003cd0 2024-09-13T18:45:45.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f960141a640 1 -- 172.21.15.29:0/364419842 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f802adb0 con 0x7f95fc0afb80 2024-09-13T18:45:45.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f960141a640 1 -- 172.21.15.29:0/364419842 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f8032440 con 0x7f95fc0afb80 2024-09-13T18:45:45.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f960141a640 1 -- 172.21.15.29:0/364419842 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f80327d0 con 0x7f95fc0afb80 2024-09-13T18:45:45.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f7e29c96640 1 Processor -- start 2024-09-13T18:45:45.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f7e29c96640 1 -- start start 2024-09-13T18:45:45.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f7d337fe640 1 --2- 172.21.15.29:0/1803271179 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7d340afe90 0x7f7d3414a4b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009870 tx=0x7f7d1c02a1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29d6a7d96ff17f96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7fbee0e2b640 1 -- 172.21.15.29:0/3499130593 wait complete. 2024-09-13T18:45:45.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f9604680640 1 -- 172.21.15.29:0/364419842 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95fc0afb80 msgr2=0x7f95fc0aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f9604680640 1 --2- 172.21.15.29:0/364419842 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95fc0afb80 0x7f95fc0aff60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f95f80097d0 tx=0x7f95f802a0a0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f7d327fc640 1 -- 172.21.15.29:0/1803271179 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c032440 con 0x7f7d340afe90 2024-09-13T18:45:45.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f7d327fc640 1 -- 172.21.15.29:0/1803271179 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c0325a0 con 0x7f7d340afe90 2024-09-13T18:45:45.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f9604680640 1 -- 172.21.15.29:0/364419842 shutdown_connections 2024-09-13T18:45:45.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f9604680640 1 --2- 172.21.15.29:0/364419842 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95fc0afb80 0x7f95fc0aff60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f9604680640 1 -- 172.21.15.29:0/364419842 >> 172.21.15.29:0/364419842 conn(0x7f95fc0b71e0 msgr2=0x7f95fc0b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f9604680640 1 -- 172.21.15.29:0/364419842 shutdown_connections 2024-09-13T18:45:45.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f9604680640 1 -- 172.21.15.29:0/364419842 wait complete. 2024-09-13T18:45:45.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f9499d33640 1 -- 172.21.15.29:0/533097094 shutdown_connections 2024-09-13T18:45:45.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f9499d33640 1 -- 172.21.15.29:0/533097094 wait complete. 2024-09-13T18:45:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f7e29c96640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7e240b4250 0x7f7e24145e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f7e29c96640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7e24146350 0x7f7e2413f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7e22ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7e24146350 0x7f7e2413f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7fbee0e2b640 1 Processor -- start 2024-09-13T18:45:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7fc91c7ff640 1 -- 172.21.15.29:0/3805961934 wait complete. 2024-09-13T18:45:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.562+0000 7f1ed7111640 1 -- 172.21.15.29:0/3714051729 wait complete. 2024-09-13T18:45:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f1ed7111640 1 Processor -- start 2024-09-13T18:45:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f1ed7111640 1 -- start start 2024-09-13T18:45:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f1ed7111640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ed00b2120 0x7f1ed006e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f1ed7111640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed00b34d0 0x7f1ed0070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f1ed7111640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ed01497a0 0x7f1ed0071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f1ed7111640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed01f9d80 con 0x7f1ed00b2120 2024-09-13T18:45:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f1ed7111640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed006fe20 con 0x7f1ed00b34d0 2024-09-13T18:45:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f1ed7111640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed01f94b0 con 0x7f1ed01497a0 2024-09-13T18:45:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7fbee0e2b640 1 -- start start 2024-09-13T18:45:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7fbee0e2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbedc06b5d0 0x7fbedc146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7fbee0e2b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbedc0b3480 0x7fbedc070050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7fbee0e2b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbedc0b38e0 0x7fbedc070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7fbee0e2b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0aef70 con 0x7fbedc06b5d0 2024-09-13T18:45:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7fbee0e2b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0aeb50 con 0x7fbedc0b3480 2024-09-13T18:45:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7fbee0e2b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0717b0 con 0x7fbedc0b38e0 2024-09-13T18:45:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7fc91c7ff640 1 Processor -- start 2024-09-13T18:45:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7fc91c7ff640 1 -- start start 2024-09-13T18:45:45.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f9499d33640 1 Processor -- start 2024-09-13T18:45:45.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f9499d33640 1 -- start start 2024-09-13T18:45:45.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.563+0000 7f0705589640 1 --2- 172.21.15.29:0/1304677390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06ec003cd0 0x7f06ec0040f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c210 tx=0x7f06ec004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed929f1933cf8e0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc005ad0 con 0x7f06ec003cd0 2024-09-13T18:45:45.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc005c30 con 0x7f06ec003cd0 2024-09-13T18:45:45.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f06f7fff640 1 -- 172.21.15.29:0/1304677390 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc007070 con 0x7f06ec003cd0 2024-09-13T18:45:45.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f9604680640 1 Processor -- start 2024-09-13T18:45:45.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7e29c96640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e240b2630 con 0x7f7e2413f910 2024-09-13T18:45:45.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7e29c96640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e24146790 con 0x7f7e24146350 2024-09-13T18:45:45.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7e22ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7e24146350 0x7f7e2413f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40658/0 (socket says 172.21.15.29:40658) 2024-09-13T18:45:45.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7e22ffd640 1 -- 172.21.15.29:0/579094368 learned_addr learned my addr 172.21.15.29:0/579094368 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7e29c96640 1 -- 172.21.15.29:0/579094368 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e241459c0 con 0x7f7e240b4250 2024-09-13T18:45:45.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7d39e6b640 1 -- 172.21.15.29:0/1803271179 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7d340afe90 msgr2=0x7f7d3414a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7d39e6b640 1 --2- 172.21.15.29:0/1803271179 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7d340afe90 0x7f7d3414a4b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009870 tx=0x7f7d1c02a1d0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7d39e6b640 1 -- 172.21.15.29:0/1803271179 shutdown_connections 2024-09-13T18:45:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7d39e6b640 1 --2- 172.21.15.29:0/1803271179 >> v2:172.21.15.96:3300/0 conn(0x7f7d34143790 0x7f7d34143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7d39e6b640 1 --2- 172.21.15.29:0/1803271179 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7d340afe90 0x7f7d3414a4b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7d39e6b640 1 -- 172.21.15.29:0/1803271179 >> 172.21.15.29:0/1803271179 conn(0x7f7d340b71e0 msgr2=0x7f7d340b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f7d39e6b640 1 -- 172.21.15.29:0/1803271179 shutdown_connections 2024-09-13T18:45:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7fbedad9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbedc0b38e0 0x7fbedc070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7fbedad9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbedc0b38e0 0x7fbedc070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:43992/0 (socket says 172.21.15.29:43992) 2024-09-13T18:45:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7fbedad9d640 1 -- 172.21.15.29:0/1749349063 learned_addr learned my addr 172.21.15.29:0/1749349063 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7fbed9d9b640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbedc0b3480 0x7fbedc070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fc91c7ff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc91409a560 0x7fc914147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f9499d33640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f948c03a310 0x7f948c171ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f07077ed640 1 -- 172.21.15.29:0/1304677390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06ec003cd0 msgr2=0x7f06ec0040f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f07077ed640 1 --2- 172.21.15.29:0/1304677390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06ec003cd0 0x7f06ec0040f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c210 tx=0x7f06ec004d50 comp rx=0 tx=0).stop 2024-09-13T18:45:45.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f9499d33640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f948c03b550 0x7f948c02f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fc91c7ff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9140b2120 0x7fc91406e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f1ecffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed00b34d0 0x7f1ed0070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f9499d33640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f948c0d0c50 0x7f948c02fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fc91c7ff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc914144190 0x7fc91406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f1ecffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed00b34d0 0x7f1ed0070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38546/0 (socket says 172.21.15.29:38546) 2024-09-13T18:45:45.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fc91c7ff640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91413b3c0 con 0x7fc91409a560 2024-09-13T18:45:45.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f0705d8a640 1 -- 172.21.15.29:0/1304677390 reap_dead start 2024-09-13T18:45:45.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f07077ed640 1 -- 172.21.15.29:0/1304677390 shutdown_connections 2024-09-13T18:45:45.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f07077ed640 1 -- 172.21.15.29:0/1304677390 >> 172.21.15.29:0/1304677390 conn(0x7f07000b71e0 msgr2=0x7f07000b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fc91c7ff640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9141466b0 con 0x7fc9140b2120 2024-09-13T18:45:45.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fc91c7ff640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc914146990 con 0x7fc914144190 2024-09-13T18:45:45.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f9499d33640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c030a80 con 0x7f948c03b550 2024-09-13T18:45:45.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.564+0000 7f7e237fe640 1 --2- 172.21.15.29:0/579094368 >> v2:172.21.15.96:3300/0 conn(0x7f7e240b4250 0x7f7e24145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f9499532640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f948c0d0c50 0x7f948c02fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f9499532640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f948c0d0c50 0x7f948c02fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44012/0 (socket says 172.21.15.29:44012) 2024-09-13T18:45:45.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f9499532640 1 -- 172.21.15.29:0/2590487943 learned_addr learned my addr 172.21.15.29:0/2590487943 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fbedad9d640 1 -- 172.21.15.29:0/1749349063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbedc0b3480 msgr2=0x7fbedc070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fbedad9d640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbedc0b3480 0x7fbedc070050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fbedad9d640 1 -- 172.21.15.29:0/1749349063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbedc06b5d0 msgr2=0x7fbedc146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fbedad9d640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbedc06b5d0 0x7fbedc146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fbedad9d640 1 -- 172.21.15.29:0/1749349063 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc009400 con 0x7fbedc0b38e0 2024-09-13T18:45:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f7e237fe640 1 -- 172.21.15.29:0/579094368 >> v2:172.21.15.29:3300/0 conn(0x7f7e24146350 msgr2=0x7f7e2413f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f7e237fe640 1 --2- 172.21.15.29:0/579094368 >> v2:172.21.15.29:3300/0 conn(0x7f7e24146350 0x7f7e2413f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f7e237fe640 1 -- 172.21.15.29:0/579094368 >> v1:172.21.15.29:6789/0 conn(0x7f7e2413f910 legacy=0x7f7e24148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f7e237fe640 1 -- 172.21.15.29:0/579094368 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e240b5640 con 0x7f7e240b4250 2024-09-13T18:45:45.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c172920 con 0x7f948c03a310 2024-09-13T18:45:45.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c1646f0 con 0x7f948c0d0c50 2024-09-13T18:45:45.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f07077ed640 1 -- 172.21.15.29:0/1304677390 shutdown_connections 2024-09-13T18:45:45.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f7d39e6b640 1 -- 172.21.15.29:0/1803271179 wait complete. 2024-09-13T18:45:45.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fbedad9d640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbedc0b38e0 0x7fbedc070590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009cf0 tx=0x7fbed400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fc919d9a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9140b2120 0x7fc91406e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7fc91ad9c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc914144190 0x7fc91406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f7e237fe640 1 --2- 172.21.15.29:0/579094368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e240b4250 0x7f7e24145e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7e2406b960 tx=0x7f7e1c02a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d211c17fcf31887 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f7d39e6b640 1 Processor -- start 2024-09-13T18:45:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.565+0000 7f9604680640 1 -- start start 2024-09-13T18:45:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7fc919d9a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9140b2120 0x7fc91406e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38572/0 (socket says 172.21.15.29:38572) 2024-09-13T18:45:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7fc919d9a640 1 -- 172.21.15.29:0/2293559683 learned_addr learned my addr 172.21.15.29:0/2293559683 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f9604680640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95fc0afb80 0x7f95fc145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f9604680640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95fc14a4e0 0x7f95fc14aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f9604680640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95fc1524b0 0x7f95fc1e27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9604680640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc14b7c0 con 0x7f95fc1524b0 2024-09-13T18:45:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9604680640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc14c310 con 0x7f95fc0afb80 2024-09-13T18:45:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7fbecaffd640 1 -- 172.21.15.29:0/1749349063 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4009b60 con 0x7fbedc0b38e0 2024-09-13T18:45:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7fbecaffd640 1 -- 172.21.15.29:0/1749349063 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed400f040 con 0x7fbedc0b38e0 2024-09-13T18:45:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7fbecaffd640 1 -- 172.21.15.29:0/1749349063 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4003990 con 0x7fbedc0b38e0 2024-09-13T18:45:45.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9604680640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc13b640 con 0x7f95fc14a4e0 2024-09-13T18:45:45.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f7d39e6b640 1 -- start start 2024-09-13T18:45:45.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7fc91a59b640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc91409a560 0x7fc914147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9601c1b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95fc14a4e0 0x7f95fc14aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9601c1b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95fc14a4e0 0x7f95fc14aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44038/0 (socket says 172.21.15.29:44038) 2024-09-13T18:45:45.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9601c1b640 1 -- 172.21.15.29:0/753007614 learned_addr learned my addr 172.21.15.29:0/753007614 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f960241c640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95fc0afb80 0x7f95fc145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9602c1d640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95fc1524b0 0x7f95fc1e27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9499532640 1 -- 172.21.15.29:0/2590487943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f948c03a310 msgr2=0x7f948c171ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:45:45.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9499532640 1 --2- 172.21.15.29:0/2590487943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f948c03a310 0x7f948c171ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9499532640 1 -- 172.21.15.29:0/2590487943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f948c03b550 msgr2=0x7f948c02f910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:45:45.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9499532640 1 --2- 172.21.15.29:0/2590487943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f948c03b550 0x7f948c02f910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9499532640 1 -- 172.21.15.29:0/2590487943 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880094d0 con 0x7f948c0d0c50 2024-09-13T18:45:45.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7fc91ad9c640 1 -- 172.21.15.29:0/2293559683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9140b2120 msgr2=0x7fc91406e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7fc91ad9c640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9140b2120 0x7fc91406e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7fc91ad9c640 1 -- 172.21.15.29:0/2293559683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc91409a560 msgr2=0x7fc914147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7fc91ad9c640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc91409a560 0x7fc914147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9601c1b640 1 -- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95fc0afb80 msgr2=0x7f95fc145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9601c1b640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95fc0afb80 0x7f95fc145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9601c1b640 1 -- 172.21.15.29:0/753007614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95fc1524b0 msgr2=0x7f95fc1e27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9601c1b640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95fc1524b0 0x7f95fc1e27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f9601c1b640 1 -- 172.21.15.29:0/753007614 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f8009400 con 0x7f95fc14a4e0 2024-09-13T18:45:45.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7fc91ad9c640 1 -- 172.21.15.29:0/2293559683 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c009b30 con 0x7fc914144190 2024-09-13T18:45:45.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f1ed56ae640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ed01497a0 0x7f1ed0071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f1ed56ae640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ed01497a0 0x7f1ed0071040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44006/0 (socket says 172.21.15.29:44006) 2024-09-13T18:45:45.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7fbee0e2b640 1 -- 172.21.15.29:0/1749349063 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc0712a0 con 0x7fbedc0b38e0 2024-09-13T18:45:45.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7fbee0e2b640 1 -- 172.21.15.29:0/1749349063 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc0afc30 con 0x7fbedc0b38e0 2024-09-13T18:45:45.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f9601c1b640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95fc14a4e0 0x7f95fc14aef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f95f400cbf0 tx=0x7f95f400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7e227fc640 1 -- 172.21.15.29:0/579094368 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c02ae70 con 0x7f7e240b4250 2024-09-13T18:45:45.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7e227fc640 1 -- 172.21.15.29:0/579094368 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c032440 con 0x7f7e240b4250 2024-09-13T18:45:45.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7e227fc640 1 -- 172.21.15.29:0/579094368 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0327d0 con 0x7f7e240b4250 2024-09-13T18:45:45.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f1ed56ae640 1 -- 172.21.15.29:0/2208486548 learned_addr learned my addr 172.21.15.29:0/2208486548 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.567+0000 7f1ed56ae640 1 -- 172.21.15.29:0/2208486548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed00b34d0 msgr2=0x7f1ed0070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f1ed56ae640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed00b34d0 0x7f1ed0070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f1ed56ae640 1 -- 172.21.15.29:0/2208486548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ed00b2120 msgr2=0x7f1ed006e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f1ed56ae640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ed00b2120 0x7f1ed006e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f1ed56ae640 1 -- 172.21.15.29:0/2208486548 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00094d0 con 0x7f1ed01497a0 2024-09-13T18:45:45.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f1ecffff640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ed00b34d0 0x7f1ed0070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:45.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f9499532640 1 --2- 172.21.15.29:0/2590487943 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f948c0d0c50 0x7f948c02fe50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9494061a70 tx=0x7f94940678c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7d39e6b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d340afe90 0x7f7d341e2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f1ed56ae640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ed01497a0 0x7f1ed0071040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800cd80 tx=0x7f1ec800a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.566+0000 7f07077ed640 1 -- 172.21.15.29:0/1304677390 wait complete. 2024-09-13T18:45:45.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f95f2ffd640 1 -- 172.21.15.29:0/753007614 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f400ad50 con 0x7f95fc14a4e0 2024-09-13T18:45:45.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f95f2ffd640 1 -- 172.21.15.29:0/753007614 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f4012400 con 0x7f95fc14a4e0 2024-09-13T18:45:45.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f9604680640 1 -- 172.21.15.29:0/753007614 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc1459c0 con 0x7f95fc14a4e0 2024-09-13T18:45:45.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7d39e6b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d34143790 0x7f7d3414b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7d39e6b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7d3414d190 0x7f7d3413d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7d39e6b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d34144740 con 0x7f7d340afe90 2024-09-13T18:45:45.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7d39e6b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340715a0 con 0x7f7d34143790 2024-09-13T18:45:45.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7d39e6b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d341e2ad0 con 0x7f7d3414d190 2024-09-13T18:45:45.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7fbee0e2b640 1 -- 172.21.15.29:0/1749349063 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbedc0ad710 con 0x7fbedc0b38e0 2024-09-13T18:45:45.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f95f2ffd640 1 -- 172.21.15.29:0/753007614 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4012770 con 0x7f95fc14a4e0 2024-09-13T18:45:45.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f9604680640 1 -- 172.21.15.29:0/753007614 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc14b960 con 0x7f95fc14a4e0 2024-09-13T18:45:45.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f07077ed640 1 Processor -- start 2024-09-13T18:45:45.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f07077ed640 1 -- start start 2024-09-13T18:45:45.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7fc91ad9c640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc914144190 0x7fc91406ed50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc90c030000 tx=0x7fc90c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7d33fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7d3414d190 0x7f7d3413d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7d33fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7d3414d190 0x7f7d3413d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44054/0 (socket says 172.21.15.29:44054) 2024-09-13T18:45:45.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f94917fa640 1 -- 172.21.15.29:0/2590487943 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94940738e0 con 0x7f948c0d0c50 2024-09-13T18:45:45.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c1725b0 con 0x7f948c0d0c50 2024-09-13T18:45:45.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c02dc20 con 0x7f948c0d0c50 2024-09-13T18:45:45.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7e29c96640 1 -- 172.21.15.29:0/579094368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e240b4250 msgr2=0x7f7e24145e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7e29c96640 1 --2- 172.21.15.29:0/579094368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e240b4250 0x7f7e24145e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7e2406b960 tx=0x7f7e1c02a160 comp rx=0 tx=0).stop 2024-09-13T18:45:45.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7d33fff640 1 -- 172.21.15.29:0/4180069338 learned_addr learned my addr 172.21.15.29:0/4180069338 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7d337fe640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d340afe90 0x7f7d341e2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.568+0000 7f7d32ffd640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d34143790 0x7f7d3414b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7d337fe640 1 -- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7d3414d190 msgr2=0x7f7d3413d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7d337fe640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7d3414d190 0x7f7d3413d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7d337fe640 1 -- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d34143790 msgr2=0x7f7d3414b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7d337fe640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d34143790 0x7f7d3414b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7d337fe640 1 -- 172.21.15.29:0/4180069338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c0094d0 con 0x7f7d340afe90 2024-09-13T18:45:45.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f94917fa640 1 -- 172.21.15.29:0/2590487943 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94940721c0 con 0x7f948c0d0c50 2024-09-13T18:45:45.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f94917fa640 1 -- 172.21.15.29:0/2590487943 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494093410 con 0x7f948c0d0c50 2024-09-13T18:45:45.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7fc90affd640 1 -- 172.21.15.29:0/2293559683 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c008c50 con 0x7fc914144190 2024-09-13T18:45:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7fc90affd640 1 -- 172.21.15.29:0/2293559683 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c008db0 con 0x7fc914144190 2024-09-13T18:45:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f9604680640 1 -- 172.21.15.29:0/753007614 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95e4000fc0 con 0x7f95fc14a4e0 2024-09-13T18:45:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7fc90affd640 1 -- 172.21.15.29:0/2293559683 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c008c50 con 0x7fc914144190 2024-09-13T18:45:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7e29c96640 1 -- 172.21.15.29:0/579094368 shutdown_connections 2024-09-13T18:45:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7e29c96640 1 --2- 172.21.15.29:0/579094368 >> v2:172.21.15.29:3300/0 conn(0x7f7e24146350 0x7f7e2413f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7e29c96640 1 --2- 172.21.15.29:0/579094368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e240b4250 0x7f7e24145e10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7e29c96640 1 -- 172.21.15.29:0/579094368 >> 172.21.15.29:0/579094368 conn(0x7f7e240bb400 msgr2=0x7f7e240bb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7d337fe640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d340afe90 0x7f7d341e2590 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c031000 tx=0x7f7d1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7fc91c7ff640 1 -- 172.21.15.29:0/2293559683 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc914147b60 con 0x7fc914144190 2024-09-13T18:45:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f7e29c96640 1 -- 172.21.15.29:0/579094368 shutdown_connections 2024-09-13T18:45:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7fc91c7ff640 1 -- 172.21.15.29:0/2293559683 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc914071970 con 0x7fc914144190 2024-09-13T18:45:45.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f07077ed640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07001da030 0x7f070013cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f07077ed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07001da410 0x7f07001da890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.569+0000 7f07077ed640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f070013a5f0 0x7f070013aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f07077ed640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070013c8a0 con 0x7f07001da410 2024-09-13T18:45:45.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f07077ed640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07001418b0 con 0x7f07001da030 2024-09-13T18:45:45.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f07077ed640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07001cb0c0 con 0x7f070013a5f0 2024-09-13T18:45:45.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f0704d88640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07001da410 0x7f07001da890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f0704d88640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07001da410 0x7f07001da890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40726/0 (socket says 172.21.15.29:40726) 2024-09-13T18:45:45.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f0704d88640 1 -- 172.21.15.29:0/210223808 learned_addr learned my addr 172.21.15.29:0/210223808 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f0705d8a640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f070013a5f0 0x7f070013aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9474000fc0 con 0x7f948c0d0c50 2024-09-13T18:45:45.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f1ecd7fa640 1 -- 172.21.15.29:0/2208486548 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800f680 con 0x7f1ed01497a0 2024-09-13T18:45:45.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f0705d8a640 1 -- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07001da030 msgr2=0x7f070013cbb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f1ecd7fa640 1 -- 172.21.15.29:0/2208486548 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec800f7e0 con 0x7f1ed01497a0 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f1ecd7fa640 1 -- 172.21.15.29:0/2208486548 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800fb90 con 0x7f1ed01497a0 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f0705d8a640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07001da030 0x7f070013cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f7d2bfff640 1 -- 172.21.15.29:0/4180069338 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c032440 con 0x7f7d340afe90 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f0705d8a640 1 -- 172.21.15.29:0/210223808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07001da410 msgr2=0x7f07001da890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f0705d8a640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07001da410 0x7f07001da890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f0705d8a640 1 -- 172.21.15.29:0/210223808 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07001405d0 con 0x7f070013a5f0 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f1ed7111640 1 -- 172.21.15.29:0/2208486548 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed00b18e0 con 0x7f1ed01497a0 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.571+0000 7f1ed7111640 1 -- 172.21.15.29:0/2208486548 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed01f9a10 con 0x7f1ed01497a0 2024-09-13T18:45:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f0704d88640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07001da410 0x7f07001da890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.571+0000 7fc91c7ff640 1 -- 172.21.15.29:0/2293559683 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc91409d770 con 0x7fc914144190 2024-09-13T18:45:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.571+0000 7f0705d8a640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f070013a5f0 0x7f070013aa70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f07000b8210 tx=0x7f06f8003e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.571+0000 7f95f2ffd640 1 -- 172.21.15.29:0/753007614 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f95f4007070 con 0x7f95fc14a4e0 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.570+0000 7f7d39e6b640 1 -- 172.21.15.29:0/4180069338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d341e2cf0 con 0x7f7d340afe90 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.571+0000 7f7d39e6b640 1 -- 172.21.15.29:0/4180069338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d34140710 con 0x7f7d340afe90 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.571+0000 7f7d2bfff640 1 -- 172.21.15.29:0/4180069338 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c03d420 con 0x7f7d340afe90 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.571+0000 7f7d2bfff640 1 -- 172.21.15.29:0/4180069338 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c03d7d0 con 0x7f7d340afe90 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.572+0000 7f7d39e6b640 1 -- 172.21.15.29:0/4180069338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d340b0270 con 0x7f7d340afe90 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.571+0000 7fbecaffd640 1 -- 172.21.15.29:0/1749349063 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbed4003af0 con 0x7fbedc0b38e0 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.572+0000 7f94917fa640 1 -- 172.21.15.29:0/2590487943 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f94940923c0 con 0x7f948c0d0c50 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.572+0000 7fbecaffd640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbebc06ac50 0x7fbebc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.572+0000 7fbecaffd640 1 -- 172.21.15.29:0/1749349063 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbed408a760 con 0x7fbedc0b38e0 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.572+0000 7f1ed7111640 1 -- 172.21.15.29:0/2208486548 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ed009d770 con 0x7f1ed01497a0 2024-09-13T18:45:45.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.572+0000 7fbecaffd640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] conn(0x7fbebc074290 0x7fbebc0766d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.572+0000 7fbecaffd640 1 -- 172.21.15.29:0/1749349063 --> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbebc076da0 con 0x7fbebc074290 2024-09-13T18:45:45.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.572+0000 7fbecaffd640 1 -- 172.21.15.29:0/1749349063 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbed408ac00 con 0x7fbedc0b38e0 2024-09-13T18:45:45.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.572+0000 7f06f5ffb640 1 -- 172.21.15.29:0/210223808 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8007ab0 con 0x7f070013a5f0 2024-09-13T18:45:45.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.572+0000 7f06f5ffb640 1 -- 172.21.15.29:0/210223808 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f8007c30 con 0x7f070013a5f0 2024-09-13T18:45:45.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.572+0000 7f06f5ffb640 1 -- 172.21.15.29:0/210223808 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8015420 con 0x7f070013a5f0 2024-09-13T18:45:45.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.572+0000 7f95f2ffd640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f95e006acd0 0x7f95e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f94917fa640 1 --2- 172.21.15.29:0/2590487943 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f947806ac30 0x7f947806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f07077ed640 1 -- 172.21.15.29:0/210223808 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070013afb0 con 0x7f070013a5f0 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f9498d31640 1 --2- 172.21.15.29:0/2590487943 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f947806ac30 0x7f947806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f07077ed640 1 -- 172.21.15.29:0/210223808 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07001402f0 con 0x7f070013a5f0 2024-09-13T18:45:45.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f960241c640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f95e006acd0 0x7f95e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f95f2ffd640 1 -- 172.21.15.29:0/753007614 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f95f4089cd0 con 0x7f95fc14a4e0 2024-09-13T18:45:45.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f94917fa640 1 -- 172.21.15.29:0/2590487943 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9494102ad0 con 0x7f948c0d0c50 2024-09-13T18:45:45.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f1ecd7fa640 1 -- 172.21.15.29:0/2208486548 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1ec800b040 con 0x7f1ed01497a0 2024-09-13T18:45:45.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f95f2ffd640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] conn(0x7f95e0074310 0x7f95e0076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f95f2ffd640 1 -- 172.21.15.29:0/753007614 --> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95e0076e20 con 0x7f95e0074310 2024-09-13T18:45:45.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f9498d31640 1 --2- 172.21.15.29:0/2590487943 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f947806ac30 0x7f947806d0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9488034000 tx=0x7f948802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f94917fa640 1 --2- 172.21.15.29:0/2590487943 >> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] conn(0x7f9478074270 0x7f94780766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f95f2ffd640 1 -- 172.21.15.29:0/753007614 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95f408a080 con 0x7f95fc14a4e0 2024-09-13T18:45:45.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f960241c640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f95e006acd0 0x7f95e006d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f95f8034000 tx=0x7f95f802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7f7e29c96640 1 -- 172.21.15.29:0/579094368 wait complete. 2024-09-13T18:45:45.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.573+0000 7fc90affd640 1 -- 172.21.15.29:0/2293559683 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc90c038050 con 0x7fc914144190 2024-09-13T18:45:45.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7fbeda59c640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbebc06ac50 0x7fbebc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7fbed9d9b640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] conn(0x7fbebc074290 0x7fbebc0766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7fc90affd640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc8f806acf0 0x7fc8f806d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7f1ecd7fa640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1ebc06ad00 0x7f1ebc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7f94917fa640 1 -- 172.21.15.29:0/2590487943 --> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9478076d80 con 0x7f9478074270 2024-09-13T18:45:45.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7f94917fa640 1 -- 172.21.15.29:0/2590487943 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94941072a0 con 0x7f948c0d0c50 2024-09-13T18:45:45.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7f1ecd7fa640 1 -- 172.21.15.29:0/2208486548 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ec8089f60 con 0x7f1ed01497a0 2024-09-13T18:45:45.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7fc91a59b640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc8f806acf0 0x7fc8f806d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7fc90affd640 1 -- 172.21.15.29:0/2293559683 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc90c0a9ee0 con 0x7fc914144190 2024-09-13T18:45:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7f9493fff640 1 --2- 172.21.15.29:0/2590487943 >> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] conn(0x7f9478074270 0x7f94780766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7f9602c1d640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] conn(0x7f95e0074310 0x7f95e0076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7f7d2bfff640 1 -- 172.21.15.29:0/4180069338 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7d1c039040 con 0x7f7d340afe90 2024-09-13T18:45:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7f1ecd7fa640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] conn(0x7f1ebc074340 0x7f1ebc076780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7f1ecd7fa640 1 -- 172.21.15.29:0/2208486548 --> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ebc076e50 con 0x7f1ebc074340 2024-09-13T18:45:45.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7f1ecd7fa640 1 -- 172.21.15.29:0/2208486548 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ec808c580 con 0x7f1ed01497a0 2024-09-13T18:45:45.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7fc90affd640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] conn(0x7fc8f80741b0 0x7fc8f80765f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7fc90affd640 1 -- 172.21.15.29:0/2293559683 --> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8f8076cc0 con 0x7fc8f80741b0 2024-09-13T18:45:45.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7fc90affd640 1 -- 172.21.15.29:0/2293559683 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc90c008c50 con 0x7fc914144190 2024-09-13T18:45:45.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7f1ecffff640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] conn(0x7f1ebc074340 0x7f1ebc076780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.574+0000 7fc919d9a640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] conn(0x7fc8f80741b0 0x7fc8f80765f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.575+0000 7f9493fff640 1 --2- 172.21.15.29:0/2590487943 >> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] conn(0x7f9478074270 0x7f94780766b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.575+0000 7f7d2bfff640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7d1406ad00 0x7f7d1406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.575+0000 7f7d2bfff640 1 -- 172.21.15.29:0/4180069338 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7d1c0aa7b0 con 0x7f7d340afe90 2024-09-13T18:45:45.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.575+0000 7f1ecffff640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] conn(0x7f1ebc074340 0x7f1ebc076780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.575+0000 7f7d2bfff640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] conn(0x7f7d14074340 0x7f7d14076780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.575+0000 7fc919d9a640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] conn(0x7fc8f80741b0 0x7fc8f80765f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.575+0000 7f7d2bfff640 1 -- 172.21.15.29:0/4180069338 --> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d14076e50 con 0x7f7d14074340 2024-09-13T18:45:45.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.575+0000 7f7d2bfff640 1 -- 172.21.15.29:0/4180069338 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d1c0aab60 con 0x7f7d340afe90 2024-09-13T18:45:45.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.575+0000 7f7e29c96640 1 Processor -- start 2024-09-13T18:45:45.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.575+0000 7f1ed4ead640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1ebc06ad00 0x7f1ebc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.575+0000 7fbed9d9b640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] conn(0x7fbebc074290 0x7fbebc0766d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.575+0000 7fbeda59c640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbebc06ac50 0x7fbebc06d110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbecc034000 tx=0x7fbecc02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.576+0000 7f7d33fff640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] conn(0x7f7d14074340 0x7f7d14076780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.576+0000 7fc91a59b640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc8f806acf0 0x7fc8f806d1b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc914147a90 tx=0x7fc9100090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.576+0000 7f7e29c96640 1 -- start start 2024-09-13T18:45:45.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.576+0000 7f7d32ffd640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7d1406ad00 0x7f7d1406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.576+0000 7fc90affd640 1 -- 172.21.15.29:0/2293559683 <== osd.2 v2:172.21.15.29:6800/3954589082 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc8f8076cc0 con 0x7fc8f80741b0 2024-09-13T18:45:45.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.576+0000 7f07077ed640 1 -- 172.21.15.29:0/210223808 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07000aefe0 con 0x7f070013a5f0 2024-09-13T18:45:45.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.576+0000 7f06f5ffb640 1 -- 172.21.15.29:0/210223808 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f06f8015580 con 0x7f070013a5f0 2024-09-13T18:45:45.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.576+0000 7fbecaffd640 1 -- 172.21.15.29:0/1749349063 <== osd.1 v2:172.21.15.29:6824/2613470093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbebc076da0 con 0x7fbebc074290 2024-09-13T18:45:45.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.576+0000 7f1ecd7fa640 1 -- 172.21.15.29:0/2208486548 <== osd.0 v2:172.21.15.29:6808/2605275306 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1ebc076e50 con 0x7f1ebc074340 2024-09-13T18:45:45.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.576+0000 7f94917fa640 1 -- 172.21.15.29:0/2590487943 <== osd.3 v2:172.21.15.29:6816/286406825 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9478076d80 con 0x7f9478074270 2024-09-13T18:45:45.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.576+0000 7f9602c1d640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] conn(0x7f95e0074310 0x7f95e0076750 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f1ed4ead640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1ebc06ad00 0x7f1ebc06d1c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0034000 tx=0x7f1ec002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f7e29c96640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e240b4250 0x7f7e240706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f7e29c96640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e2413f910 0x7f7e2406d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f7e29c96640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e24146350 0x7f7e240b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f7e29c96640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240702d0 con 0x7f7e24146350 2024-09-13T18:45:45.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f7e29c96640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2406fcc0 con 0x7f7e240b4250 2024-09-13T18:45:45.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f7e29c96640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2406f000 con 0x7f7e2413f910 2024-09-13T18:45:45.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.576+0000 7f7d33fff640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] conn(0x7f7d14074340 0x7f7d14076780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f06f5ffb640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f06e406ad00 0x7f06e406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f7e237fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e240b4250 0x7f7e240706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f7d2bfff640 1 -- 172.21.15.29:0/4180069338 <== osd.7 v2:172.21.15.96:6816/1178210252 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7d14076e50 con 0x7f7d14074340 2024-09-13T18:45:45.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f7e237fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e240b4250 0x7f7e240706f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38618/0 (socket says 172.21.15.29:38618) 2024-09-13T18:45:45.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f7e237fe640 1 -- 172.21.15.29:0/4156443078 learned_addr learned my addr 172.21.15.29:0/4156443078 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f06f5ffb640 1 -- 172.21.15.29:0/210223808 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f06f8089a90 con 0x7f070013a5f0 2024-09-13T18:45:45.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f06f5ffb640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] conn(0x7f06e40742c0 0x7f06e4076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f06f5ffb640 1 -- 172.21.15.29:0/210223808 --> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06e4076dd0 con 0x7f06e40742c0 2024-09-13T18:45:45.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f95f2ffd640 1 -- 172.21.15.29:0/753007614 <== osd.5 v2:172.21.15.96:6824/1577126037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f95e0076e20 con 0x7f95e0074310 2024-09-13T18:45:45.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f7e22ffd640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e2413f910 0x7f7e2406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.577+0000 7f0705589640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f06e406ad00 0x7f06e406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.578+0000 7f0704d88640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] conn(0x7f06e40742c0 0x7f06e4076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.578+0000 7f7e23fff640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e24146350 0x7f7e240b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.578+0000 7f7e237fe640 1 -- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e2413f910 msgr2=0x7f7e2406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.578+0000 7f7e237fe640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e2413f910 0x7f7e2406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.578+0000 7f7e237fe640 1 -- 172.21.15.29:0/4156443078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e24146350 msgr2=0x7f7e240b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.578+0000 7f7e237fe640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e24146350 0x7f7e240b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.578+0000 7f7e237fe640 1 -- 172.21.15.29:0/4156443078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c009400 con 0x7f7e240b4250 2024-09-13T18:45:45.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.578+0000 7f7e23fff640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e24146350 0x7f7e240b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:45.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.578+0000 7f7d32ffd640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7d1406ad00 0x7f7d1406d1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7d34142e40 tx=0x7f7d2400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.578+0000 7f7e237fe640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e240b4250 0x7f7e240706f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009890 tx=0x7f7e1c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.578+0000 7f0704d88640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] conn(0x7f06e40742c0 0x7f06e4076700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.579+0000 7f7e1bfff640 1 -- 172.21.15.29:0/4156443078 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c030bc0 con 0x7f7e240b4250 2024-09-13T18:45:45.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.579+0000 7f06f5ffb640 1 -- 172.21.15.29:0/210223808 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06f80049b0 con 0x7f070013a5f0 2024-09-13T18:45:45.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.579+0000 7f0705589640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f06e406ad00 0x7f06e406d1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06fc033000 tx=0x7f06fc009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.579+0000 7f7e29c96640 1 -- 172.21.15.29:0/4156443078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2406f550 con 0x7f7e240b4250 2024-09-13T18:45:45.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.579+0000 7f7e29c96640 1 -- 172.21.15.29:0/4156443078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2406f270 con 0x7f7e240b4250 2024-09-13T18:45:45.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.579+0000 7f7e1bfff640 1 -- 172.21.15.29:0/4156443078 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c030d20 con 0x7f7e240b4250 2024-09-13T18:45:45.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.579+0000 7f7e1bfff640 1 -- 172.21.15.29:0/4156443078 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c03c640 con 0x7f7e240b4250 2024-09-13T18:45:45.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.580+0000 7f06f5ffb640 1 -- 172.21.15.29:0/210223808 <== osd.4 v2:172.21.15.96:6808/1598807756 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f06e4076dd0 con 0x7f06e40742c0 2024-09-13T18:45:45.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.580+0000 7f7e29c96640 1 -- 172.21.15.29:0/4156443078 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e08000fc0 con 0x7f7e240b4250 2024-09-13T18:45:45.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.581+0000 7f7e1bfff640 1 -- 172.21.15.29:0/4156443078 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e1c03c7a0 con 0x7f7e240b4250 2024-09-13T18:45:45.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.582+0000 7f7e1bfff640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7e0406acd0 0x7f7e0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.583+0000 7f7e1bfff640 1 -- 172.21.15.29:0/4156443078 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e1c0aa470 con 0x7f7e240b4250 2024-09-13T18:45:45.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.583+0000 7f7e1bfff640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] conn(0x7f7e04074310 0x7f7e04076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.583+0000 7f7e1bfff640 1 -- 172.21.15.29:0/4156443078 --> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e04076e20 con 0x7f7e04074310 2024-09-13T18:45:45.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.583+0000 7f7e1bfff640 1 -- 172.21.15.29:0/4156443078 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e1c0aca90 con 0x7f7e240b4250 2024-09-13T18:45:45.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.583+0000 7f7e23fff640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] conn(0x7f7e04074310 0x7f7e04076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.584+0000 7f7e22ffd640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7e0406acd0 0x7f7e0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.584+0000 7f7e23fff640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] conn(0x7f7e04074310 0x7f7e04076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.584+0000 7f7e22ffd640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7e0406acd0 0x7f7e0406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7e241dcb30 tx=0x7f7e1400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.585+0000 7f7e1bfff640 1 -- 172.21.15.29:0/4156443078 <== osd.6 v2:172.21.15.96:6800/2433452864 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7e04076e20 con 0x7f7e04074310 2024-09-13T18:45:45.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.607+0000 7fbee0e2b640 1 -- 172.21.15.29:0/1749349063 --> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbedc0b21c0 con 0x7fbebc074290 2024-09-13T18:45:45.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.608+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 --> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9474002cb0 con 0x7f9478074270 2024-09-13T18:45:45.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.608+0000 7fc91c7ff640 1 -- 172.21.15.29:0/2293559683 --> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc914071100 con 0x7fc8f80741b0 2024-09-13T18:45:45.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.608+0000 7fbecaffd640 1 -- 172.21.15.29:0/1749349063 <== osd.1 v2:172.21.15.29:6824/2613470093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbed00047e0 con 0x7fbebc074290 2024-09-13T18:45:45.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.608+0000 7f9604680640 1 -- 172.21.15.29:0/753007614 --> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95e4002ce0 con 0x7f95e0074310 2024-09-13T18:45:45.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.608+0000 7f7d39e6b640 1 -- 172.21.15.29:0/4180069338 --> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7d34149cb0 con 0x7f7d14074340 2024-09-13T18:45:45.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.608+0000 7fc90affd640 1 -- 172.21.15.29:0/2293559683 <== osd.2 v2:172.21.15.29:6800/3954589082 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc914071100 con 0x7fc8f80741b0 2024-09-13T18:45:45.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.608+0000 7f94917fa640 1 -- 172.21.15.29:0/2590487943 <== osd.3 v2:172.21.15.29:6816/286406825 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9474002cb0 con 0x7f9478074270 2024-09-13T18:45:45.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fbee0e2b640 1 -- 172.21.15.29:0/1749349063 >> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] conn(0x7fbebc074290 msgr2=0x7fbebc0766d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fbee0e2b640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] conn(0x7fbebc074290 0x7fbebc0766d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f7d2bfff640 1 -- 172.21.15.29:0/4180069338 <== osd.7 v2:172.21.15.96:6816/1178210252 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7d2c001280 con 0x7f7d14074340 2024-09-13T18:45:45.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fbee0e2b640 1 -- 172.21.15.29:0/1749349063 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbebc06ac50 msgr2=0x7fbebc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fbee0e2b640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbebc06ac50 0x7fbebc06d110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbecc034000 tx=0x7fbecc02c000 comp rx=0 tx=0).stop 2024-09-13T18:45:45.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fc91c7ff640 1 -- 172.21.15.29:0/2293559683 >> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] conn(0x7fc8f80741b0 msgr2=0x7fc8f80765f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fc91c7ff640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] conn(0x7fc8f80741b0 0x7fc8f80765f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f95f2ffd640 1 -- 172.21.15.29:0/753007614 <== osd.5 v2:172.21.15.96:6824/1577126037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f95e4002ce0 con 0x7f95e0074310 2024-09-13T18:45:45.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 >> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] conn(0x7f9478074270 msgr2=0x7f94780766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f9499d33640 1 --2- 172.21.15.29:0/2590487943 >> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] conn(0x7f9478074270 0x7f94780766b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fbee0e2b640 1 -- 172.21.15.29:0/1749349063 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbedc0b38e0 msgr2=0x7fbedc070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fbee0e2b640 1 --2- 172.21.15.29:0/1749349063 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbedc0b38e0 0x7fbedc070590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009cf0 tx=0x7fbed400c490 comp rx=0 tx=0).stop 2024-09-13T18:45:45.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f7d39e6b640 1 -- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] conn(0x7f7d14074340 msgr2=0x7f7d14076780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f7d39e6b640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] conn(0x7f7d14074340 0x7f7d14076780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fbedad9d640 1 -- 172.21.15.29:0/1749349063 reap_dead start 2024-09-13T18:45:45.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fbee0e2b640 1 -- 172.21.15.29:0/1749349063 shutdown_connections 2024-09-13T18:45:45.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f7d39e6b640 1 -- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7d1406ad00 msgr2=0x7f7d1406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f7d39e6b640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7d1406ad00 0x7f7d1406d1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7d34142e40 tx=0x7f7d2400b040 comp rx=0 tx=0).stop 2024-09-13T18:45:45.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f7d39e6b640 1 -- 172.21.15.29:0/4180069338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d340afe90 msgr2=0x7f7d341e2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f7d39e6b640 1 --2- 172.21.15.29:0/4180069338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d340afe90 0x7f7d341e2590 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c031000 tx=0x7f7d1c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f7d33fff640 1 -- 172.21.15.29:0/4180069338 reap_dead start 2024-09-13T18:45:45.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fbee0e2b640 1 -- 172.21.15.29:0/1749349063 >> 172.21.15.29:0/1749349063 conn(0x7fbedc0b78a0 msgr2=0x7fbedc09afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fc91c7ff640 1 -- 172.21.15.29:0/2293559683 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc8f806acf0 msgr2=0x7fc8f806d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fc91c7ff640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc8f806acf0 0x7fc8f806d1b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc914147a90 tx=0x7fc9100090e0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fc91c7ff640 1 -- 172.21.15.29:0/2293559683 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc914144190 msgr2=0x7fc91406ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7fc91c7ff640 1 --2- 172.21.15.29:0/2293559683 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc914144190 0x7fc91406ed50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc90c030000 tx=0x7fc90c004a40 comp rx=0 tx=0).stop 2024-09-13T18:45:45.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f7d39e6b640 1 -- 172.21.15.29:0/4180069338 shutdown_connections 2024-09-13T18:45:45.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.609+0000 7f7d39e6b640 1 -- 172.21.15.29:0/4180069338 >> 172.21.15.29:0/4180069338 conn(0x7f7d340b71e0 msgr2=0x7f7d340b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7fc91ad9c640 1 -- 172.21.15.29:0/2293559683 reap_dead start 2024-09-13T18:45:45.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7fbee0e2b640 1 -- 172.21.15.29:0/1749349063 shutdown_connections 2024-09-13T18:45:45.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7fbee0e2b640 1 -- 172.21.15.29:0/1749349063 wait complete. 2024-09-13T18:45:45.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f947806ac30 msgr2=0x7f947806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9499d33640 1 --2- 172.21.15.29:0/2590487943 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f947806ac30 0x7f947806d0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9488034000 tx=0x7f948802e000 comp rx=0 tx=0).stop 2024-09-13T18:45:45.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9604680640 1 -- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] conn(0x7f95e0074310 msgr2=0x7f95e0076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f948c0d0c50 msgr2=0x7f948c02fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9499d33640 1 --2- 172.21.15.29:0/2590487943 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f948c0d0c50 0x7f948c02fe50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9494061a70 tx=0x7f94940678c0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9499532640 1 -- 172.21.15.29:0/2590487943 reap_dead start 2024-09-13T18:45:45.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9604680640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] conn(0x7f95e0074310 0x7f95e0076750 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 shutdown_connections 2024-09-13T18:45:45.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 >> 172.21.15.29:0/2590487943 conn(0x7f948c03e310 msgr2=0x7f948c03e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9604680640 1 -- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f95e006acd0 msgr2=0x7f95e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f1ed7111640 1 -- 172.21.15.29:0/2208486548 --> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1ed00b7340 con 0x7f1ebc074340 2024-09-13T18:45:45.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9604680640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f95e006acd0 0x7f95e006d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f95f8034000 tx=0x7f95f802e000 comp rx=0 tx=0).stop 2024-09-13T18:45:45.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7fc91c7ff640 1 -- 172.21.15.29:0/2293559683 shutdown_connections 2024-09-13T18:45:45.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7fc91c7ff640 1 -- 172.21.15.29:0/2293559683 >> 172.21.15.29:0/2293559683 conn(0x7fc9140b3fb0 msgr2=0x7fc9140b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7fc91c7ff640 1 -- 172.21.15.29:0/2293559683 shutdown_connections 2024-09-13T18:45:45.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7fc91c7ff640 1 -- 172.21.15.29:0/2293559683 wait complete. 2024-09-13T18:45:45.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f7d39e6b640 1 -- 172.21.15.29:0/4180069338 shutdown_connections 2024-09-13T18:45:45.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f7d39e6b640 1 -- 172.21.15.29:0/4180069338 wait complete. 2024-09-13T18:45:45.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9604680640 1 -- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95fc14a4e0 msgr2=0x7f95fc14aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9604680640 1 --2- 172.21.15.29:0/753007614 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95fc14a4e0 0x7f95fc14aef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f95f400cbf0 tx=0x7f95f400a430 comp rx=0 tx=0).stop 2024-09-13T18:45:45.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9602c1d640 1 -- 172.21.15.29:0/753007614 reap_dead start 2024-09-13T18:45:45.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 shutdown_connections 2024-09-13T18:45:45.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.610+0000 7f9604680640 1 -- 172.21.15.29:0/753007614 shutdown_connections 2024-09-13T18:45:45.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.611+0000 7f9604680640 1 -- 172.21.15.29:0/753007614 >> 172.21.15.29:0/753007614 conn(0x7f95fc0b71e0 msgr2=0x7f95fc0b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.611+0000 7f9499d33640 1 -- 172.21.15.29:0/2590487943 wait complete. 2024-09-13T18:45:45.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.611+0000 7f9604680640 1 -- 172.21.15.29:0/753007614 shutdown_connections 2024-09-13T18:45:45.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.611+0000 7f9604680640 1 -- 172.21.15.29:0/753007614 wait complete. 2024-09-13T18:45:45.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.611+0000 7f1ecd7fa640 1 -- 172.21.15.29:0/2208486548 <== osd.0 v2:172.21.15.29:6808/2605275306 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1ed00b7340 con 0x7f1ebc074340 2024-09-13T18:45:45.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.611+0000 7f07077ed640 1 -- 172.21.15.29:0/210223808 --> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f07000aed00 con 0x7f06e40742c0 2024-09-13T18:45:45.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.611+0000 7f1ed7111640 1 -- 172.21.15.29:0/2208486548 >> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] conn(0x7f1ebc074340 msgr2=0x7f1ebc076780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.611+0000 7f06f5ffb640 1 -- 172.21.15.29:0/210223808 <== osd.4 v2:172.21.15.96:6808/1598807756 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06f0014410 con 0x7f06e40742c0 2024-09-13T18:45:45.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.611+0000 7f1ed7111640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] conn(0x7f1ebc074340 0x7f1ebc076780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.612+0000 7f06e37fe640 1 -- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] conn(0x7f06e40742c0 msgr2=0x7f06e4076700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.612+0000 7f06e37fe640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] conn(0x7f06e40742c0 0x7f06e4076700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.612+0000 7f1ed7111640 1 -- 172.21.15.29:0/2208486548 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1ebc06ad00 msgr2=0x7f1ebc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.612+0000 7f1ed7111640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1ebc06ad00 0x7f1ebc06d1c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0034000 tx=0x7f1ec002c000 comp rx=0 tx=0).stop 2024-09-13T18:45:45.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.612+0000 7f1ed7111640 1 -- 172.21.15.29:0/2208486548 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ed01497a0 msgr2=0x7f1ed0071040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.612+0000 7f1ed7111640 1 --2- 172.21.15.29:0/2208486548 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ed01497a0 0x7f1ed0071040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800cd80 tx=0x7f1ec800a650 comp rx=0 tx=0).stop 2024-09-13T18:45:45.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.613+0000 7f06e37fe640 1 -- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f06e406ad00 msgr2=0x7f06e406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.613+0000 7f06e37fe640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f06e406ad00 0x7f06e406d1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06fc033000 tx=0x7f06fc009030 comp rx=0 tx=0).stop 2024-09-13T18:45:45.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.613+0000 7f06e37fe640 1 -- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f070013a5f0 msgr2=0x7f070013aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.613+0000 7f06e37fe640 1 --2- 172.21.15.29:0/210223808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f070013a5f0 0x7f070013aa70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f07000b8210 tx=0x7f06f8003e00 comp rx=0 tx=0).stop 2024-09-13T18:45:45.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.613+0000 7f0705d8a640 1 -- 172.21.15.29:0/210223808 reap_dead start 2024-09-13T18:45:45.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.613+0000 7f1ed56ae640 1 -- 172.21.15.29:0/2208486548 reap_dead start 2024-09-13T18:45:45.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.613+0000 7f06e37fe640 1 -- 172.21.15.29:0/210223808 shutdown_connections 2024-09-13T18:45:45.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.613+0000 7f06e37fe640 1 -- 172.21.15.29:0/210223808 >> 172.21.15.29:0/210223808 conn(0x7f07000b71e0 msgr2=0x7f07000b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.613+0000 7f1ed7111640 1 -- 172.21.15.29:0/2208486548 shutdown_connections 2024-09-13T18:45:45.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.613+0000 7f1ed7111640 1 -- 172.21.15.29:0/2208486548 >> 172.21.15.29:0/2208486548 conn(0x7f1ed00b3fb0 msgr2=0x7f1ed00ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.614+0000 7f1ed7111640 1 -- 172.21.15.29:0/2208486548 shutdown_connections 2024-09-13T18:45:45.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.614+0000 7f1ed7111640 1 -- 172.21.15.29:0/2208486548 wait complete. 2024-09-13T18:45:45.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.614+0000 7f06e37fe640 1 -- 172.21.15.29:0/210223808 shutdown_connections 2024-09-13T18:45:45.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.614+0000 7f06e37fe640 1 -- 172.21.15.29:0/210223808 wait complete. 2024-09-13T18:45:45.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.615+0000 7f7e29c96640 1 -- 172.21.15.29:0/4156443078 --> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e08002cb0 con 0x7f7e04074310 2024-09-13T18:45:45.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.615+0000 7f7e1bfff640 1 -- 172.21.15.29:0/4156443078 <== osd.6 v2:172.21.15.96:6800/2433452864 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7e08002cb0 con 0x7f7e04074310 2024-09-13T18:45:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.616+0000 7f7e19ffb640 1 -- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] conn(0x7f7e04074310 msgr2=0x7f7e04076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.616+0000 7f7e19ffb640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] conn(0x7f7e04074310 0x7f7e04076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.617+0000 7f7e19ffb640 1 -- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7e0406acd0 msgr2=0x7f7e0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.617+0000 7f7e19ffb640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7e0406acd0 0x7f7e0406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7e241dcb30 tx=0x7f7e1400b040 comp rx=0 tx=0).stop 2024-09-13T18:45:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.617+0000 7f7e19ffb640 1 -- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e240b4250 msgr2=0x7f7e240706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.617+0000 7f7e19ffb640 1 --2- 172.21.15.29:0/4156443078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e240b4250 0x7f7e240706f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009890 tx=0x7f7e1c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.617+0000 7f7e23fff640 1 -- 172.21.15.29:0/4156443078 reap_dead start 2024-09-13T18:45:45.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.619+0000 7f7e19ffb640 1 -- 172.21.15.29:0/4156443078 shutdown_connections 2024-09-13T18:45:45.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.619+0000 7f7e19ffb640 1 -- 172.21.15.29:0/4156443078 >> 172.21.15.29:0/4156443078 conn(0x7f7e240bb400 msgr2=0x7f7e240b5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.619+0000 7f7e19ffb640 1 -- 172.21.15.29:0/4156443078 shutdown_connections 2024-09-13T18:45:45.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.619+0000 7f7e19ffb640 1 -- 172.21.15.29:0/4156443078 wait complete. 2024-09-13T18:45:45.678 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-09-13T18:45:45.678 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-09-13T18:45:45.679 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-09-13T18:45:45.680 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:45:45.680 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:45:45.681 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:45:45.682 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-09-13T18:45:45.682 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:45:45.683 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-09-13T18:45:45.683 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:45:45.684 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-09-13T18:45:45.684 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:45:45.685 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-09-13T18:45:45.685 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:45:45.686 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-09-13T18:45:45.686 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.891+0000 7fb64da9f640 1 Processor -- start 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.891+0000 7fb64da9f640 1 -- start start 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7fb64da9f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480aec00 0x7fb648143800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7fb64da9f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb6480b0e60 0x7fb648143d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7fb64da9f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb648149c80 con 0x7fb6480affc0 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7fb64da9f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb648144280 con 0x7fb6480b0e60 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7fb64da9f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6480b03a0 con 0x7fb6480aec00 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7fb64ca9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fb6480affc0 0x7fb64814a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:53172/0 (socket says 172.21.15.29:53172) 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7fb64ca9d640 1 -- 172.21.15.29:0/3530660998 learned_addr learned my addr 172.21.15.29:0/3530660998 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7fb647fff640 1 --2- 172.21.15.29:0/3530660998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480aec00 0x7fb648143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.892+0000 7f50cda72640 1 Processor -- start 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7fb64d29e640 1 --2- 172.21.15.29:0/3530660998 >> v2:172.21.15.96:3300/0 conn(0x7fb6480b0e60 0x7fb648143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.892+0000 7f50cda72640 1 -- start start 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7fb6477fe640 1 -- 172.21.15.29:0/3530660998 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904232510 0 0) 0x7fb648149c80 con 0x7fb6480affc0 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7f50cda72640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f50c0006c90 0x7f50c001aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7f50cda72640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f50c001f0d0 0x7f50c001f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7f50cda72640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c001c550 con 0x7f50c00d0930 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7f50cda72640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c001c350 con 0x7f50c0006c90 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.893+0000 7f50cda72640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c0027ac0 con 0x7f50c001f0d0 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7fae38b33640 1 Processor -- start 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7f96a4e19640 1 Processor -- start 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7fb6477fe640 1 -- 172.21.15.29:0/3530660998 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb638003520 con 0x7fb6480affc0 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7f96a4e19640 1 -- start start 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7fb647fff640 1 -- 172.21.15.29:0/3530660998 >> v2:172.21.15.96:3300/0 conn(0x7fb6480b0e60 msgr2=0x7fb648143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7fb647fff640 1 --2- 172.21.15.29:0/3530660998 >> v2:172.21.15.96:3300/0 conn(0x7fb6480b0e60 0x7fb648143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7fb647fff640 1 -- 172.21.15.29:0/3530660998 >> v1:172.21.15.96:6789/0 conn(0x7fb6480affc0 legacy=0x7fb64814a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7fb647fff640 1 -- 172.21.15.29:0/3530660998 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6480b1390 con 0x7fb6480aec00 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7fae38b33640 1 -- start start 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7f50c6ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f50c00d0930 0x7f50c00d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:53186/0 (socket says 172.21.15.29:53186) 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7f50c7fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f50c001f0d0 0x7f50c001f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7f50c7fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f50c001f0d0 0x7f50c001f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38634/0 (socket says 172.21.15.29:38634) 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7f50c6ffd640 1 -- 172.21.15.29:0/1756250024 learned_addr learned my addr 172.21.15.29:0/1756250024 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7f50c67fc640 1 -- 172.21.15.29:0/1756250024 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575038908 0 0) 0x7f50c001c550 con 0x7f50c00d0930 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7f50c67fc640 1 -- 172.21.15.29:0/1756250024 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b8003520 con 0x7f50c00d0930 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7f13dcd5e640 1 Processor -- start 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.894+0000 7f13dcd5e640 1 -- start start 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7fae38b33640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fae34066de0 0x7fae340b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7fae38b33640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae340b6500 0x7fae34141e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7fae38b33640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae340b73b0 con 0x7fae340b4580 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7fae38b33640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae340b49f0 con 0x7fae34066de0 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7fae38b33640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae340b2350 con 0x7fae340b6500 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7fae337fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fae34066de0 0x7fae340b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7fae337fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fae34066de0 0x7fae340b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40760/0 (socket says 172.21.15.29:40760) 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7fae337fe640 1 -- 172.21.15.29:0/405345161 learned_addr learned my addr 172.21.15.29:0/405345161 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7fae33fff640 1 --2- 172.21.15.29:0/405345161 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae340b6500 0x7fae34141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7f50c7fff640 1 -- 172.21.15.29:0/1756250024 >> v2:172.21.15.29:3300/0 conn(0x7f50c0006c90 msgr2=0x7f50c001aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7f50c67fc640 1 -- 172.21.15.29:0/1756250024 <== mon.1 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3062460437 0 0) 0x7f50b8003520 con 0x7f50c00d0930 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7f50c7fff640 1 --2- 172.21.15.29:0/1756250024 >> v2:172.21.15.29:3300/0 conn(0x7f50c0006c90 0x7f50c001aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7f50c7fff640 1 -- 172.21.15.29:0/1756250024 >> v1:172.21.15.96:6789/0 conn(0x7f50c00d0930 legacy=0x7f50c00d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7f50c7fff640 1 -- 172.21.15.29:0/1756250024 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c001fa80 con 0x7f50c001f0d0 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7f96a4e19640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9698037d10 0x7f96980c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7f13dcd5e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f13d80b6760 0x7f13d814a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7f13dcd5e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f13d80b5b70 0x7f13d814a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7f13dcd5e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d80b6b40 con 0x7f13d80b70a0 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7f13dcd5e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d80b2830 con 0x7f13d80b5b70 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.895+0000 7f13dcd5e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d814a080 con 0x7f13d80b6760 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f969dd9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9698037d10 0x7f96980c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f969e59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9698037070 0x7f9698035110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:53210/0 (socket says 172.21.15.29:53210) 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f969dd9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9698037d10 0x7f96980c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40766/0 (socket says 172.21.15.29:40766) 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f96a4e19640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9698036470 0x7f96980d45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f13d5d9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f13d80b70a0 0x7f13d81470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:53224/0 (socket says 172.21.15.29:53224) 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f13d5d9b640 1 -- 172.21.15.29:0/4028928730 learned_addr learned my addr 172.21.15.29:0/4028928730 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7fb647fff640 1 --2- 172.21.15.29:0/3530660998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480aec00 0x7fb648143800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb6340097a0 tx=0x7fb63402a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd690b2181133241 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f13d6d9d640 1 --2- 172.21.15.29:0/4028928730 >> v2:172.21.15.96:3300/0 conn(0x7f13d80b5b70 0x7f13d814a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7fae337fe640 1 -- 172.21.15.29:0/405345161 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae340b6500 msgr2=0x7fae34141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7fae337fe640 1 --2- 172.21.15.29:0/405345161 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae340b6500 0x7fae34141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7fae337fe640 1 -- 172.21.15.29:0/405345161 >> v1:172.21.15.96:6789/0 conn(0x7fae340b4580 legacy=0x7fae340b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7fae337fe640 1 -- 172.21.15.29:0/405345161 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae340b3400 con 0x7fae34066de0 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f96a4e19640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96980ca290 con 0x7f9698037070 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f96a4e19640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9698038d40 con 0x7f9698037d10 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f969e59c640 1 -- 172.21.15.29:0/2392504105 learned_addr learned my addr 172.21.15.29:0/2392504105 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f96a4e19640 1 -- 172.21.15.29:0/2392504105 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969802b910 con 0x7f9698036470 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7fae33fff640 1 --2- 172.21.15.29:0/405345161 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae340b6500 0x7fae34141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f969ed9d640 1 --2- 172.21.15.29:0/2392504105 >> v2:172.21.15.96:3300/0 conn(0x7f9698036470 0x7f96980d45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f13d659c640 1 --2- 172.21.15.29:0/4028928730 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f13d80b6760 0x7f13d814a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7f50c7fff640 1 --2- 172.21.15.29:0/1756250024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50c001f0d0 0x7f50c001f540 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f50c8068a50 tx=0x7f50c80a4010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=677b78af187421fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7fb6477fe640 1 -- 172.21.15.29:0/3530660998 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63402add0 con 0x7fb6480aec00 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7fb6477fe640 1 -- 172.21.15.29:0/3530660998 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634032440 con 0x7fb6480aec00 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.896+0000 7fb6477fe640 1 -- 172.21.15.29:0/3530660998 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634032810 con 0x7fb6480aec00 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7f50c67fc640 1 -- 172.21.15.29:0/1756250024 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4001690 con 0x7f50c001f0d0 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7f50c67fc640 1 -- 172.21.15.29:0/1756250024 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c80a4b60 con 0x7f50c001f0d0 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7f969dd9b640 1 -- 172.21.15.29:0/2392504105 >> v2:172.21.15.96:3300/0 conn(0x7f9698036470 msgr2=0x7f96980d45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7f969dd9b640 1 --2- 172.21.15.29:0/2392504105 >> v2:172.21.15.96:3300/0 conn(0x7f9698036470 0x7f96980d45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7f969dd9b640 1 -- 172.21.15.29:0/2392504105 >> v1:172.21.15.96:6789/0 conn(0x7f9698037070 legacy=0x7f9698035110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7f969dd9b640 1 -- 172.21.15.29:0/2392504105 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9698037450 con 0x7f9698037d10 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7fb64da9f640 1 -- 172.21.15.29:0/3530660998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480aec00 msgr2=0x7fb648143800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7fb64da9f640 1 --2- 172.21.15.29:0/3530660998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480aec00 0x7fb648143800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb6340097a0 tx=0x7fb63402a080 comp rx=0 tx=0).stop 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7fb64da9f640 1 -- 172.21.15.29:0/3530660998 shutdown_connections 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7fb64da9f640 1 --2- 172.21.15.29:0/3530660998 >> v2:172.21.15.96:3300/0 conn(0x7fb6480b0e60 0x7fb648143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7fb64da9f640 1 --2- 172.21.15.29:0/3530660998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480aec00 0x7fb648143800 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb6340097a0 tx=0x7fb63402a080 comp rx=0 tx=0).stop 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7fc2348d7640 1 Processor -- start 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7fc2348d7640 1 -- start start 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7fb64da9f640 1 -- 172.21.15.29:0/3530660998 >> 172.21.15.29:0/3530660998 conn(0x7fb6480b7250 msgr2=0x7fb6480b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7f13d6d9d640 1 -- 172.21.15.29:0/4028928730 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f13d80b6760 msgr2=0x7f13d814a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7f13d6d9d640 1 --2- 172.21.15.29:0/4028928730 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f13d80b6760 0x7f13d814a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7f13d6d9d640 1 -- 172.21.15.29:0/4028928730 >> v1:172.21.15.96:6789/0 conn(0x7f13d80b70a0 legacy=0x7f13d81470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.897+0000 7f13d6d9d640 1 -- 172.21.15.29:0/4028928730 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d80b5420 con 0x7f13d80b5b70 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f50c67fc640 1 -- 172.21.15.29:0/1756250024 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c80ac440 con 0x7f50c001f0d0 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f50cda72640 1 -- 172.21.15.29:0/1756250024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50c001f0d0 msgr2=0x7f50c001f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f50cda72640 1 --2- 172.21.15.29:0/1756250024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50c001f0d0 0x7f50c001f540 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f50c8068a50 tx=0x7f50c80a4010 comp rx=0 tx=0).stop 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7fae337fe640 1 --2- 172.21.15.29:0/405345161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae34066de0 0x7fae340b4040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009e50 tx=0x7fae2c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a4e02afe623c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f13d6d9d640 1 --2- 172.21.15.29:0/4028928730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80b5b70 0x7f13d814a9f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009d90 tx=0x7f13d002a4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39db2d66619751c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f50cda72640 1 -- 172.21.15.29:0/1756250024 shutdown_connections 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f50cda72640 1 --2- 172.21.15.29:0/1756250024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50c001f0d0 0x7f50c001f540 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f50cda72640 1 --2- 172.21.15.29:0/1756250024 >> v2:172.21.15.29:3300/0 conn(0x7f50c0006c90 0x7f50c001aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f50cda72640 1 -- 172.21.15.29:0/1756250024 >> 172.21.15.29:0/1756250024 conn(0x7f50c0009030 msgr2=0x7f50c0009440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f0f60e67640 1 Processor -- start 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f50cda72640 1 -- 172.21.15.29:0/1756250024 shutdown_connections 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f969dd9b640 1 --2- 172.21.15.29:0/2392504105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698037d10 0x7f96980c9d50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f96a0068a50 tx=0x7f96a00a4030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b4856270704eea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f50cda72640 1 -- 172.21.15.29:0/1756250024 wait complete. 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7fae327fc640 1 -- 172.21.15.29:0/405345161 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c031600 con 0x7fae34066de0 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7fae327fc640 1 -- 172.21.15.29:0/405345161 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c02d050 con 0x7fae34066de0 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7fae327fc640 1 -- 172.21.15.29:0/405345161 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c031980 con 0x7fae34066de0 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f969d59a640 1 -- 172.21.15.29:0/2392504105 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00a4e40 con 0x7f9698037d10 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f13d559a640 1 -- 172.21.15.29:0/4028928730 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0007740 con 0x7f13d80b5b70 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7f13d559a640 1 -- 172.21.15.29:0/4028928730 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d002d050 con 0x7f13d80b5b70 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7f969d59a640 1 -- 172.21.15.29:0/2392504105 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a00ac440 con 0x7f9698037d10 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7f969d59a640 1 -- 172.21.15.29:0/2392504105 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00ac830 con 0x7f9698037d10 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7f13d559a640 1 -- 172.21.15.29:0/4028928730 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0007ac0 con 0x7f13d80b5b70 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7fc2348d7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc23006fb60 0x7fc23013c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7fc2348d7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc23013c800 0x7fc230069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7fc2348d7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc230142860 con 0x7fc230071030 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7fc2348d7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc230143400 con 0x7fc23006fb60 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7fc2348d7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc230142530 con 0x7fc23013c800 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7fb64da9f640 1 -- 172.21.15.29:0/3530660998 shutdown_connections 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7fc22dd9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc23006fb60 0x7fc23013c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7fc22dd9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc23006fb60 0x7fc23013c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40772/0 (socket says 172.21.15.29:40772) 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7fc22dd9b640 1 -- 172.21.15.29:0/795367319 learned_addr learned my addr 172.21.15.29:0/795367319 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7fc22ed9d640 1 --2- 172.21.15.29:0/795367319 >> v2:172.21.15.96:3300/0 conn(0x7fc23013c800 0x7fc230069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.898+0000 7f0f60e67640 1 -- start start 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7f0f60e67640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f54038ca0 0x7f0f5403a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7f0f60e67640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f54039430 con 0x7f0f5403a4a0 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7f0f5b7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0f5403a4a0 0x7f0f540cf9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54378/0 (socket says 172.21.15.29:54378) 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7fb64da9f640 1 -- 172.21.15.29:0/3530660998 wait complete. 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7fc22ed9d640 1 -- 172.21.15.29:0/795367319 >> v2:172.21.15.29:3300/0 conn(0x7fc23006fb60 msgr2=0x7fc23013c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7fc22ed9d640 1 --2- 172.21.15.29:0/795367319 >> v2:172.21.15.29:3300/0 conn(0x7fc23006fb60 0x7fc23013c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7fc22ed9d640 1 -- 172.21.15.29:0/795367319 >> v1:172.21.15.96:6789/0 conn(0x7fc230071030 legacy=0x7fc230142cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7fc22ed9d640 1 -- 172.21.15.29:0/795367319 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc230071410 con 0x7fc23013c800 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7fae38b33640 1 -- 172.21.15.29:0/405345161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae34066de0 msgr2=0x7fae340b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7fae38b33640 1 --2- 172.21.15.29:0/405345161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae34066de0 0x7fae340b4040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009e50 tx=0x7fae2c02a6d0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f50cda72640 1 Processor -- start 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f13dcd5e640 1 -- 172.21.15.29:0/4028928730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80b5b70 msgr2=0x7f13d814a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f13dcd5e640 1 --2- 172.21.15.29:0/4028928730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80b5b70 0x7f13d814a9f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009d90 tx=0x7f13d002a4e0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f13dcd5e640 1 -- 172.21.15.29:0/4028928730 shutdown_connections 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f13dcd5e640 1 --2- 172.21.15.29:0/4028928730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80b5b70 0x7f13d814a9f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f13dcd5e640 1 --2- 172.21.15.29:0/4028928730 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f13d80b6760 0x7f13d814a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f13dcd5e640 1 -- 172.21.15.29:0/4028928730 >> 172.21.15.29:0/4028928730 conn(0x7f13d8099230 msgr2=0x7f13d8099640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7fae38b33640 1 -- 172.21.15.29:0/405345161 shutdown_connections 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7fae38b33640 1 --2- 172.21.15.29:0/405345161 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae340b6500 0x7fae34141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7fae38b33640 1 --2- 172.21.15.29:0/405345161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae34066de0 0x7fae340b4040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7fae38b33640 1 -- 172.21.15.29:0/405345161 >> 172.21.15.29:0/405345161 conn(0x7fae340b7690 msgr2=0x7fae340b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f50cda72640 1 -- start start 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7f0f60e67640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f54039190 con 0x7f0f54037b90 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7f0f5b7fe640 1 -- 172.21.15.29:0/2150085475 learned_addr learned my addr 172.21.15.29:0/2150085475 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.899+0000 7f0f60e67640 1 -- 172.21.15.29:0/2150085475 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f540cf4f0 con 0x7f0f54038ca0 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f13dcd5e640 1 -- 172.21.15.29:0/4028928730 shutdown_connections 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390846920 0 0) 0x7f0f54039430 con 0x7f0f5403a4a0 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f4c003520 con 0x7f0f5403a4a0 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1174961466 0 0) 0x7f0f4c003520 con 0x7f0f5403a4a0 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 >> v2:172.21.15.29:3300/0 conn(0x7f0f54038ca0 msgr2=0x7f0f5403a880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7fae38b33640 1 -- 172.21.15.29:0/405345161 shutdown_connections 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7fae38b33640 1 -- 172.21.15.29:0/405345161 wait complete. 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.900+0000 7f13dcd5e640 1 -- 172.21.15.29:0/4028928730 wait complete. 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7fb64da9f640 1 Processor -- start 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f96a4e19640 1 -- 172.21.15.29:0/2392504105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698037d10 msgr2=0x7f96980c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f96a4e19640 1 --2- 172.21.15.29:0/2392504105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698037d10 0x7f96980c9d50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f96a0068a50 tx=0x7f96a00a4030 comp rx=0 tx=0).stop 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7fc22ed9d640 1 --2- 172.21.15.29:0/795367319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc23013c800 0x7fc230069ed0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2300af880 tx=0x7fc22802a590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2167af9f36d7c686 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f50cda72640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50c0006c90 0x7f50c00cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f50cda72640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50c001f0d0 0x7f50c00cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f50cda72640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50c00d0930 0x7f50c0165bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f50cda72640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0033650 con 0x7f50c0006c90 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f50cda72640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00cd2e0 con 0x7f50c001f0d0 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f50cda72640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00ccc90 con 0x7f50c00d0930 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f50c7fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50c00d0930 0x7f50c0165bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7fb64da9f640 1 -- start start 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7fc22d59a640 1 -- 172.21.15.29:0/795367319 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228007740 con 0x7fc23013c800 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f50c6ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50c001f0d0 0x7f50c00cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7fc22d59a640 1 -- 172.21.15.29:0/795367319 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22802d050 con 0x7fc23013c800 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f96a4e19640 1 -- 172.21.15.29:0/2392504105 shutdown_connections 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f96a4e19640 1 --2- 172.21.15.29:0/2392504105 >> v2:172.21.15.96:3300/0 conn(0x7f9698036470 0x7f96980d45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f96a4e19640 1 --2- 172.21.15.29:0/2392504105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698037d10 0x7f96980c9d50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f96a4e19640 1 -- 172.21.15.29:0/2392504105 >> 172.21.15.29:0/2392504105 conn(0x7f969803c300 msgr2=0x7f969803c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f50c7fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50c00d0930 0x7f50c0165bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44120/0 (socket says 172.21.15.29:44120) 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f0f5affd640 1 --2- 172.21.15.29:0/2150085475 >> v2:172.21.15.29:3300/0 conn(0x7f0f54038ca0 0x7f0f5403a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.901+0000 7f50c7fff640 1 -- 172.21.15.29:0/1944492777 learned_addr learned my addr 172.21.15.29:0/1944492777 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f50c6ffd640 1 -- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50c00d0930 msgr2=0x7f50c0165bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f50c6ffd640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50c00d0930 0x7f50c0165bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f50c6ffd640 1 -- 172.21.15.29:0/1944492777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50c0006c90 msgr2=0x7f50c00cbe20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f0f5a7fc640 1 --2- 172.21.15.29:0/2150085475 >> v2:172.21.15.29:3300/0 conn(0x7f0f54038ca0 0x7f0f5403a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7fae38b33640 1 Processor -- start 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 >> v1:172.21.15.96:6789/0 conn(0x7f0f54037b90 legacy=0x7f0f54038000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5403ba00 con 0x7f0f5403a4a0 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f0f50001650 con 0x7f0f5403a4a0 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 >> v1:172.21.15.29:6789/0 conn(0x7f0f5403a4a0 legacy=0x7f0f540cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f0f5a7fc640 1 --2- 172.21.15.29:0/2150085475 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f4c003970 0x7f0f4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f0f5a7fc640 1 --2- 172.21.15.29:0/2150085475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f4c0047c0 0x7f0f4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f0f5a7fc640 1 --2- 172.21.15.29:0/2150085475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f4c0051d0 0x7f0f4c014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540cf4f0 con 0x7f0f4c0047c0 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c014930 con 0x7f0f4c0051d0 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c014af0 con 0x7f0f4c003970 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7fc22d59a640 1 -- 172.21.15.29:0/795367319 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228007ac0 con 0x7fc23013c800 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f50c77fe640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50c0006c90 0x7f50c00cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7fb64da9f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6480affc0 0x7fb648071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f0f5affd640 1 --2- 172.21.15.29:0/2150085475 >> v2:172.21.15.29:3300/0 conn(0x7f0f54038ca0 0x7f0f5403a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7fb64da9f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480b0e60 0x7fb64806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f50c6ffd640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50c0006c90 0x7f50c00cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f50c6ffd640 1 -- 172.21.15.29:0/1944492777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00ccf70 con 0x7f50c001f0d0 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7fb64da9f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6481e2880 0x7fb6481e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7f50c77fe640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50c0006c90 0x7f50c00cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7fb64da9f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb648071ac0 con 0x7fb6480affc0 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7fb64da9f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64813fc10 con 0x7fb6481e2880 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7fb64da9f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb648070810 con 0x7fb6480b0e60 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7f0f5affd640 1 --2- 172.21.15.29:0/2150085475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f4c0047c0 0x7f0f4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7f50c6ffd640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50c001f0d0 0x7f50c00cc550 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50c001c6e0 tx=0x7f50b400c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fc2348d7640 1 -- 172.21.15.29:0/795367319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc23013c800 msgr2=0x7fc230069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fc2348d7640 1 --2- 172.21.15.29:0/795367319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc23013c800 0x7fc230069ed0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2300af880 tx=0x7fc22802a590 comp rx=0 tx=0).stop 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fc2348d7640 1 -- 172.21.15.29:0/795367319 shutdown_connections 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fc2348d7640 1 --2- 172.21.15.29:0/795367319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc23013c800 0x7fc230069ed0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fc2348d7640 1 --2- 172.21.15.29:0/795367319 >> v2:172.21.15.29:3300/0 conn(0x7fc23006fb60 0x7fc23013c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fc2348d7640 1 -- 172.21.15.29:0/795367319 >> 172.21.15.29:0/795367319 conn(0x7fc2300b82f0 msgr2=0x7fc2300b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fb64ca9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6480affc0 0x7fb648071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fb647fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480b0e60 0x7fb64806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fb64ca9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6480affc0 0x7fb648071280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40808/0 (socket says 172.21.15.29:40808) 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fb647fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480b0e60 0x7fb64806e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44136/0 (socket says 172.21.15.29:44136) 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fb64ca9d640 1 -- 172.21.15.29:0/1333904606 learned_addr learned my addr 172.21.15.29:0/1333904606 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fb64d29e640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6481e2880 0x7fb6481e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f13dcd5e640 1 Processor -- start 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7f13dcd5e640 1 -- start start 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fc2348d7640 1 -- 172.21.15.29:0/795367319 shutdown_connections 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.902+0000 7fae38b33640 1 -- start start 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fc2348d7640 1 -- 172.21.15.29:0/795367319 wait complete. 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7f50b3fff640 1 -- 172.21.15.29:0/1944492777 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b40074e0 con 0x7f50c001f0d0 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fae38b33640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae34066de0 0x7fae34134500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fb647fff640 1 -- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6481e2880 msgr2=0x7fb6481e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fb647fff640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6481e2880 0x7fb6481e2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fb647fff640 1 -- 172.21.15.29:0/1333904606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6480affc0 msgr2=0x7fb648071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fb647fff640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6480affc0 0x7fb648071280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fb647fff640 1 -- 172.21.15.29:0/1333904606 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb634009400 con 0x7fb6480b0e60 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7fae38b33640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae340b4580 0x7fae3412f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7f0f5bfff640 1 --2- 172.21.15.29:0/2150085475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f4c0051d0 0x7f0f4c014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7f0f5bfff640 1 -- 172.21.15.29:0/2150085475 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f4c003970 msgr2=0x7f0f4c003d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7f0f5bfff640 1 --2- 172.21.15.29:0/2150085475 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f4c003970 0x7f0f4c003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7f0f5bfff640 1 -- 172.21.15.29:0/2150085475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f4c0047c0 msgr2=0x7f0f4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7f96a4e19640 1 -- 172.21.15.29:0/2392504105 shutdown_connections 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7f0f5bfff640 1 --2- 172.21.15.29:0/2150085475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f4c0047c0 0x7f0f4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7f0f5bfff640 1 -- 172.21.15.29:0/2150085475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5403ba00 con 0x7f0f4c0051d0 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.903+0000 7f50cda72640 1 -- 172.21.15.29:0/1944492777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c0033ad0 con 0x7f50c001f0d0 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7f50cda72640 1 -- 172.21.15.29:0/1944492777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c0166110 con 0x7f50c001f0d0 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7f50b3fff640 1 -- 172.21.15.29:0/1944492777 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4007640 con 0x7f50c001f0d0 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7f13dcd5e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80b5b70 0x7f13d8142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f0f5bfff640 1 -- 172.21.15.29:0/2150085475 reap_dead start 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7fb647fff640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480b0e60 0x7fb64806e870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb634031000 tx=0x7fb6340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7fb6457fa640 1 -- 172.21.15.29:0/1333904606 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634004230 con 0x7fb6480b0e60 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7fb6457fa640 1 -- 172.21.15.29:0/1333904606 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634004390 con 0x7fb6480b0e60 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7fb64da9f640 1 -- 172.21.15.29:0/1333904606 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb648070af0 con 0x7fb6480b0e60 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7fb6457fa640 1 -- 172.21.15.29:0/1333904606 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63403d850 con 0x7fb6480b0e60 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7fb64da9f640 1 -- 172.21.15.29:0/1333904606 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64814d700 con 0x7fb6480b0e60 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7f13dcd5e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d80b6760 0x7f13d81e2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f0f5affd640 1 --2- 172.21.15.29:0/2150085475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f4c0047c0 0x7f0f4c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7f13dcd5e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f13d80b70a0 0x7f13d81e34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7f13dcd5e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d813f740 con 0x7f13d80b6760 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7fae337fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae34066de0 0x7fae34134500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7fae337fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae34066de0 0x7fae34134500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38688/0 (socket says 172.21.15.29:38688) 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fae38b33640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae340b6500 0x7fae34142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fae38b33640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae341456b0 con 0x7fae340b6500 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fae38b33640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3412fb80 con 0x7fae34066de0 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fae38b33640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3412ec60 con 0x7fae340b4580 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fae337fe640 1 -- 172.21.15.29:0/637133889 learned_addr learned my addr 172.21.15.29:0/637133889 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fae32ffd640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae340b4580 0x7fae3412f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f0798153640 1 Processor -- start 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7f13dcd5e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d813e390 con 0x7f13d80b5b70 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.904+0000 7f13dcd5e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d813e670 con 0x7f13d80b70a0 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f13d5d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d80b6760 0x7f13d81e2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f13d5d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d80b6760 0x7f13d81e2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40820/0 (socket says 172.21.15.29:40820) 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f13d5d9b640 1 -- 172.21.15.29:0/3958325133 learned_addr learned my addr 172.21.15.29:0/3958325133 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f13d6d9d640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f13d80b70a0 0x7f13d81e34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f13d659c640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80b5b70 0x7f13d8142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f13d5d9b640 1 -- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f13d80b70a0 msgr2=0x7f13d81e34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f13d5d9b640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f13d80b70a0 0x7f13d81e34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f13d5d9b640 1 -- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80b5b70 msgr2=0x7f13d8142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f13d5d9b640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80b5b70 0x7f13d8142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f13d5d9b640 1 -- 172.21.15.29:0/3958325133 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0009a70 con 0x7f13d80b6760 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fae337fe640 1 -- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae340b4580 msgr2=0x7fae3412f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fae337fe640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae340b4580 0x7fae3412f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fae337fe640 1 -- 172.21.15.29:0/637133889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae340b6500 msgr2=0x7fae34142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fae337fe640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae340b6500 0x7fae34142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fae337fe640 1 -- 172.21.15.29:0/637133889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28009400 con 0x7fae34066de0 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fb64da9f640 1 -- 172.21.15.29:0/1333904606 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64814a7d0 con 0x7fb6480b0e60 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f96a4e19640 1 -- 172.21.15.29:0/2392504105 wait complete. 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f0798153640 1 -- start start 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7f50b3fff640 1 -- 172.21.15.29:0/1944492777 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b40049e0 con 0x7f50c001f0d0 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7f0f5bfff640 1 --2- 172.21.15.29:0/2150085475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f4c0051d0 0x7f0f4c014190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c074a20 tx=0x7f0f4c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c58b8f28849c7654 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7f50cda72640 1 -- 172.21.15.29:0/1944492777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a8005250 con 0x7f50c001f0d0 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fae337fe640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae34066de0 0x7fae34134500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009e50 tx=0x7fae2c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7f13d5d9b640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d80b6760 0x7f13d81e2fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f13c800c520 tx=0x7f13c800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fc2348d7640 1 Processor -- start 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fae1bfff640 1 -- 172.21.15.29:0/637133889 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c03b820 con 0x7fae34066de0 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fae1bfff640 1 -- 172.21.15.29:0/637133889 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c03b980 con 0x7fae34066de0 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7fae1bfff640 1 -- 172.21.15.29:0/637133889 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c03bd30 con 0x7fae34066de0 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7fae38b33640 1 -- 172.21.15.29:0/637133889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c009b30 con 0x7fae34066de0 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7fae38b33640 1 -- 172.21.15.29:0/637133889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3412f1b0 con 0x7fae34066de0 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0a4ad0 con 0x7f0f4c0051d0 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0a4c30 con 0x7f0f4c0051d0 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7f0f5a7fc640 1 -- 172.21.15.29:0/2150085475 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0a4ad0 con 0x7f0f4c0051d0 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.905+0000 7fc2348d7640 1 -- start start 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fc2348d7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc23006fb60 0x7fc2301e3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fc2348d7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc230071030 0x7fc23013f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fc22e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc23006fb60 0x7fc2301e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fc22e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc23006fb60 0x7fc2301e3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38706/0 (socket says 172.21.15.29:38706) 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fc22e59c640 1 -- 172.21.15.29:0/3394719507 learned_addr learned my addr 172.21.15.29:0/3394719507 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fc2348d7640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc23013c800 0x7fc2301df860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23014f520 con 0x7fc23013c800 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23013b640 con 0x7fc23006fb60 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2301e2bf0 con 0x7fc230071030 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.906+0000 7fc22dd9b640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc230071030 0x7fc23013f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7fc22e59c640 1 -- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc230071030 msgr2=0x7fc23013f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7fc22e59c640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc230071030 0x7fc23013f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7fc22e59c640 1 -- 172.21.15.29:0/3394719507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc23013c800 msgr2=0x7fc2301df860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7fc22e59c640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc23013c800 0x7fc2301df860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7fc22e59c640 1 -- 172.21.15.29:0/3394719507 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc228009a70 con 0x7fc23006fb60 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7fc22e59c640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc23006fb60 0x7fc2301e3080 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc22400b480 tx=0x7fc22400b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f0798153640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f07900b44b0 0x7f07901462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f0798153640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f07900b5f50 0x7f079013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f0798153640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07900b3320 0x7f079013fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f0798153640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07900b5580 con 0x7f07900b44b0 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f0798153640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07900b3880 con 0x7f07900b5f50 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f0798153640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07900b4890 con 0x7f07900b3320 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f50b3fff640 1 -- 172.21.15.29:0/1944492777 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f50b4004c00 con 0x7f50c001f0d0 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7fb6457fa640 1 -- 172.21.15.29:0/1333904606 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb634039040 con 0x7fb6480b0e60 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f0f60e67640 1 -- 172.21.15.29:0/2150085475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f4c0051d0 msgr2=0x7f0f4c014190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f0f60e67640 1 --2- 172.21.15.29:0/2150085475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f4c0051d0 0x7f0f4c014190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c074a20 tx=0x7f0f4c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f0f60e67640 1 -- 172.21.15.29:0/2150085475 shutdown_connections 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f0f60e67640 1 --2- 172.21.15.29:0/2150085475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f4c0051d0 0x7f0f4c014190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f0f60e67640 1 -- 172.21.15.29:0/2150085475 >> 172.21.15.29:0/2150085475 conn(0x7f0f5403e320 msgr2=0x7f0f5403e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f50b3fff640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f50ac06acd0 0x7f50ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7fb6457fa640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb62c06ac00 0x7fb62c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f50b3fff640 1 -- 172.21.15.29:0/1944492777 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f50b4088b00 con 0x7f50c001f0d0 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f13c6ffd640 1 -- 172.21.15.29:0/3958325133 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80074e0 con 0x7f13d80b6760 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f13c6ffd640 1 -- 172.21.15.29:0/3958325133 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c8007640 con 0x7f13d80b6760 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f13c6ffd640 1 -- 172.21.15.29:0/3958325133 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80049e0 con 0x7f13d80b6760 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f13dcd5e640 1 -- 172.21.15.29:0/3958325133 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d813e950 con 0x7f13d80b6760 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f13dcd5e640 1 -- 172.21.15.29:0/3958325133 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d813f2d0 con 0x7f13d80b6760 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7fae38b33640 1 -- 172.21.15.29:0/637133889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae34067980 con 0x7fae34066de0 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7fae1bfff640 1 -- 172.21.15.29:0/637133889 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fae2c038050 con 0x7fae34066de0 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7fb6457fa640 1 -- 172.21.15.29:0/1333904606 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb6340aa350 con 0x7fb6480b0e60 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7fb64ca9d640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb62c06ac00 0x7fb62c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7fb64ca9d640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb62c06ac00 0x7fb62c06d0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0011e0 tx=0x7fb63c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f96a4e19640 1 Processor -- start 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f96a4e19640 1 -- start start 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f0f60e67640 1 -- 172.21.15.29:0/2150085475 shutdown_connections 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7f0f60e67640 1 -- 172.21.15.29:0/2150085475 wait complete. 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7fc21effd640 1 -- 172.21.15.29:0/3394719507 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224010870 con 0x7fc23006fb60 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7f50c77fe640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f50ac06acd0 0x7f50ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7f96a4e19640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698036470 0x7f9698008980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7f96a4e19640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9698037070 0x7f96980c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7fae1bfff640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fae2006ac50 0x7fae2006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7f96a4e19640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9698037d10 0x7f96980bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7f96a4e19640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96980bdf90 con 0x7f9698036470 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7f96a4e19640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96980bd940 con 0x7f9698037070 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7f96a4e19640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96980bdc20 con 0x7f9698037d10 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7f969e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698036470 0x7f9698008980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7f969e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698036470 0x7f9698008980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40854/0 (socket says 172.21.15.29:40854) 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7f969e59c640 1 -- 172.21.15.29:0/3559851063 learned_addr learned my addr 172.21.15.29:0/3559851063 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.909+0000 7f969ed9d640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9698037d10 0x7f96980bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f969ed9d640 1 -- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9698037070 msgr2=0x7f96980c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f969dd9b640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9698037070 0x7f96980c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f969ed9d640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9698037070 0x7f96980c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f13dcd5e640 1 -- 172.21.15.29:0/3958325133 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d80b1fd0 con 0x7f13d80b6760 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f969ed9d640 1 -- 172.21.15.29:0/3559851063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698036470 msgr2=0x7f9698008980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f0795eef640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f07900b44b0 0x7f07901462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f0795eef640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f07900b44b0 0x7f07901462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40852/0 (socket says 172.21.15.29:40852) 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f0795eef640 1 -- 172.21.15.29:0/4128741242 learned_addr learned my addr 172.21.15.29:0/4128741242 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.907+0000 7f07956ee640 1 --2- 172.21.15.29:0/4128741242 >> v2:172.21.15.96:3300/0 conn(0x7f07900b5f50 0x7f079013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f07966f0640 1 --2- 172.21.15.29:0/4128741242 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07900b3320 0x7f079013fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f0795eef640 1 -- 172.21.15.29:0/4128741242 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07900b3320 msgr2=0x7f079013fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f0795eef640 1 --2- 172.21.15.29:0/4128741242 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07900b3320 0x7f079013fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f0795eef640 1 -- 172.21.15.29:0/4128741242 >> v2:172.21.15.96:3300/0 conn(0x7f07900b5f50 msgr2=0x7f079013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f0795eef640 1 --2- 172.21.15.29:0/4128741242 >> v2:172.21.15.96:3300/0 conn(0x7f07900b5f50 0x7f079013f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.908+0000 7f0795eef640 1 -- 172.21.15.29:0/4128741242 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07900b57f0 con 0x7f07900b44b0 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f0795eef640 1 --2- 172.21.15.29:0/4128741242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07900b44b0 0x7f07901462e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0790143570 tx=0x7f078802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b19d3136cae9b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f969ed9d640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698036470 0x7f9698008980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2301e28c0 con 0x7fc23006fb60 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2301e35c0 con 0x7fc23006fb60 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f0794eed640 1 -- 172.21.15.29:0/4128741242 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0788042610 con 0x7f07900b44b0 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7fae32ffd640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fae2006ac50 0x7fae2006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f0794eed640 1 -- 172.21.15.29:0/4128741242 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078802d050 con 0x7f07900b44b0 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f0794eed640 1 -- 172.21.15.29:0/4128741242 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0788042990 con 0x7f07900b44b0 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f969ed9d640 1 -- 172.21.15.29:0/3559851063 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96980c53e0 con 0x7f9698037d10 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f969e59c640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698036470 0x7f9698008980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7fae32ffd640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fae2006ac50 0x7fae2006d110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae341445b0 tx=0x7fae24007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f0f60e67640 1 Processor -- start 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.910+0000 7f0f60e67640 1 -- start start 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f50c77fe640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f50ac06acd0 0x7f50ac06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f50bc006fd0 tx=0x7f50bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f969ed9d640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9698037d10 0x7f96980bbd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f969000e7f0 tx=0x7f969000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f13c6ffd640 1 -- 172.21.15.29:0/3958325133 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f13c8004b40 con 0x7f13d80b6760 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0f60e67640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f4c0051d0 0x7f0f541608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0f60e67640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f540cd570 0x7f0f540cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0798153640 1 -- 172.21.15.29:0/4128741242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07900b44b0 msgr2=0x7f07901462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0f60e67640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f540be2f0 0x7f0f540be770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0798153640 1 --2- 172.21.15.29:0/4128741242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07900b44b0 0x7f07901462e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0790143570 tx=0x7f078802a6a0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0f60e67640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540cd150 con 0x7f0f540be2f0 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0f60e67640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540ccb10 con 0x7f0f4c0051d0 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0f60e67640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540cdf10 con 0x7f0f540cd570 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0798153640 1 -- 172.21.15.29:0/4128741242 shutdown_connections 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0798153640 1 --2- 172.21.15.29:0/4128741242 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07900b3320 0x7f079013fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0798153640 1 --2- 172.21.15.29:0/4128741242 >> v2:172.21.15.96:3300/0 conn(0x7f07900b5f50 0x7f079013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0f5affd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f540cd570 0x7f0f540cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0f5affd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f540cd570 0x7f0f540cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44190/0 (socket says 172.21.15.29:44190) 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0f5affd640 1 -- 172.21.15.29:0/1659097581 learned_addr learned my addr 172.21.15.29:0/1659097581 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0798153640 1 --2- 172.21.15.29:0/4128741242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07900b44b0 0x7f07901462e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0798153640 1 -- 172.21.15.29:0/4128741242 >> 172.21.15.29:0/4128741242 conn(0x7f07900b8050 msgr2=0x7f07900b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f968effd640 1 -- 172.21.15.29:0/3559851063 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000c730 con 0x7f9698037d10 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0f5b7fe640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f4c0051d0 0x7f0f541608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f0f5bfff640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f540be2f0 0x7f0f540be770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7f968effd640 1 -- 172.21.15.29:0/3559851063 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969000c890 con 0x7f9698037d10 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.911+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2301e2720 con 0x7fc23006fb60 2024-09-13T18:45:45.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f96a4e19640 1 -- 172.21.15.29:0/3559851063 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96980be420 con 0x7f9698037d10 2024-09-13T18:45:45.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f968effd640 1 -- 172.21.15.29:0/3559851063 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000cc80 con 0x7f9698037d10 2024-09-13T18:45:45.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0798153640 1 -- 172.21.15.29:0/4128741242 shutdown_connections 2024-09-13T18:45:45.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f96a4e19640 1 -- 172.21.15.29:0/3559851063 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96980c4f40 con 0x7f9698037d10 2024-09-13T18:45:45.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0f5affd640 1 -- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f4c0051d0 msgr2=0x7f0f541608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0f5affd640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f4c0051d0 0x7f0f541608c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0f5affd640 1 -- 172.21.15.29:0/1659097581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f540be2f0 msgr2=0x7f0f540be770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0f5affd640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f540be2f0 0x7f0f540be770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7fb6457fa640 1 -- 172.21.15.29:0/1333904606 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb634075360 con 0x7fb6480b0e60 2024-09-13T18:45:45.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0f5affd640 1 -- 172.21.15.29:0/1659097581 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f54161220 con 0x7f0f540cd570 2024-09-13T18:45:45.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f13c6ffd640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f13b806ac80 0x7f13b806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f13c6ffd640 1 -- 172.21.15.29:0/3958325133 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f13c8088a30 con 0x7f13d80b6760 2024-09-13T18:45:45.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0f5b7fe640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f4c0051d0 0x7f0f541608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:45.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0f5affd640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f540cd570 0x7f0f540cd9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800f950 tx=0x7f0f4800fe10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0f47fff640 1 -- 172.21.15.29:0/1659097581 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800dd30 con 0x7f0f540cd570 2024-09-13T18:45:45.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0f47fff640 1 -- 172.21.15.29:0/1659097581 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4800c040 con 0x7f0f540cd570 2024-09-13T18:45:45.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0f47fff640 1 -- 172.21.15.29:0/1659097581 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48004240 con 0x7f0f540cd570 2024-09-13T18:45:45.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0f60e67640 1 -- 172.21.15.29:0/1659097581 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f54161500 con 0x7f0f540cd570 2024-09-13T18:45:45.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.913+0000 7f0f60e67640 1 -- 172.21.15.29:0/1659097581 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f540ced70 con 0x7f0f540cd570 2024-09-13T18:45:45.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.913+0000 7fae1bfff640 1 -- 172.21.15.29:0/637133889 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fae2c078b80 con 0x7fae34066de0 2024-09-13T18:45:45.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.913+0000 7f13d659c640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f13b806ac80 0x7f13b806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.912+0000 7f0798153640 1 -- 172.21.15.29:0/4128741242 wait complete. 2024-09-13T18:45:45.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.914+0000 7f50b3fff640 1 -- 172.21.15.29:0/1944492777 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f50b4053b10 con 0x7f50c001f0d0 2024-09-13T18:45:45.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.914+0000 7f0798153640 1 Processor -- start 2024-09-13T18:45:45.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.914+0000 7f0798153640 1 -- start start 2024-09-13T18:45:45.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.914+0000 7fc21effd640 1 -- 172.21.15.29:0/3394719507 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2240109d0 con 0x7fc23006fb60 2024-09-13T18:45:45.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.914+0000 7fc21effd640 1 -- 172.21.15.29:0/3394719507 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224010da0 con 0x7fc23006fb60 2024-09-13T18:45:45.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.914+0000 7f0f60e67640 1 -- 172.21.15.29:0/1659097581 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f540cd290 con 0x7f0f540cd570 2024-09-13T18:45:45.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.914+0000 7f96a4e19640 1 -- 172.21.15.29:0/3559851063 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96980bdde0 con 0x7f9698037d10 2024-09-13T18:45:45.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.914+0000 7f13d659c640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f13b806ac80 0x7f13b806d140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009a10 tx=0x7f13cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f0f47fff640 1 -- 172.21.15.29:0/1659097581 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f480043a0 con 0x7f0f540cd570 2024-09-13T18:45:45.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f0798153640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07900b3320 0x7f079013b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f0798153640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07900b44b0 0x7f0790070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f0798153640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07900b5f50 0x7f079006eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f0798153640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079006ea30 con 0x7f07900b5f50 2024-09-13T18:45:45.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f0798153640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079006f400 con 0x7f07900b44b0 2024-09-13T18:45:45.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f0798153640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079006db00 con 0x7f07900b3320 2024-09-13T18:45:45.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f968effd640 1 -- 172.21.15.29:0/3559851063 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9690004020 con 0x7f9698037d10 2024-09-13T18:45:45.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f07956ee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07900b44b0 0x7f0790070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f07956ee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07900b44b0 0x7f0790070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38754/0 (socket says 172.21.15.29:38754) 2024-09-13T18:45:45.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f07956ee640 1 -- 172.21.15.29:0/1914968515 learned_addr learned my addr 172.21.15.29:0/1914968515 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:45.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f0795eef640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07900b3320 0x7f079013b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f07966f0640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07900b5f50 0x7f079006eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f0f47fff640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0f4006ac30 0x7f0f4006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f07956ee640 1 -- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07900b3320 msgr2=0x7f079013b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f07956ee640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07900b3320 0x7f079013b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.915+0000 7f07956ee640 1 -- 172.21.15.29:0/1914968515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07900b5f50 msgr2=0x7f079006eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.916+0000 7f0f47fff640 1 -- 172.21.15.29:0/1659097581 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f480896a0 con 0x7f0f540cd570 2024-09-13T18:45:45.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.916+0000 7f07956ee640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07900b5f50 0x7f079006eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.916+0000 7f07956ee640 1 -- 172.21.15.29:0/1914968515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0788009b30 con 0x7f07900b44b0 2024-09-13T18:45:45.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.916+0000 7f07966f0640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07900b5f50 0x7f079006eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:45.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.916+0000 7f0f5b7fe640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0f4006ac30 0x7f0f4006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.916+0000 7f07956ee640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07900b44b0 0x7f0790070b70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f078c00c7c0 tx=0x7f078c00cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.916+0000 7f968effd640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f968006ac80 0x7f968006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.916+0000 7f0f5b7fe640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0f4006ac30 0x7f0f4006d0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f50000fb0 tx=0x7f0f50001a60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.916+0000 7f969e59c640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f968006ac80 0x7f968006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.916+0000 7f968effd640 1 -- 172.21.15.29:0/3559851063 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9690089160 con 0x7f9698037d10 2024-09-13T18:45:45.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.917+0000 7f969e59c640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f968006ac80 0x7f968006d140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9694004d40 tx=0x7f9694007f10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.918+0000 7fae1bfff640 1 -- 172.21.15.29:0/637133889 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fae2c074ec0 con 0x7fae34066de0 2024-09-13T18:45:45.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.918+0000 7f07867fc640 1 -- 172.21.15.29:0/1914968515 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c00a8b0 con 0x7f07900b44b0 2024-09-13T18:45:45.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.918+0000 7f07867fc640 1 -- 172.21.15.29:0/1914968515 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c00aa10 con 0x7f07900b44b0 2024-09-13T18:45:45.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.918+0000 7f0798153640 1 -- 172.21.15.29:0/1914968515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079006dda0 con 0x7f07900b44b0 2024-09-13T18:45:45.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.919+0000 7f13c6ffd640 1 -- 172.21.15.29:0/3958325133 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f13c8053b40 con 0x7f13d80b6760 2024-09-13T18:45:45.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.919+0000 7f968effd640 1 -- 172.21.15.29:0/3559851063 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9690054270 con 0x7f9698037d10 2024-09-13T18:45:45.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.919+0000 7f07867fc640 1 -- 172.21.15.29:0/1914968515 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c00ad80 con 0x7f07900b44b0 2024-09-13T18:45:45.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.919+0000 7f0798153640 1 -- 172.21.15.29:0/1914968515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079013d2f0 con 0x7f07900b44b0 2024-09-13T18:45:45.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.920+0000 7fc21effd640 1 -- 172.21.15.29:0/3394719507 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc224023480 con 0x7fc23006fb60 2024-09-13T18:45:45.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.921+0000 7f0798153640 1 -- 172.21.15.29:0/1914968515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07900b3aa0 con 0x7f07900b44b0 2024-09-13T18:45:45.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.921+0000 7fc21effd640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc21006ac60 0x7fc21006d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.921+0000 7fc21effd640 1 -- 172.21.15.29:0/3394719507 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc2240898b0 con 0x7fc23006fb60 2024-09-13T18:45:45.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.921+0000 7fc22dd9b640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc21006ac60 0x7fc21006d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.922+0000 7fc22dd9b640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc21006ac60 0x7fc21006d120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc23013bc40 tx=0x7fc220008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.923+0000 7f0f47fff640 1 -- 172.21.15.29:0/1659097581 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0f540cd290 con 0x7f0f540cd570 2024-09-13T18:45:45.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.924+0000 7fc21effd640 1 -- 172.21.15.29:0/3394719507 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc224054890 con 0x7fc23006fb60 2024-09-13T18:45:45.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.928+0000 7f07867fc640 1 -- 172.21.15.29:0/1914968515 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f078c017020 con 0x7f07900b44b0 2024-09-13T18:45:45.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.928+0000 7f07867fc640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f077406ac00 0x7f077406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.929+0000 7f0795eef640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f077406ac00 0x7f077406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.929+0000 7f07867fc640 1 -- 172.21.15.29:0/1914968515 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f078c089870 con 0x7f07900b44b0 2024-09-13T18:45:45.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.929+0000 7f0795eef640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f077406ac00 0x7f077406d0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0788044000 tx=0x7f0788009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:45.929+0000 7f07867fc640 1 -- 172.21.15.29:0/1914968515 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f078c0b6a60 con 0x7f07900b44b0 2024-09-13T18:45:46.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.305+0000 7f50cda72640 1 -- 172.21.15.29:0/1944492777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f50a8005500 con 0x7f50c001f0d0 2024-09-13T18:45:46.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.306+0000 7f50b3fff640 1 -- 172.21.15.29:0/1944492777 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50b4018020 con 0x7f50c001f0d0 2024-09-13T18:45:46.308 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-09-13T18:45:46.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.309+0000 7f50b1ffb640 1 -- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f50ac06acd0 msgr2=0x7f50ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.309+0000 7f50b1ffb640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f50ac06acd0 0x7f50ac06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f50bc006fd0 tx=0x7f50bc008040 comp rx=0 tx=0).stop 2024-09-13T18:45:46.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.309+0000 7f50b1ffb640 1 -- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50c001f0d0 msgr2=0x7f50c00cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.309+0000 7f50b1ffb640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50c001f0d0 0x7f50c00cc550 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50c001c6e0 tx=0x7f50b400c930 comp rx=0 tx=0).stop 2024-09-13T18:45:46.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.310+0000 7f50b1ffb640 1 -- 172.21.15.29:0/1944492777 shutdown_connections 2024-09-13T18:45:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.310+0000 7f50b1ffb640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f50ac06acd0 0x7f50ac06d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.310+0000 7f50b1ffb640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50c00d0930 0x7f50c0165bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.310+0000 7f50b1ffb640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50c001f0d0 0x7f50c00cc550 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.310+0000 7f50b1ffb640 1 --2- 172.21.15.29:0/1944492777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50c0006c90 0x7f50c00cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.310+0000 7f50b1ffb640 1 -- 172.21.15.29:0/1944492777 >> 172.21.15.29:0/1944492777 conn(0x7f50c0009030 msgr2=0x7f50c003bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.310+0000 7f50b1ffb640 1 -- 172.21.15.29:0/1944492777 shutdown_connections 2024-09-13T18:45:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.310+0000 7f50b1ffb640 1 -- 172.21.15.29:0/1944492777 wait complete. 2024-09-13T18:45:46.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.312+0000 7fb64da9f640 1 -- 172.21.15.29:0/1333904606 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb64814d8f0 con 0x7fb6480b0e60 2024-09-13T18:45:46.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.314+0000 7fb6457fa640 1 -- 172.21.15.29:0/1333904606 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb634078980 con 0x7fb6480b0e60 2024-09-13T18:45:46.316 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-09-13T18:45:46.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.317+0000 7fb632ffd640 1 -- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb62c06ac00 msgr2=0x7fb62c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.317+0000 7fb632ffd640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb62c06ac00 0x7fb62c06d0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0011e0 tx=0x7fb63c009040 comp rx=0 tx=0).stop 2024-09-13T18:45:46.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.317+0000 7fb632ffd640 1 -- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480b0e60 msgr2=0x7fb64806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.317+0000 7fb632ffd640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480b0e60 0x7fb64806e870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb634031000 tx=0x7fb6340046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.317+0000 7f96a4e19640 1 -- 172.21.15.29:0/3559851063 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f96980c4cf0 con 0x7f9698037d10 2024-09-13T18:45:46.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.318+0000 7fb632ffd640 1 -- 172.21.15.29:0/1333904606 shutdown_connections 2024-09-13T18:45:46.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.318+0000 7fb632ffd640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb62c06ac00 0x7fb62c06d0c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.318+0000 7fb632ffd640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6481e2880 0x7fb6481e2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.318+0000 7fb632ffd640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6480b0e60 0x7fb64806e870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.318+0000 7fb632ffd640 1 --2- 172.21.15.29:0/1333904606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6480affc0 0x7fb648071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.318+0000 7fb632ffd640 1 -- 172.21.15.29:0/1333904606 >> 172.21.15.29:0/1333904606 conn(0x7fb6480b7250 msgr2=0x7fb6480b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.318+0000 7fb632ffd640 1 -- 172.21.15.29:0/1333904606 shutdown_connections 2024-09-13T18:45:46.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.318+0000 7fb632ffd640 1 -- 172.21.15.29:0/1333904606 wait complete. 2024-09-13T18:45:46.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.318+0000 7f968effd640 1 -- 172.21.15.29:0/3559851063 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f96980c4cf0 con 0x7f9698037d10 2024-09-13T18:45:46.322 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-09-13T18:45:46.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.320+0000 7fae38b33640 1 -- 172.21.15.29:0/637133889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fae340b4040 con 0x7fae34066de0 2024-09-13T18:45:46.324 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-09-13T18:45:46.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.320+0000 7fae1bfff640 1 -- 172.21.15.29:0/637133889 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae2c04b020 con 0x7fae34066de0 2024-09-13T18:45:46.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.321+0000 7f96a4e19640 1 -- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f968006ac80 msgr2=0x7f968006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.321+0000 7f96a4e19640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f968006ac80 0x7f968006d140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9694004d40 tx=0x7f9694007f10 comp rx=0 tx=0).stop 2024-09-13T18:45:46.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.322+0000 7f96a4e19640 1 -- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9698037d10 msgr2=0x7f96980bbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.322+0000 7f96a4e19640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9698037d10 0x7f96980bbd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f969000e7f0 tx=0x7f969000ecb0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.322+0000 7f96a4e19640 1 -- 172.21.15.29:0/3559851063 shutdown_connections 2024-09-13T18:45:46.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.322+0000 7f96a4e19640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f968006ac80 0x7f968006d140 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.322+0000 7f96a4e19640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9698037d10 0x7f96980bbd50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.322+0000 7f96a4e19640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9698037070 0x7f96980c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.322+0000 7f96a4e19640 1 --2- 172.21.15.29:0/3559851063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698036470 0x7f9698008980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.322+0000 7f96a4e19640 1 -- 172.21.15.29:0/3559851063 >> 172.21.15.29:0/3559851063 conn(0x7f969803c300 msgr2=0x7f969803e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.322+0000 7f96a4e19640 1 -- 172.21.15.29:0/3559851063 shutdown_connections 2024-09-13T18:45:46.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.322+0000 7f96a4e19640 1 -- 172.21.15.29:0/3559851063 wait complete. 2024-09-13T18:45:46.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.324+0000 7fae38b33640 1 -- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fae2006ac50 msgr2=0x7fae2006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.324+0000 7fae38b33640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fae2006ac50 0x7fae2006d110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae341445b0 tx=0x7fae24007e30 comp rx=0 tx=0).stop 2024-09-13T18:45:46.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.324+0000 7fae38b33640 1 -- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae34066de0 msgr2=0x7fae34134500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.324+0000 7fae38b33640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae34066de0 0x7fae34134500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009e50 tx=0x7fae2c004a40 comp rx=0 tx=0).stop 2024-09-13T18:45:46.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.324+0000 7fae38b33640 1 -- 172.21.15.29:0/637133889 shutdown_connections 2024-09-13T18:45:46.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.324+0000 7fae38b33640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fae2006ac50 0x7fae2006d110 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae341445b0 tx=0x7fae24007e30 comp rx=0 tx=0).stop 2024-09-13T18:45:46.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.324+0000 7fae38b33640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae340b6500 0x7fae34142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.324+0000 7fae38b33640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae340b4580 0x7fae3412f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.324+0000 7fae38b33640 1 --2- 172.21.15.29:0/637133889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae34066de0 0x7fae34134500 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.324+0000 7fae38b33640 1 -- 172.21.15.29:0/637133889 >> 172.21.15.29:0/637133889 conn(0x7fae340b7690 msgr2=0x7fae34070fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.324+0000 7fae38b33640 1 -- 172.21.15.29:0/637133889 shutdown_connections 2024-09-13T18:45:46.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.324+0000 7fae38b33640 1 -- 172.21.15.29:0/637133889 wait complete. 2024-09-13T18:45:46.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-09-13T18:45:46.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.330+0000 7f13dcd5e640 1 -- 172.21.15.29:0/3958325133 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f13d81470b0 con 0x7f13d80b6760 2024-09-13T18:45:46.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.331+0000 7f0f60e67640 1 -- 172.21.15.29:0/1659097581 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0f540cd290 con 0x7f0f540cd570 2024-09-13T18:45:46.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.331+0000 7f13c6ffd640 1 -- 172.21.15.29:0/3958325133 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13c8018020 con 0x7f13d80b6760 2024-09-13T18:45:46.334 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-09-13T18:45:46.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.331+0000 7f0f47fff640 1 -- 172.21.15.29:0/1659097581 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f540cd290 con 0x7f0f540cd570 2024-09-13T18:45:46.335 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2024-09-13T18:45:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f13dcd5e640 1 -- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f13b806ac80 msgr2=0x7f13b806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f13dcd5e640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f13b806ac80 0x7f13b806d140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009a10 tx=0x7f13cc008040 comp rx=0 tx=0).stop 2024-09-13T18:45:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f13dcd5e640 1 -- 172.21.15.29:0/3958325133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d80b6760 msgr2=0x7f13d81e2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f13dcd5e640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d80b6760 0x7f13d81e2fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f13c800c520 tx=0x7f13c800c9e0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f13dcd5e640 1 -- 172.21.15.29:0/3958325133 shutdown_connections 2024-09-13T18:45:46.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f13dcd5e640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f13b806ac80 0x7f13b806d140 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f13dcd5e640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f13d80b70a0 0x7f13d81e34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f13dcd5e640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d80b6760 0x7f13d81e2fb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f13dcd5e640 1 --2- 172.21.15.29:0/3958325133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80b5b70 0x7f13d8142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f13dcd5e640 1 -- 172.21.15.29:0/3958325133 >> 172.21.15.29:0/3958325133 conn(0x7f13d8099230 msgr2=0x7f13d8148b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f0f60e67640 1 -- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0f4006ac30 msgr2=0x7f0f4006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f0f60e67640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0f4006ac30 0x7f0f4006d0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f50000fb0 tx=0x7f0f50001a60 comp rx=0 tx=0).stop 2024-09-13T18:45:46.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f0f60e67640 1 -- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f540cd570 msgr2=0x7f0f540cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f0f60e67640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f540cd570 0x7f0f540cd9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800f950 tx=0x7f0f4800fe10 comp rx=0 tx=0).stop 2024-09-13T18:45:46.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f13dcd5e640 1 -- 172.21.15.29:0/3958325133 shutdown_connections 2024-09-13T18:45:46.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f0f60e67640 1 -- 172.21.15.29:0/1659097581 shutdown_connections 2024-09-13T18:45:46.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f0f60e67640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0f4006ac30 0x7f0f4006d0f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f13dcd5e640 1 -- 172.21.15.29:0/3958325133 wait complete. 2024-09-13T18:45:46.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f0f60e67640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f540be2f0 0x7f0f540be770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.335+0000 7f0f60e67640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f540cd570 0x7f0f540cd9d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.336+0000 7f0f60e67640 1 --2- 172.21.15.29:0/1659097581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f4c0051d0 0x7f0f541608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.336+0000 7f0f60e67640 1 -- 172.21.15.29:0/1659097581 >> 172.21.15.29:0/1659097581 conn(0x7f0f5403e320 msgr2=0x7f0f540c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.336+0000 7f0798153640 1 -- 172.21.15.29:0/1914968515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0790140fa0 con 0x7f07900b44b0 2024-09-13T18:45:46.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.336+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc2301e2720 con 0x7fc23006fb60 2024-09-13T18:45:46.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.336+0000 7f0f60e67640 1 -- 172.21.15.29:0/1659097581 shutdown_connections 2024-09-13T18:45:46.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.336+0000 7f0f60e67640 1 -- 172.21.15.29:0/1659097581 wait complete. 2024-09-13T18:45:46.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.336+0000 7fc21effd640 1 -- 172.21.15.29:0/3394719507 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2301e2720 con 0x7fc23006fb60 2024-09-13T18:45:46.342 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2024-09-13T18:45:46.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.336+0000 7f07867fc640 1 -- 172.21.15.29:0/1914968515 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f078c01f090 con 0x7f07900b44b0 2024-09-13T18:45:46.343 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-09-13T18:45:46.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-09-13T18:45:46.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.338+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc21006ac60 msgr2=0x7fc21006d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.338+0000 7fc2348d7640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc21006ac60 0x7fc21006d120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc23013bc40 tx=0x7fc220008040 comp rx=0 tx=0).stop 2024-09-13T18:45:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.338+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc23006fb60 msgr2=0x7fc2301e3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.338+0000 7fc2348d7640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc23006fb60 0x7fc2301e3080 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc22400b480 tx=0x7fc22400b940 comp rx=0 tx=0).stop 2024-09-13T18:45:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.338+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 shutdown_connections 2024-09-13T18:45:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.338+0000 7fc2348d7640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc21006ac60 0x7fc21006d120 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.338+0000 7fc2348d7640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc23013c800 0x7fc2301df860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.338+0000 7fc2348d7640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc230071030 0x7fc23013f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.338+0000 7fc2348d7640 1 --2- 172.21.15.29:0/3394719507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc23006fb60 0x7fc2301e3080 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.338+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 >> 172.21.15.29:0/3394719507 conn(0x7fc2300b82f0 msgr2=0x7fc230140470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 shutdown_connections 2024-09-13T18:45:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7fc2348d7640 1 -- 172.21.15.29:0/3394719507 wait complete. 2024-09-13T18:45:46.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7f0798153640 1 -- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f077406ac00 msgr2=0x7f077406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7f0798153640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f077406ac00 0x7f077406d0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0788044000 tx=0x7f0788009000 comp rx=0 tx=0).stop 2024-09-13T18:45:46.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7f0798153640 1 -- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07900b44b0 msgr2=0x7f0790070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7f0798153640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07900b44b0 0x7f0790070b70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f078c00c7c0 tx=0x7f078c00cc80 comp rx=0 tx=0).stop 2024-09-13T18:45:46.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7f0798153640 1 -- 172.21.15.29:0/1914968515 shutdown_connections 2024-09-13T18:45:46.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7f0798153640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f077406ac00 0x7f077406d0c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7f0798153640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07900b5f50 0x7f079006eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7f0798153640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07900b44b0 0x7f0790070b70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7f0798153640 1 --2- 172.21.15.29:0/1914968515 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07900b3320 0x7f079013b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7f0798153640 1 -- 172.21.15.29:0/1914968515 >> 172.21.15.29:0/1914968515 conn(0x7f07900b8050 msgr2=0x7f07900b71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.339+0000 7f0798153640 1 -- 172.21.15.29:0/1914968515 shutdown_connections 2024-09-13T18:45:46.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:46.340+0000 7f0798153640 1 -- 172.21.15.29:0/1914968515 wait complete. 2024-09-13T18:45:46.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2024-09-13T18:45:46.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-09-13T18:45:46.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-09-13T18:45:46.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-09-13T18:45:46.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-09-13T18:45:46.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-09-13T18:45:47.333 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:45:47.345 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:45:47.348 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:45:47.349 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:45:47.356 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:45:47.357 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:45:47.359 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:45:47.360 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:45:47.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.497+0000 7f821e487640 1 Processor -- start 2024-09-13T18:45:47.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.497+0000 7f821e487640 1 -- start start 2024-09-13T18:45:47.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.499+0000 7f821e487640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82180aed70 0x7f8218144da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.499+0000 7f821e487640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f82180b0380 0x7f8218070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.499+0000 7f821e487640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8218071e20 con 0x7f82180713e0 2024-09-13T18:45:47.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.499+0000 7f821e487640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82180b1580 con 0x7f82180b0380 2024-09-13T18:45:47.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.499+0000 7f821e487640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82180af150 con 0x7f82180aed70 2024-09-13T18:45:47.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.499+0000 7f821dc86640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f82180713e0 0x7f8218141830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54390/0 (socket says 172.21.15.29:54390) 2024-09-13T18:45:47.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.499+0000 7f821dc86640 1 -- 172.21.15.29:0/2958949645 learned_addr learned my addr 172.21.15.29:0/2958949645 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:47.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.499+0000 7f821cc84640 1 --2- 172.21.15.29:0/2958949645 >> v2:172.21.15.29:3300/0 conn(0x7f82180b0380 0x7f8218070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.500+0000 7f821cc84640 1 -- 172.21.15.29:0/2958949645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82180aed70 msgr2=0x7f8218144da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:45:47.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.500+0000 7f821cc84640 1 --2- 172.21.15.29:0/2958949645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82180aed70 0x7f8218144da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.500+0000 7f821cc84640 1 -- 172.21.15.29:0/2958949645 >> v1:172.21.15.29:6789/0 conn(0x7f82180713e0 legacy=0x7f8218141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.500+0000 7f821cc84640 1 -- 172.21.15.29:0/2958949645 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821806e730 con 0x7f82180b0380 2024-09-13T18:45:47.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.501+0000 7f821cc84640 1 --2- 172.21.15.29:0/2958949645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82180b0380 0x7f8218070ea0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f821400d8a0 tx=0x7f821402c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514296d0906da3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.501+0000 7f820ffff640 1 -- 172.21.15.29:0/2958949645 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214034640 con 0x7f82180b0380 2024-09-13T18:45:47.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.501+0000 7f820ffff640 1 -- 172.21.15.29:0/2958949645 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82140347a0 con 0x7f82180b0380 2024-09-13T18:45:47.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.503+0000 7f821e487640 1 -- 172.21.15.29:0/2958949645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82180b0380 msgr2=0x7f8218070ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.503+0000 7f821e487640 1 --2- 172.21.15.29:0/2958949645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82180b0380 0x7f8218070ea0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f821400d8a0 tx=0x7f821402c3b0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.505+0000 7f821e487640 1 -- 172.21.15.29:0/2958949645 shutdown_connections 2024-09-13T18:45:47.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.505+0000 7f821e487640 1 --2- 172.21.15.29:0/2958949645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82180b0380 0x7f8218070ea0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.505+0000 7f821e487640 1 --2- 172.21.15.29:0/2958949645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82180aed70 0x7f8218144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.505+0000 7f821e487640 1 -- 172.21.15.29:0/2958949645 >> 172.21.15.29:0/2958949645 conn(0x7f82180b7250 msgr2=0x7f82180b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.505+0000 7f821e487640 1 -- 172.21.15.29:0/2958949645 shutdown_connections 2024-09-13T18:45:47.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.505+0000 7f821e487640 1 -- 172.21.15.29:0/2958949645 wait complete. 2024-09-13T18:45:47.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.507+0000 7f821e487640 1 Processor -- start 2024-09-13T18:45:47.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.507+0000 7f821e487640 1 -- start start 2024-09-13T18:45:47.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.508+0000 7f821e487640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82180713e0 0x7f82181420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.508+0000 7f821e487640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82180aed70 0x7f82181eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.508+0000 7f821e487640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82180b0380 0x7f82181e1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.509+0000 7f821e487640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180a8350 con 0x7f82180aed70 2024-09-13T18:45:47.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.509+0000 7f821e487640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821813e270 con 0x7f82180713e0 2024-09-13T18:45:47.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.509+0000 7f821e487640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82180a7990 con 0x7f82180b0380 2024-09-13T18:45:47.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.509+0000 7f821cc84640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82180aed70 0x7f82181eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.509+0000 7f821cc84640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82180aed70 0x7f82181eaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40914/0 (socket says 172.21.15.29:40914) 2024-09-13T18:45:47.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.510+0000 7f821cc84640 1 -- 172.21.15.29:0/2916054195 learned_addr learned my addr 172.21.15.29:0/2916054195 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:47.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.510+0000 7f821d485640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82180713e0 0x7f82181420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.510+0000 7f821cc84640 1 -- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82180b0380 msgr2=0x7f82181e1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.510+0000 7f821dc86640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82180b0380 0x7f82181e1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.512+0000 7f821cc84640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82180b0380 0x7f82181e1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.512+0000 7f821cc84640 1 -- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82180713e0 msgr2=0x7f82181420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.512+0000 7f821cc84640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82180713e0 0x7f82181420f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.512+0000 7f821cc84640 1 -- 172.21.15.29:0/2916054195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821400d510 con 0x7f82180aed70 2024-09-13T18:45:47.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.512+0000 7f821d485640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82180713e0 0x7f82181420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:47.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.512+0000 7f821dc86640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82180b0380 0x7f82181e1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:47.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.512+0000 7f821cc84640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82180aed70 0x7f82181eaac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f821400d9c0 tx=0x7f82140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.513+0000 7f820dffb640 1 -- 172.21.15.29:0/2916054195 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821403d3f0 con 0x7f82180aed70 2024-09-13T18:45:47.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.513+0000 7f821e487640 1 -- 172.21.15.29:0/2916054195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82180a7ba0 con 0x7f82180aed70 2024-09-13T18:45:47.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.513+0000 7f820dffb640 1 -- 172.21.15.29:0/2916054195 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821403d550 con 0x7f82180aed70 2024-09-13T18:45:47.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.513+0000 7f820dffb640 1 -- 172.21.15.29:0/2916054195 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821403d900 con 0x7f82180aed70 2024-09-13T18:45:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.513+0000 7f821e487640 1 -- 172.21.15.29:0/2916054195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82180a7e80 con 0x7f82180aed70 2024-09-13T18:45:47.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.518+0000 7f820dffb640 1 -- 172.21.15.29:0/2916054195 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8214034d50 con 0x7f82180aed70 2024-09-13T18:45:47.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.519+0000 7f821e487640 1 -- 172.21.15.29:0/2916054195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8218072290 con 0x7f82180aed70 2024-09-13T18:45:47.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.529+0000 7f820dffb640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f81fc06ac00 0x7f81fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.529+0000 7f820dffb640 1 -- 172.21.15.29:0/2916054195 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f82140a98e0 con 0x7f82180aed70 2024-09-13T18:45:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.529+0000 7f820dffb640 1 -- 172.21.15.29:0/2916054195 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8218072290 con 0x7f82180aed70 2024-09-13T18:45:47.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.536+0000 7f821d485640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f81fc06ac00 0x7f81fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.540+0000 7f821d485640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f81fc06ac00 0x7f81fc06d0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8208006fd0 tx=0x7f8208008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.557+0000 7f7fca2b1640 1 Processor -- start 2024-09-13T18:45:47.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.557+0000 7f7fca2b1640 1 -- start start 2024-09-13T18:45:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.557+0000 7f5b64765640 1 Processor -- start 2024-09-13T18:45:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.557+0000 7f5b64765640 1 -- start start 2024-09-13T18:45:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.558+0000 7f7fca2b1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7fc40b7b10 0x7f7fc40b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.558+0000 7f7fca2b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fc40b2f20 0x7f7fc40b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.558+0000 7f7fc37fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f7fc406c420 0x7f7fc40b3f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:53228/0 (socket says 172.21.15.29:53228) 2024-09-13T18:45:47.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.558+0000 7f7fc37fe640 1 -- 172.21.15.29:0/2898122677 learned_addr learned my addr 172.21.15.29:0/2898122677 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:47.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7f7fc884e640 1 --2- 172.21.15.29:0/2898122677 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fc40b2f20 0x7f7fc40b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.558+0000 7f5be785a640 1 Processor -- start 2024-09-13T18:45:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.558+0000 7f5be785a640 1 -- start start 2024-09-13T18:45:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7f7fca2b1640 1 -- 172.21.15.29:0/2898122677 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc4072550 con 0x7f7fc406c420 2024-09-13T18:45:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7f7fca2b1640 1 -- 172.21.15.29:0/2898122677 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc40b2530 con 0x7f7fc40b7b10 2024-09-13T18:45:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7f7fca2b1640 1 -- 172.21.15.29:0/2898122677 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc409d850 con 0x7f7fc40b2f20 2024-09-13T18:45:47.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7f5b64765640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5b5c06fca0 0x7f5b5c0b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7f5b62501640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5b5c145430 0x7f5b5c145810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:53240/0 (socket says 172.21.15.29:53240) 2024-09-13T18:45:47.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7f5b62501640 1 -- 172.21.15.29:0/2254034391 learned_addr learned my addr 172.21.15.29:0/2254034391 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:47.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7fa1ca6d7640 1 Processor -- start 2024-09-13T18:45:47.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7f29b284f640 1 Processor -- start 2024-09-13T18:45:47.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7fa1ca6d7640 1 -- start start 2024-09-13T18:45:47.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7f29b284f640 1 -- start start 2024-09-13T18:45:47.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7f5b64765640 1 -- 172.21.15.29:0/2254034391 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c0715b0 con 0x7f5b5c066de0 2024-09-13T18:45:47.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5b64765640 1 -- 172.21.15.29:0/2254034391 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c06ed70 con 0x7f5b5c145430 2024-09-13T18:45:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5b64765640 1 -- 172.21.15.29:0/2254034391 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c0b7780 con 0x7f5b5c06fca0 2024-09-13T18:45:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f7fc3fff640 1 --2- 172.21.15.29:0/2898122677 >> v2:172.21.15.29:3300/0 conn(0x7f7fc40b7b10 0x7f7fc40b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7f5be785a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5be00b88d0 0x7f5be0149d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.559+0000 7f5be785a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5be00b1d70 0x7f5be0143a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5be785a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5be014a2a0 0x7f5be0143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5be785a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be00b09a0 con 0x7f5be014a2a0 2024-09-13T18:45:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5be785a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be00b0e30 con 0x7f5be00b1d70 2024-09-13T18:45:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5be785a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be01444f0 con 0x7f5be00b88d0 2024-09-13T18:45:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14121061 0 0) 0x7f5b5c06ed70 con 0x7f5b5c145430 2024-09-13T18:45:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b44003440 con 0x7f5b5c145430 2024-09-13T18:45:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721595545 0 0) 0x7f5b5c0715b0 con 0x7f5b5c066de0 2024-09-13T18:45:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5be4df5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5be00b1d70 0x7f5be0143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5be4df5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5be00b1d70 0x7f5be0143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38772/0 (socket says 172.21.15.29:38772) 2024-09-13T18:45:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5be4df5640 1 -- 172.21.15.29:0/3987604920 learned_addr learned my addr 172.21.15.29:0/3987604920 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5be55f6640 1 --2- 172.21.15.29:0/3987604920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5be00b88d0 0x7f5be0149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b5c06ed70 con 0x7f5b5c066de0 2024-09-13T18:45:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f7fc2ffd640 1 -- 172.21.15.29:0/2898122677 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941556806 0 0) 0x7f7fc4072550 con 0x7f7fc406c420 2024-09-13T18:45:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f7fc2ffd640 1 -- 172.21.15.29:0/2898122677 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fb0003520 con 0x7f7fc406c420 2024-09-13T18:45:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f7fc884e640 1 -- 172.21.15.29:0/2898122677 >> v2:172.21.15.29:3300/0 conn(0x7f7fc40b7b10 msgr2=0x7f7fc40b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f7fc884e640 1 --2- 172.21.15.29:0/2898122677 >> v2:172.21.15.29:3300/0 conn(0x7f7fc40b7b10 0x7f7fc40b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f7fc884e640 1 -- 172.21.15.29:0/2898122677 >> v1:172.21.15.96:6789/0 conn(0x7f7fc406c420 legacy=0x7f7fc40b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f7fc884e640 1 -- 172.21.15.29:0/2898122677 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40b7ef0 con 0x7f7fc40b2f20 2024-09-13T18:45:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f29b284f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29a4009be0 0x7f29a40c8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7fa1ca6d7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1bc03b9d0 0x7fa1bc0d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7fa1ca6d7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1bc0cda60 0x7fa1bc0d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7fa1ca6d7640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1bc01c720 con 0x7fa1bc038f50 2024-09-13T18:45:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7fa1ca6d7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc0d46d0 con 0x7fa1bc0cda60 2024-09-13T18:45:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7fa1ca6d7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc03bdb0 con 0x7fa1bc03b9d0 2024-09-13T18:45:47.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f29b284f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f29a4006a20 0x7f29a40d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f29ab7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f29a40c8540 0x7f29a401ef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:53242/0 (socket says 172.21.15.29:53242) 2024-09-13T18:45:47.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f29ab7fe640 1 -- 172.21.15.29:0/4217158792 learned_addr learned my addr 172.21.15.29:0/4217158792 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:47.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3976259884 0 0) 0x7f5b5c06ed70 con 0x7f5b5c066de0 2024-09-13T18:45:47.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 >> v2:172.21.15.29:3300/0 conn(0x7f5b5c06fca0 msgr2=0x7f5b5c0b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5b614ff640 1 --2- 172.21.15.29:0/2254034391 >> v2:172.21.15.29:3300/0 conn(0x7f5b5c06fca0 0x7f5b5c0b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 >> v1:172.21.15.96:6789/0 conn(0x7f5b5c145430 legacy=0x7f5b5c145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c071870 con 0x7f5b5c066de0 2024-09-13T18:45:47.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f5b54001920 con 0x7f5b5c066de0 2024-09-13T18:45:47.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 >> v1:172.21.15.29:6789/0 conn(0x7f5b5c066de0 legacy=0x7f5b5c0b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1bc03b9d0 0x7fa1bc0d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1bc03b9d0 0x7fa1bc0d0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44274/0 (socket says 172.21.15.29:44274) 2024-09-13T18:45:47.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7fa1c3fff640 1 -- 172.21.15.29:0/2772424321 learned_addr learned my addr 172.21.15.29:0/2772424321 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:47.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7f5be5df7640 1 --2- 172.21.15.29:0/3987604920 >> v2:172.21.15.29:3300/0 conn(0x7f5be014a2a0 0x7f5be0143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.560+0000 7fbfb7976640 1 Processor -- start 2024-09-13T18:45:47.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f29b284f640 1 -- 172.21.15.29:0/4217158792 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a4009fc0 con 0x7f29a40c8540 2024-09-13T18:45:47.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f29b284f640 1 -- 172.21.15.29:0/4217158792 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a40cb8a0 con 0x7f29a4006a20 2024-09-13T18:45:47.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f29b284f640 1 -- 172.21.15.29:0/4217158792 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a40cbb80 con 0x7f29a4009be0 2024-09-13T18:45:47.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f29abfff640 1 --2- 172.21.15.29:0/4217158792 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29a4009be0 0x7f29a40c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f29b0dec640 1 --2- 172.21.15.29:0/4217158792 >> v2:172.21.15.96:3300/0 conn(0x7f29a4006a20 0x7f29a40d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f29aaffd640 1 -- 172.21.15.29:0/4217158792 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082439712 0 0) 0x7f29a4009fc0 con 0x7f29a40c8540 2024-09-13T18:45:47.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f805359e640 1 Processor -- start 2024-09-13T18:45:47.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f805359e640 1 -- start start 2024-09-13T18:45:47.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7fa1c3fff640 1 -- 172.21.15.29:0/2772424321 >> v2:172.21.15.29:3300/0 conn(0x7fa1bc0cda60 msgr2=0x7fa1bc0d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7fa1c3fff640 1 --2- 172.21.15.29:0/2772424321 >> v2:172.21.15.29:3300/0 conn(0x7fa1bc0cda60 0x7fa1bc0d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7fa1c3fff640 1 -- 172.21.15.29:0/2772424321 >> v1:172.21.15.29:6789/0 conn(0x7fa1bc038f50 legacy=0x7fa1bc0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7fbfb7976640 1 -- start start 2024-09-13T18:45:47.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5be55f6640 1 -- 172.21.15.29:0/3987604920 >> v2:172.21.15.96:3300/0 conn(0x7f5be00b1d70 msgr2=0x7f5be0143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5be55f6640 1 --2- 172.21.15.29:0/3987604920 >> v2:172.21.15.96:3300/0 conn(0x7f5be00b1d70 0x7f5be0143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5be55f6640 1 -- 172.21.15.29:0/3987604920 >> v2:172.21.15.29:3300/0 conn(0x7f5be014a2a0 msgr2=0x7f5be0143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5be55f6640 1 --2- 172.21.15.29:0/3987604920 >> v2:172.21.15.29:3300/0 conn(0x7f5be014a2a0 0x7f5be0143fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5be55f6640 1 -- 172.21.15.29:0/3987604920 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00b8cb0 con 0x7f5be00b88d0 2024-09-13T18:45:47.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.561+0000 7f5be4df5640 1 --2- 172.21.15.29:0/3987604920 >> v2:172.21.15.96:3300/0 conn(0x7f5be00b1d70 0x7f5be0143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:47.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f5b614ff640 1 --2- 172.21.15.29:0/2254034391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b44003c20 0x7f5b44004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f5b614ff640 1 --2- 172.21.15.29:0/2254034391 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b44008980 0x7f5b4400ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7fa1c3fff640 1 -- 172.21.15.29:0/2772424321 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc01ca00 con 0x7fa1bc03b9d0 2024-09-13T18:45:47.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f5b614ff640 1 --2- 172.21.15.29:0/2254034391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b4400b6b0 0x7f5b4400db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c004890 con 0x7f5b4400b6b0 2024-09-13T18:45:47.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f5b61d00640 1 --2- 172.21.15.29:0/2254034391 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b44008980 0x7f5b4400ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0b7780 con 0x7f5b44003c20 2024-09-13T18:45:47.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f29abfff640 1 -- 172.21.15.29:0/4217158792 >> v2:172.21.15.96:3300/0 conn(0x7f29a4006a20 msgr2=0x7f29a40d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f29abfff640 1 --2- 172.21.15.29:0/4217158792 >> v2:172.21.15.96:3300/0 conn(0x7f29a4006a20 0x7f29a40d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f29abfff640 1 -- 172.21.15.29:0/4217158792 >> v1:172.21.15.96:6789/0 conn(0x7f29a40c8540 legacy=0x7f29a401ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f29abfff640 1 -- 172.21.15.29:0/4217158792 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a40cbe60 con 0x7f29a4009be0 2024-09-13T18:45:47.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4400e4d0 con 0x7f5b44008980 2024-09-13T18:45:47.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f805359e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8054146f40 0x7f80540b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f805359e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80540b5940 0x7f805414e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f5b62d02640 1 --2- 172.21.15.29:0/2254034391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b4400b6b0 0x7f5b4400db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7fbfb7976640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbfb00b5d40 0x7fbfb0141950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7fbfb7976640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb0142630 con 0x7fbfb006c7f0 2024-09-13T18:45:47.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7fbfb7976640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb00b3c50 con 0x7fbfb00b6f30 2024-09-13T18:45:47.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7fbfb7976640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb0141fe0 con 0x7fbfb00b5d40 2024-09-13T18:45:47.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f805359e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80540b31c0 con 0x7f80540b5500 2024-09-13T18:45:47.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f805359e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80540b7130 con 0x7f8054146f40 2024-09-13T18:45:47.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.562+0000 7f805359e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8054147320 con 0x7f80540b5940 2024-09-13T18:45:47.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f805259c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8054146f40 0x7f80540b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7fbfb5712640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbfb006c7f0 0x7fbfb00b3540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54416/0 (socket says 172.21.15.29:54416) 2024-09-13T18:45:47.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7fbfb5712640 1 -- 172.21.15.29:0/3283538479 learned_addr learned my addr 172.21.15.29:0/3283538479 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:47.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f805259c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8054146f40 0x7f80540b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40952/0 (socket says 172.21.15.29:40952) 2024-09-13T18:45:47.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f805259c640 1 -- 172.21.15.29:0/3388049885 learned_addr learned my addr 172.21.15.29:0/3388049885 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:47.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f8052d9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80540b5940 0x7f805414e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f5b61d00640 1 -- 172.21.15.29:0/2254034391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b44003c20 msgr2=0x7f5b44004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f5b61d00640 1 --2- 172.21.15.29:0/2254034391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b44003c20 0x7f5b44004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f7fc884e640 1 --2- 172.21.15.29:0/2898122677 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fc40b2f20 0x7f7fc40b4620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0097a0 tx=0x7f7fbc02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27b3c0437558ca09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f5b61d00640 1 -- 172.21.15.29:0/2254034391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b4400b6b0 msgr2=0x7f5b4400db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f5b61d00640 1 --2- 172.21.15.29:0/2254034391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b4400b6b0 0x7f5b4400db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f5b62d02640 1 -- 172.21.15.29:0/2254034391 reap_dead start 2024-09-13T18:45:47.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f5b61d00640 1 -- 172.21.15.29:0/2254034391 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c06ed70 con 0x7f5b44008980 2024-09-13T18:45:47.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f5be55f6640 1 --2- 172.21.15.29:0/3987604920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5be00b88d0 0x7f5be0149d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5be00b71d0 tx=0x7f5bd002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c63d87d6ca68434 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7fbfb5f13640 1 --2- 172.21.15.29:0/3283538479 >> v2:172.21.15.96:3300/0 conn(0x7fbfb00b5d40 0x7fbfb0141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f29abfff640 1 --2- 172.21.15.29:0/4217158792 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29a4009be0 0x7f29a40c8000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29a00097a0 tx=0x7f29a002a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf6f74737ed22927 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f7fc2ffd640 1 -- 172.21.15.29:0/2898122677 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc02ae40 con 0x7f7fc40b2f20 2024-09-13T18:45:47.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f7fc2ffd640 1 -- 172.21.15.29:0/2898122677 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc032440 con 0x7f7fc40b2f20 2024-09-13T18:45:47.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f7fc2ffd640 1 -- 172.21.15.29:0/2898122677 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0327d0 con 0x7f7fc40b2f20 2024-09-13T18:45:47.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7fbfa7fff640 1 -- 172.21.15.29:0/3283538479 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667494229 0 0) 0x7fbfb00b3c50 con 0x7fbfb00b6f30 2024-09-13T18:45:47.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7fbfa7fff640 1 -- 172.21.15.29:0/3283538479 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf9c003520 con 0x7fbfb00b6f30 2024-09-13T18:45:47.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7fa1c3fff640 1 --2- 172.21.15.29:0/2772424321 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1bc03b9d0 0x7fa1bc0d0220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009870 tx=0x7fa1b802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57eb4b59d19436cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f5bd7fff640 1 -- 172.21.15.29:0/3987604920 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd002add0 con 0x7f5be00b88d0 2024-09-13T18:45:47.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f5bd7fff640 1 -- 172.21.15.29:0/3987604920 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd0032440 con 0x7f5be00b88d0 2024-09-13T18:45:47.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f5bd7fff640 1 -- 172.21.15.29:0/3987604920 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00327d0 con 0x7f5be00b88d0 2024-09-13T18:45:47.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7fa1c2ffd640 1 -- 172.21.15.29:0/2772424321 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8032440 con 0x7fa1bc03b9d0 2024-09-13T18:45:47.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7fbfa7fff640 1 -- 172.21.15.29:0/3283538479 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196661453 0 0) 0x7fbfb0142630 con 0x7fbfb006c7f0 2024-09-13T18:45:47.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7fbfa7fff640 1 -- 172.21.15.29:0/3283538479 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf9c003840 con 0x7fbfb006c7f0 2024-09-13T18:45:47.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7fbfb5f13640 1 -- 172.21.15.29:0/3283538479 >> v1:172.21.15.96:6789/0 conn(0x7fbfb00b6f30 legacy=0x7fbfb00b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7fbfb5f13640 1 -- 172.21.15.29:0/3283538479 >> v1:172.21.15.29:6789/0 conn(0x7fbfb006c7f0 legacy=0x7fbfb00b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7fbfb5f13640 1 -- 172.21.15.29:0/3283538479 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb01422c0 con 0x7fbfb00b5d40 2024-09-13T18:45:47.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7fa1c2ffd640 1 -- 172.21.15.29:0/2772424321 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b80325a0 con 0x7fa1bc03b9d0 2024-09-13T18:45:47.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7fa1c2ffd640 1 -- 172.21.15.29:0/2772424321 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8032930 con 0x7fa1bc03b9d0 2024-09-13T18:45:47.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7f5b61d00640 1 --2- 172.21.15.29:0/2254034391 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b44008980 0x7f5b4400ae10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b50009860 tx=0x7f5b440036f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23dda510c989d05b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7f29aaffd640 1 -- 172.21.15.29:0/4217158792 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a002ae30 con 0x7f29a4009be0 2024-09-13T18:45:47.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7f29aaffd640 1 -- 172.21.15.29:0/4217158792 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a0032440 con 0x7f29a4009be0 2024-09-13T18:45:47.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f8052d9d640 1 -- 172.21.15.29:0/3388049885 >> v2:172.21.15.29:3300/0 conn(0x7f8054146f40 msgr2=0x7f80540b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f8052d9d640 1 --2- 172.21.15.29:0/3388049885 >> v2:172.21.15.29:3300/0 conn(0x7f8054146f40 0x7f80540b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f8052d9d640 1 -- 172.21.15.29:0/3388049885 >> v1:172.21.15.29:6789/0 conn(0x7f80540b5500 legacy=0x7f805413d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.563+0000 7f8052d9d640 1 -- 172.21.15.29:0/3388049885 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8054066f50 con 0x7f80540b5940 2024-09-13T18:45:47.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7f29aaffd640 1 -- 172.21.15.29:0/4217158792 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00327d0 con 0x7f29a4009be0 2024-09-13T18:45:47.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5002aa50 con 0x7f5b44008980 2024-09-13T18:45:47.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5002abd0 con 0x7f5b44008980 2024-09-13T18:45:47.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7f7fca2b1640 1 -- 172.21.15.29:0/2898122677 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fc40b2f20 msgr2=0x7f7fc40b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7f7fca2b1640 1 --2- 172.21.15.29:0/2898122677 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fc40b2f20 0x7f7fc40b4620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0097a0 tx=0x7f7fbc02a0f0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7f5be785a640 1 -- 172.21.15.29:0/3987604920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5be00b88d0 msgr2=0x7f5be0149d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.564+0000 7f5be785a640 1 --2- 172.21.15.29:0/3987604920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5be00b88d0 0x7f5be0149d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5be00b71d0 tx=0x7f5bd002a080 comp rx=0 tx=0).stop 2024-09-13T18:45:47.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5be785a640 1 -- 172.21.15.29:0/3987604920 shutdown_connections 2024-09-13T18:45:47.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5be785a640 1 --2- 172.21.15.29:0/3987604920 >> v2:172.21.15.29:3300/0 conn(0x7f5be014a2a0 0x7f5be0143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5be785a640 1 --2- 172.21.15.29:0/3987604920 >> v2:172.21.15.96:3300/0 conn(0x7f5be00b1d70 0x7f5be0143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5be785a640 1 --2- 172.21.15.29:0/3987604920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5be00b88d0 0x7f5be0149d60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5be785a640 1 -- 172.21.15.29:0/3987604920 >> 172.21.15.29:0/3987604920 conn(0x7f5be0071da0 msgr2=0x7f5be00b7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f7fca2b1640 1 -- 172.21.15.29:0/2898122677 shutdown_connections 2024-09-13T18:45:47.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f7fca2b1640 1 --2- 172.21.15.29:0/2898122677 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fc40b2f20 0x7f7fc40b4620 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f7fca2b1640 1 --2- 172.21.15.29:0/2898122677 >> v2:172.21.15.29:3300/0 conn(0x7f7fc40b7b10 0x7f7fc40b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f7fca2b1640 1 -- 172.21.15.29:0/2898122677 >> 172.21.15.29:0/2898122677 conn(0x7f7fc406a2f0 msgr2=0x7f7fc406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7fbfb5f13640 1 --2- 172.21.15.29:0/3283538479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb00b5d40 0x7fbfb0141950 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800aea0 tx=0x7fbfa802a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ac8c73e5c6c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5be785a640 1 -- 172.21.15.29:0/3987604920 shutdown_connections 2024-09-13T18:45:47.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5be785a640 1 -- 172.21.15.29:0/3987604920 wait complete. 2024-09-13T18:45:47.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f29b284f640 1 -- 172.21.15.29:0/4217158792 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29a4009be0 msgr2=0x7f29a40c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/2772424321 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1bc03b9d0 msgr2=0x7fa1bc0d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7fa1ca6d7640 1 --2- 172.21.15.29:0/2772424321 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1bc03b9d0 0x7fa1bc0d0220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009870 tx=0x7fa1b802a270 comp rx=0 tx=0).stop 2024-09-13T18:45:47.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f29b284f640 1 --2- 172.21.15.29:0/4217158792 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29a4009be0 0x7f29a40c8000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29a00097a0 tx=0x7f29a002a0e0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f8052d9d640 1 --2- 172.21.15.29:0/3388049885 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80540b5940 0x7f805414e000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f804c009d90 tx=0x7f804c02a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77ac3a8239bb7439 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f29b284f640 1 -- 172.21.15.29:0/4217158792 shutdown_connections 2024-09-13T18:45:47.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f29b284f640 1 --2- 172.21.15.29:0/4217158792 >> v2:172.21.15.96:3300/0 conn(0x7f29a4006a20 0x7f29a40d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5b614ff640 1 -- 172.21.15.29:0/2254034391 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50032440 con 0x7f5b44008980 2024-09-13T18:45:47.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f29b284f640 1 --2- 172.21.15.29:0/4217158792 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29a4009be0 0x7f29a40c8000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f29b284f640 1 -- 172.21.15.29:0/4217158792 >> 172.21.15.29:0/4217158792 conn(0x7f29a4008e50 msgr2=0x7f29a4009260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5b64765640 1 -- 172.21.15.29:0/2254034391 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b44008980 msgr2=0x7f5b4400ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5b64765640 1 --2- 172.21.15.29:0/2254034391 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b44008980 0x7f5b4400ae10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b50009860 tx=0x7f5b440036f0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f8051d9b640 1 -- 172.21.15.29:0/3388049885 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c007740 con 0x7f80540b5940 2024-09-13T18:45:47.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f7fca2b1640 1 -- 172.21.15.29:0/2898122677 shutdown_connections 2024-09-13T18:45:47.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5b64765640 1 -- 172.21.15.29:0/2254034391 shutdown_connections 2024-09-13T18:45:47.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f8051d9b640 1 -- 172.21.15.29:0/3388049885 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c02d050 con 0x7f80540b5940 2024-09-13T18:45:47.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f8051d9b640 1 -- 172.21.15.29:0/3388049885 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c007ac0 con 0x7f80540b5940 2024-09-13T18:45:47.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f7fca2b1640 1 -- 172.21.15.29:0/2898122677 wait complete. 2024-09-13T18:45:47.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7fbfa7fff640 1 -- 172.21.15.29:0/3283538479 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800a2d0 con 0x7fbfb00b5d40 2024-09-13T18:45:47.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5b64765640 1 --2- 172.21.15.29:0/2254034391 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b44008980 0x7f5b4400ae10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7f5b64765640 1 -- 172.21.15.29:0/2254034391 >> 172.21.15.29:0/2254034391 conn(0x7f5b5c0b59d0 msgr2=0x7f5b5c0b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7fbfa7fff640 1 -- 172.21.15.29:0/3283538479 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa802d050 con 0x7fbfb00b5d40 2024-09-13T18:45:47.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.565+0000 7fbfa7fff640 1 -- 172.21.15.29:0/3283538479 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8008660 con 0x7fbfb00b5d40 2024-09-13T18:45:47.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7f5b64765640 1 -- 172.21.15.29:0/2254034391 shutdown_connections 2024-09-13T18:45:47.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7f5b64765640 1 -- 172.21.15.29:0/2254034391 wait complete. 2024-09-13T18:45:47.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/2772424321 shutdown_connections 2024-09-13T18:45:47.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7fa1ca6d7640 1 --2- 172.21.15.29:0/2772424321 >> v2:172.21.15.29:3300/0 conn(0x7fa1bc0cda60 0x7fa1bc0d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7fa1ca6d7640 1 --2- 172.21.15.29:0/2772424321 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1bc03b9d0 0x7fa1bc0d0220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/2772424321 >> 172.21.15.29:0/2772424321 conn(0x7fa1bc03ec00 msgr2=0x7fa1bc03b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/2772424321 shutdown_connections 2024-09-13T18:45:47.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/2772424321 wait complete. 2024-09-13T18:45:47.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7fbfb7976640 1 -- 172.21.15.29:0/3283538479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb00b5d40 msgr2=0x7fbfb0141950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7fbfb7976640 1 --2- 172.21.15.29:0/3283538479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb00b5d40 0x7fbfb0141950 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800aea0 tx=0x7fbfa802a610 comp rx=0 tx=0).stop 2024-09-13T18:45:47.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7fbfb7976640 1 -- 172.21.15.29:0/3283538479 shutdown_connections 2024-09-13T18:45:47.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7fbfb7976640 1 --2- 172.21.15.29:0/3283538479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb00b5d40 0x7fbfb0141950 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7fbfb7976640 1 -- 172.21.15.29:0/3283538479 >> 172.21.15.29:0/3283538479 conn(0x7fbfb0099230 msgr2=0x7fbfb0099640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7f805359e640 1 -- 172.21.15.29:0/3388049885 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80540b5940 msgr2=0x7f805414e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.566+0000 7f805359e640 1 --2- 172.21.15.29:0/3388049885 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80540b5940 0x7f805414e000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f804c009d90 tx=0x7f804c02a6a0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.567+0000 7f5be785a640 1 Processor -- start 2024-09-13T18:45:47.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.567+0000 7fbfb7976640 1 -- 172.21.15.29:0/3283538479 shutdown_connections 2024-09-13T18:45:47.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.567+0000 7f805359e640 1 -- 172.21.15.29:0/3388049885 shutdown_connections 2024-09-13T18:45:47.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.567+0000 7f805359e640 1 --2- 172.21.15.29:0/3388049885 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80540b5940 0x7f805414e000 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.567+0000 7f805359e640 1 --2- 172.21.15.29:0/3388049885 >> v2:172.21.15.29:3300/0 conn(0x7f8054146f40 0x7f80540b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.567+0000 7f805359e640 1 -- 172.21.15.29:0/3388049885 >> 172.21.15.29:0/3388049885 conn(0x7f80540994b0 msgr2=0x7f80540998c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.567+0000 7fbfb7976640 1 -- 172.21.15.29:0/3283538479 wait complete. 2024-09-13T18:45:47.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.567+0000 7f29b284f640 1 -- 172.21.15.29:0/4217158792 shutdown_connections 2024-09-13T18:45:47.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.567+0000 7f29b284f640 1 -- 172.21.15.29:0/4217158792 wait complete. 2024-09-13T18:45:47.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.567+0000 7f5b64765640 1 Processor -- start 2024-09-13T18:45:47.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.567+0000 7f7fca2b1640 1 Processor -- start 2024-09-13T18:45:47.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.567+0000 7f5be785a640 1 -- start start 2024-09-13T18:45:47.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.568+0000 7f7fca2b1640 1 -- start start 2024-09-13T18:45:47.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.568+0000 7f805359e640 1 -- 172.21.15.29:0/3388049885 shutdown_connections 2024-09-13T18:45:47.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.568+0000 7fa1ca6d7640 1 Processor -- start 2024-09-13T18:45:47.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.568+0000 7f5be785a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5be00b1d70 0x7f5be014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.568+0000 7fa1ca6d7640 1 -- start start 2024-09-13T18:45:47.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.568+0000 7f805359e640 1 -- 172.21.15.29:0/3388049885 wait complete. 2024-09-13T18:45:47.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7fbfb7976640 1 Processor -- start 2024-09-13T18:45:47.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.568+0000 7f5be785a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be00b88d0 0x7f5be01eb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5be785a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be014a2a0 0x7f5be006dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5be785a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0147b10 con 0x7f5be014a2a0 2024-09-13T18:45:47.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5be785a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0146510 con 0x7f5be00b88d0 2024-09-13T18:45:47.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5be785a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be006e650 con 0x7f5be00b1d70 2024-09-13T18:45:47.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.568+0000 7f5b64765640 1 -- start start 2024-09-13T18:45:47.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7fbfb7976640 1 -- start start 2024-09-13T18:45:47.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5b64765640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b44008980 0x7f5b5c13e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5b64765640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b5c0a97c0 0x7f5b5c1da680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5b64765640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b5c1dabc0 0x7f5b5c0a7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5b64765640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0aae20 con 0x7f5b5c0a97c0 2024-09-13T18:45:47.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5b64765640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c1db080 con 0x7f5b44008980 2024-09-13T18:45:47.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5b64765640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c1db360 con 0x7f5b5c1dabc0 2024-09-13T18:45:47.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5b62501640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b44008980 0x7f5b5c13e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5b62501640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b44008980 0x7f5b5c13e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38810/0 (socket says 172.21.15.29:38810) 2024-09-13T18:45:47.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5b62501640 1 -- 172.21.15.29:0/4211222410 learned_addr learned my addr 172.21.15.29:0/4211222410 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:47.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5b61d00640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b5c0a97c0 0x7f5b5c1da680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f7fca2b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fc406c420 0x7f7fc406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f7fca2b1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40b2f20 0x7f7fc4070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f7fca2b1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc40b7b10 0x7f7fc41e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5be5df7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be014a2a0 0x7f5be006dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5be5df7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be014a2a0 0x7f5be006dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40980/0 (socket says 172.21.15.29:40980) 2024-09-13T18:45:47.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f5be5df7640 1 -- 172.21.15.29:0/2782786270 learned_addr learned my addr 172.21.15.29:0/2782786270 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:47.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f29b284f640 1 Processor -- start 2024-09-13T18:45:47.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7f29b284f640 1 -- start start 2024-09-13T18:45:47.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7fa1ca6d7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1bc038f50 0x7fa1bc01fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.569+0000 7fa1ca6d7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1bc03b9d0 0x7fa1bc165f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f7fca2b1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc406f390 con 0x7f7fc40b2f20 2024-09-13T18:45:47.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7fa1ca6d7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1bc0cda60 0x7fa1bc166450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7fa1ca6d7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0d2e70 con 0x7fa1bc03b9d0 2024-09-13T18:45:47.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7fa1ca6d7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc020860 con 0x7fa1bc0cda60 2024-09-13T18:45:47.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f7fc884e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc40b7b10 0x7f7fc41e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7fa1c8c74640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1bc0cda60 0x7fa1bc166450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7fa1c8c74640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1bc0cda60 0x7fa1bc166450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38836/0 (socket says 172.21.15.29:38836) 2024-09-13T18:45:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7fa1c8c74640 1 -- 172.21.15.29:0/3858854796 learned_addr learned my addr 172.21.15.29:0/3858854796 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/3858854796 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc020560 con 0x7fa1bc038f50 2024-09-13T18:45:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f5be5df7640 1 -- 172.21.15.29:0/2782786270 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5be00b1d70 msgr2=0x7f5be014d550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:45:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f5be5df7640 1 --2- 172.21.15.29:0/2782786270 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5be00b1d70 0x7f5be014d550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f5be5df7640 1 -- 172.21.15.29:0/2782786270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be00b88d0 msgr2=0x7f5be01eb550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:45:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f5be5df7640 1 --2- 172.21.15.29:0/2782786270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be00b88d0 0x7f5be01eb550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f5be5df7640 1 -- 172.21.15.29:0/2782786270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8009b30 con 0x7f5be014a2a0 2024-09-13T18:45:47.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f805359e640 1 Processor -- start 2024-09-13T18:45:47.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f7fc37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40b2f20 0x7f7fc4070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f7fc37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40b2f20 0x7f7fc4070d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40994/0 (socket says 172.21.15.29:40994) 2024-09-13T18:45:47.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f7fc37fe640 1 -- 172.21.15.29:0/1725843858 learned_addr learned my addr 172.21.15.29:0/1725843858 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f7fca2b1640 1 -- 172.21.15.29:0/1725843858 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40702e0 con 0x7f7fc40b7b10 2024-09-13T18:45:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f5b62501640 1 -- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b5c1dabc0 msgr2=0x7f5b5c0a7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f5b62501640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b5c1dabc0 0x7f5b5c0a7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f5b62501640 1 -- 172.21.15.29:0/4211222410 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b5c0a97c0 msgr2=0x7f5b5c1da680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f5b62501640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b5c0a97c0 0x7f5b5c1da680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f5b62501640 1 -- 172.21.15.29:0/4211222410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c142a70 con 0x7f5b44008980 2024-09-13T18:45:47.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f5b61d00640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b5c0a97c0 0x7f5b5c1da680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:47.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7fa1c37fe640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1bc03b9d0 0x7fa1bc165f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f29b284f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29a4006a20 0x7f29a4034ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7fbfb7976640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb006c7f0 0x7fbfb00b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f7fca2b1640 1 -- 172.21.15.29:0/1725843858 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40705c0 con 0x7f7fc406c420 2024-09-13T18:45:47.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f29b284f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29a4009be0 0x7f29a40c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f5b62501640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b44008980 0x7f5b5c13e8a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00c730 tx=0x7f5b4c00cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fa1c8c74640 1 -- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1bc038f50 msgr2=0x7fa1bc01fed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:45:47.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fa1c8c74640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1bc038f50 0x7fa1bc01fed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fa1c8c74640 1 -- 172.21.15.29:0/3858854796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1bc03b9d0 msgr2=0x7fa1bc165f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fa1c8c74640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1bc03b9d0 0x7fa1bc165f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fa1c8c74640 1 -- 172.21.15.29:0/3858854796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b80094d0 con 0x7fa1bc0cda60 2024-09-13T18:45:47.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f7fc3fff640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fc406c420 0x7f7fc406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f29abfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29a4006a20 0x7f29a4034ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f29abfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29a4006a20 0x7f29a4034ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38852/0 (socket says 172.21.15.29:38852) 2024-09-13T18:45:47.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f29abfff640 1 -- 172.21.15.29:0/3098168830 learned_addr learned my addr 172.21.15.29:0/3098168830 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:47.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f29b284f640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29a415dd70 0x7f29a40ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fbfb7976640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfb00b5d40 0x7fbfb01d5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fbfb7976640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfb00b6f30 0x7fbfb0098590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fbfb7976640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb01d7060 con 0x7fbfb00b6f30 2024-09-13T18:45:47.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fbfb7976640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb01d7880 con 0x7fbfb006c7f0 2024-09-13T18:45:47.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fbfb7976640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb01d5580 con 0x7fbfb00b5d40 2024-09-13T18:45:47.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.570+0000 7f805359e640 1 -- start start 2024-09-13T18:45:47.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f5b5affd640 1 -- 172.21.15.29:0/4211222410 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c00a840 con 0x7f5b44008980 2024-09-13T18:45:47.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f5b5affd640 1 -- 172.21.15.29:0/4211222410 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c00a9a0 con 0x7f5b44008980 2024-09-13T18:45:47.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f5b5affd640 1 -- 172.21.15.29:0/4211222410 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c00ad50 con 0x7f5b44008980 2024-09-13T18:45:47.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f5b64765640 1 -- 172.21.15.29:0/4211222410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c0a9210 con 0x7f5b44008980 2024-09-13T18:45:47.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a4161680 con 0x7f29a4009be0 2024-09-13T18:45:47.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fa1c8c74640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1bc0cda60 0x7fa1bc166450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000b440 tx=0x7fa1b000b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a4161960 con 0x7f29a4006a20 2024-09-13T18:45:47.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f29b0dec640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29a415dd70 0x7f29a40ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f5b64765640 1 -- 172.21.15.29:0/4211222410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c13efc0 con 0x7f5b44008980 2024-09-13T18:45:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a4161c40 con 0x7f29a415dd70 2024-09-13T18:45:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f805359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80540b5500 0x7f80541e2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f805359e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80540b5940 0x7f8054143450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f805359e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8054146f40 0x7f8054143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f805359e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8054142720 con 0x7f80540b5500 2024-09-13T18:45:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f805359e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805406fb70 con 0x7f80540b5940 2024-09-13T18:45:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f805359e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8054142970 con 0x7f8054146f40 2024-09-13T18:45:47.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f5be5df7640 1 --2- 172.21.15.29:0/2782786270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be014a2a0 0x7f5be006dbb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00d5d0 tx=0x7f5bdc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fa1c0ff9640 1 -- 172.21.15.29:0/3858854796 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0011830 con 0x7fa1bc0cda60 2024-09-13T18:45:47.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fa1c0ff9640 1 -- 172.21.15.29:0/3858854796 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0011990 con 0x7fa1bc0cda60 2024-09-13T18:45:47.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fa1c0ff9640 1 -- 172.21.15.29:0/3858854796 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0011d40 con 0x7fa1bc0cda60 2024-09-13T18:45:47.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/3858854796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc036010 con 0x7fa1bc0cda60 2024-09-13T18:45:47.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/3858854796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc01ee40 con 0x7fa1bc0cda60 2024-09-13T18:45:47.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.571+0000 7f7fc3fff640 1 -- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc40b7b10 msgr2=0x7f7fc41e2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f7fc3fff640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc40b7b10 0x7f7fc41e2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f7fc3fff640 1 -- 172.21.15.29:0/1725843858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40b2f20 msgr2=0x7f7fc4070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f7fc3fff640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40b2f20 0x7f7fc4070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f7fc3fff640 1 -- 172.21.15.29:0/1725843858 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc009400 con 0x7f7fc406c420 2024-09-13T18:45:47.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f7fc884e640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc40b7b10 0x7f7fc41e2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:47.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f7fc37fe640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40b2f20 0x7f7fc4070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:47.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f8049d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80540b5940 0x7f8054143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f8052d9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8054146f40 0x7f8054143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f8052d9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8054146f40 0x7f8054143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44340/0 (socket says 172.21.15.29:44340) 2024-09-13T18:45:47.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f8052d9d640 1 -- 172.21.15.29:0/1361913605 learned_addr learned my addr 172.21.15.29:0/1361913605 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:47.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f29abfff640 1 -- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29a415dd70 msgr2=0x7f29a40ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f29abfff640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29a415dd70 0x7f29a40ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f29abfff640 1 -- 172.21.15.29:0/3098168830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29a4009be0 msgr2=0x7f29a40c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f29abfff640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29a4009be0 0x7f29a40c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f29abfff640 1 -- 172.21.15.29:0/3098168830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a0009400 con 0x7f29a4006a20 2024-09-13T18:45:47.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7fbfb5712640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb006c7f0 0x7fbfb00b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f7fc3fff640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fc406c420 0x7f7fc406e6f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4007e60 tx=0x7f7fb400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7fbfb4f11640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfb00b5d40 0x7fbfb01d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f8052d9d640 1 -- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80540b5940 msgr2=0x7f8054143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f8052d9d640 1 --2- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80540b5940 0x7f8054143450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f8052d9d640 1 -- 172.21.15.29:0/1361913605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80540b5500 msgr2=0x7f80541e2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f8052d9d640 1 --2- 172.21.15.29:0/1361913605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80540b5500 0x7f80541e2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f8052d9d640 1 -- 172.21.15.29:0/1361913605 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c009a70 con 0x7f8054146f40 2024-09-13T18:45:47.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7fbfb4f11640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfb00b5d40 0x7fbfb01d5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44352/0 (socket says 172.21.15.29:44352) 2024-09-13T18:45:47.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7fbfb5712640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb006c7f0 0x7fbfb00b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38878/0 (socket says 172.21.15.29:38878) 2024-09-13T18:45:47.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7fbfb4f11640 1 -- 172.21.15.29:0/2563441748 learned_addr learned my addr 172.21.15.29:0/2563441748 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:47.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f5bd5ffb640 1 -- 172.21.15.29:0/2782786270 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0125f0 con 0x7f5be014a2a0 2024-09-13T18:45:47.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7f5bd5ffb640 1 -- 172.21.15.29:0/2782786270 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc012770 con 0x7f5be014a2a0 2024-09-13T18:45:47.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7f7fc0ff9640 1 -- 172.21.15.29:0/1725843858 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4014620 con 0x7f7fc406c420 2024-09-13T18:45:47.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7f7fc0ff9640 1 -- 172.21.15.29:0/1725843858 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb400ee90 con 0x7f7fc406c420 2024-09-13T18:45:47.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7f7fc0ff9640 1 -- 172.21.15.29:0/1725843858 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4014620 con 0x7f7fc406c420 2024-09-13T18:45:47.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.572+0000 7fbfb5f13640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfb00b6f30 0x7fbfb0098590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7f8052d9d640 1 --2- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8054146f40 0x7f8054143990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f804c009d90 tx=0x7f804c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7f7fca2b1640 1 -- 172.21.15.29:0/1725843858 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc406ecd0 con 0x7f7fc406c420 2024-09-13T18:45:47.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7fbfb4f11640 1 -- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb006c7f0 msgr2=0x7fbfb00b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7fbfb4f11640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb006c7f0 0x7fbfb00b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7fbfb4f11640 1 -- 172.21.15.29:0/2563441748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfb00b6f30 msgr2=0x7fbfb0098590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7f7fca2b1640 1 -- 172.21.15.29:0/1725843858 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc406ff40 con 0x7f7fc406c420 2024-09-13T18:45:47.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7fbfb4f11640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfb00b6f30 0x7fbfb0098590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7fbfb4f11640 1 -- 172.21.15.29:0/2563441748 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa800ab80 con 0x7fbfb00b5d40 2024-09-13T18:45:47.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7f5bd5ffb640 1 -- 172.21.15.29:0/2782786270 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc012b20 con 0x7f5be014a2a0 2024-09-13T18:45:47.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7f5be785a640 1 -- 172.21.15.29:0/2782786270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd0009400 con 0x7f5be014a2a0 2024-09-13T18:45:47.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.574+0000 7f5be785a640 1 -- 172.21.15.29:0/2782786270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be01458e0 con 0x7f5be014a2a0 2024-09-13T18:45:47.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.574+0000 7fbfb4f11640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfb00b5d40 0x7fbfb01d5040 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000b430 tx=0x7fbfa000b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.574+0000 7f5b5affd640 1 -- 172.21.15.29:0/4211222410 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b4c01c3b0 con 0x7f5b44008980 2024-09-13T18:45:47.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7f804b7fe640 1 -- 172.21.15.29:0/1361913605 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c031950 con 0x7f8054146f40 2024-09-13T18:45:47.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7f804b7fe640 1 -- 172.21.15.29:0/1361913605 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c031ab0 con 0x7f8054146f40 2024-09-13T18:45:47.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.574+0000 7f5b5affd640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5b4806ad00 0x7f5b4806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.575+0000 7f5b5affd640 1 -- 172.21.15.29:0/4211222410 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b4c088d50 con 0x7f5b44008980 2024-09-13T18:45:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.573+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/3858854796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1bc008ca0 con 0x7fa1bc0cda60 2024-09-13T18:45:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.574+0000 7fa1c0ff9640 1 -- 172.21.15.29:0/3858854796 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa1b001a400 con 0x7fa1bc0cda60 2024-09-13T18:45:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.575+0000 7fa1c0ff9640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa1a806acd0 0x7fa1a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.575+0000 7fa1c0ff9640 1 -- 172.21.15.29:0/3858854796 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa1b0089530 con 0x7fa1bc0cda60 2024-09-13T18:45:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.575+0000 7fa1c3fff640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa1a806acd0 0x7fa1a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.574+0000 7fbfa5ffb640 1 -- 172.21.15.29:0/2563441748 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0006030 con 0x7fbfb00b5d40 2024-09-13T18:45:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.574+0000 7fbfa5ffb640 1 -- 172.21.15.29:0/2563441748 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa00061b0 con 0x7fbfb00b5d40 2024-09-13T18:45:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.574+0000 7fbfb7976640 1 -- 172.21.15.29:0/2563441748 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb01d7270 con 0x7fbfb00b5d40 2024-09-13T18:45:47.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.574+0000 7f804b7fe640 1 -- 172.21.15.29:0/1361913605 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c031950 con 0x7f8054146f40 2024-09-13T18:45:47.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.576+0000 7f5b64765640 1 -- 172.21.15.29:0/4211222410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c005250 con 0x7f5b44008980 2024-09-13T18:45:47.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.575+0000 7f7fc0ff9640 1 -- 172.21.15.29:0/1725843858 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7fb4014780 con 0x7f7fc406c420 2024-09-13T18:45:47.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.575+0000 7f7fca2b1640 1 -- 172.21.15.29:0/1725843858 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa8005250 con 0x7f7fc406c420 2024-09-13T18:45:47.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.576+0000 7fbfa5ffb640 1 -- 172.21.15.29:0/2563441748 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0006560 con 0x7fbfb00b5d40 2024-09-13T18:45:47.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.576+0000 7f29abfff640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29a4006a20 0x7f29a4034ca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29a002a6d0 tx=0x7f29a00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.576+0000 7f805359e640 1 -- 172.21.15.29:0/1361913605 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8054142c50 con 0x7f8054146f40 2024-09-13T18:45:47.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.576+0000 7f5b61d00640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5b4806ad00 0x7f5b4806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.576+0000 7fbfb7976640 1 -- 172.21.15.29:0/2563441748 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb00b0a10 con 0x7fbfb00b5d40 2024-09-13T18:45:47.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.575+0000 7f5be785a640 1 -- 172.21.15.29:0/2782786270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be00b2aa0 con 0x7f5be014a2a0 2024-09-13T18:45:47.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.576+0000 7f805359e640 1 -- 172.21.15.29:0/1361913605 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80540b18c0 con 0x7f8054146f40 2024-09-13T18:45:47.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.576+0000 7f7fc0ff9640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7fa406ac90 0x7f7fa406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.576+0000 7f7fc0ff9640 1 -- 172.21.15.29:0/1725843858 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7fb4089bc0 con 0x7f7fc406c420 2024-09-13T18:45:47.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.577+0000 7fa1c3fff640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa1a806acd0 0x7fa1a806d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8034000 tx=0x7fa1b802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.576+0000 7f5bd5ffb640 1 -- 172.21.15.29:0/2782786270 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5bdc012c80 con 0x7f5be014a2a0 2024-09-13T18:45:47.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.577+0000 7f5b61d00640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5b4806ad00 0x7f5b4806d1c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5b50034000 tx=0x7f5b5002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.577+0000 7f7fc37fe640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7fa406ac90 0x7f7fa406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.577+0000 7f5bd5ffb640 1 --2- 172.21.15.29:0/2782786270 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5bc406ac50 0x7f5bc406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.577+0000 7f5bd5ffb640 1 -- 172.21.15.29:0/2782786270 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5bdc089200 con 0x7f5be014a2a0 2024-09-13T18:45:47.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.577+0000 7f5be55f6640 1 --2- 172.21.15.29:0/2782786270 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5bc406ac50 0x7f5bc406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.577+0000 7f805359e640 1 -- 172.21.15.29:0/1361913605 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80540ae970 con 0x7f8054146f40 2024-09-13T18:45:47.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.577+0000 7fbfb7976640 1 -- 172.21.15.29:0/2563441748 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb0099cd0 con 0x7fbfb00b5d40 2024-09-13T18:45:47.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.578+0000 7f7fc37fe640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7fa406ac90 0x7f7fa406d150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7fac007fd0 tx=0x7f7fac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.578+0000 7f5be55f6640 1 --2- 172.21.15.29:0/2782786270 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5bc406ac50 0x7f5bc406d110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0034000 tx=0x7f5bd002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.578+0000 7fbfa5ffb640 1 -- 172.21.15.29:0/2563441748 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbfa00066c0 con 0x7fbfb00b5d40 2024-09-13T18:45:47.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.578+0000 7f804b7fe640 1 -- 172.21.15.29:0/1361913605 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f804c031c20 con 0x7f8054146f40 2024-09-13T18:45:47.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.578+0000 7fbfa5ffb640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbf9406ac50 0x7fbf9406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.579+0000 7fbfa5ffb640 1 -- 172.21.15.29:0/2563441748 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbfa0089330 con 0x7fbfb00b5d40 2024-09-13T18:45:47.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.579+0000 7fbfb5712640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbf9406ac50 0x7fbf9406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.579+0000 7f804b7fe640 1 --2- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f803406ac90 0x7f803406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.579+0000 7f805259c640 1 --2- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f803406ac90 0x7f803406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.579+0000 7fbfb5712640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbf9406ac50 0x7fbf9406d110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbfac000f60 tx=0x7fbfac007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.579+0000 7f805259c640 1 --2- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f803406ac90 0x7f803406d150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f803c009770 tx=0x7f803c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.580+0000 7fa1c0ff9640 1 -- 172.21.15.29:0/3858854796 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa1b0054490 con 0x7fa1bc0cda60 2024-09-13T18:45:47.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.581+0000 7f804b7fe640 1 -- 172.21.15.29:0/1361913605 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f804c079980 con 0x7f8054146f40 2024-09-13T18:45:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.582+0000 7f7fc0ff9640 1 -- 172.21.15.29:0/1725843858 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7fb4054a20 con 0x7f7fc406c420 2024-09-13T18:45:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.582+0000 7f5bd5ffb640 1 -- 172.21.15.29:0/2782786270 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5bdc08e060 con 0x7f5be014a2a0 2024-09-13T18:45:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.584+0000 7f29a8ff9640 1 -- 172.21.15.29:0/3098168830 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a003e920 con 0x7f29a4006a20 2024-09-13T18:45:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.584+0000 7f29a8ff9640 1 -- 172.21.15.29:0/3098168830 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a003eaa0 con 0x7f29a4006a20 2024-09-13T18:45:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.584+0000 7f29a8ff9640 1 -- 172.21.15.29:0/3098168830 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a003ee50 con 0x7f29a4006a20 2024-09-13T18:45:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.586+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a4162160 con 0x7f29a4006a20 2024-09-13T18:45:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.586+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a40cc690 con 0x7f29a4006a20 2024-09-13T18:45:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.586+0000 7f5b5affd640 1 -- 172.21.15.29:0/4211222410 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5b4c018080 con 0x7f5b44008980 2024-09-13T18:45:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.586+0000 7fbfa5ffb640 1 -- 172.21.15.29:0/2563441748 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbfa0054310 con 0x7fbfb00b5d40 2024-09-13T18:45:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.587+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a41614c0 con 0x7f29a4006a20 2024-09-13T18:45:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.589+0000 7f29a8ff9640 1 -- 172.21.15.29:0/3098168830 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f29a0030440 con 0x7f29a4006a20 2024-09-13T18:45:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.590+0000 7f29a8ff9640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f299006acd0 0x7f299006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.590+0000 7f29a8ff9640 1 -- 172.21.15.29:0/3098168830 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29a00aa4e0 con 0x7f29a4006a20 2024-09-13T18:45:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.590+0000 7f29ab7fe640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f299006acd0 0x7f299006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.591+0000 7f804b7fe640 1 -- 172.21.15.29:0/1361913605 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f804c0755c0 con 0x7f8054146f40 2024-09-13T18:45:47.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.591+0000 7f29ab7fe640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f299006acd0 0x7f299006d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2998007fd0 tx=0x7f2998007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.594+0000 7f29a8ff9640 1 -- 172.21.15.29:0/3098168830 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f29a0075440 con 0x7f29a4006a20 2024-09-13T18:45:47.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.914+0000 7f821e487640 1 -- 172.21.15.29:0/2916054195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f821813e3b0 con 0x7f82180aed70 2024-09-13T18:45:47.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.915+0000 7f820dffb640 1 -- 172.21.15.29:0/2916054195 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f821813e3b0 con 0x7f82180aed70 2024-09-13T18:45:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-09-13T18:45:47.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.919+0000 7f82037fe640 1 -- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f81fc06ac00 msgr2=0x7f81fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.919+0000 7f82037fe640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f81fc06ac00 0x7f81fc06d0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8208006fd0 tx=0x7f8208008040 comp rx=0 tx=0).stop 2024-09-13T18:45:47.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.919+0000 7f82037fe640 1 -- 172.21.15.29:0/2916054195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82180aed70 msgr2=0x7f82181eaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.919+0000 7f82037fe640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82180aed70 0x7f82181eaac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f821400d9c0 tx=0x7f82140046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.919+0000 7f82037fe640 1 -- 172.21.15.29:0/2916054195 shutdown_connections 2024-09-13T18:45:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.919+0000 7f82037fe640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f81fc06ac00 0x7f81fc06d0c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.920+0000 7f82037fe640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82180b0380 0x7f82181e1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.920+0000 7f82037fe640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82180aed70 0x7f82181eaac0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.920+0000 7f82037fe640 1 --2- 172.21.15.29:0/2916054195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82180713e0 0x7f82181420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.920+0000 7f82037fe640 1 -- 172.21.15.29:0/2916054195 >> 172.21.15.29:0/2916054195 conn(0x7f82180b7250 msgr2=0x7f821806fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.920+0000 7f82037fe640 1 -- 172.21.15.29:0/2916054195 shutdown_connections 2024-09-13T18:45:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.920+0000 7f82037fe640 1 -- 172.21.15.29:0/2916054195 wait complete. 2024-09-13T18:45:47.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-09-13T18:45:47.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.958+0000 7f805359e640 1 -- 172.21.15.29:0/1361913605 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8054143170 con 0x7f8054146f40 2024-09-13T18:45:47.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.959+0000 7f804b7fe640 1 -- 172.21.15.29:0/1361913605 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8054143170 con 0x7f8054146f40 2024-09-13T18:45:47.962 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2024-09-13T18:45:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.961+0000 7f805359e640 1 -- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f803406ac90 msgr2=0x7f803406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.961+0000 7f805359e640 1 --2- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f803406ac90 0x7f803406d150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f803c009770 tx=0x7f803c008040 comp rx=0 tx=0).stop 2024-09-13T18:45:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.961+0000 7f805359e640 1 -- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8054146f40 msgr2=0x7f8054143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.961+0000 7f805359e640 1 --2- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8054146f40 0x7f8054143990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f804c009d90 tx=0x7f804c004a40 comp rx=0 tx=0).stop 2024-09-13T18:45:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.961+0000 7f805359e640 1 -- 172.21.15.29:0/1361913605 shutdown_connections 2024-09-13T18:45:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.961+0000 7f805359e640 1 --2- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f803406ac90 0x7f803406d150 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.961+0000 7f805359e640 1 --2- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8054146f40 0x7f8054143990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.961+0000 7f805359e640 1 --2- 172.21.15.29:0/1361913605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80540b5940 0x7f8054143450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.961+0000 7f805359e640 1 --2- 172.21.15.29:0/1361913605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80540b5500 0x7f80541e2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.962+0000 7f805359e640 1 -- 172.21.15.29:0/1361913605 >> 172.21.15.29:0/1361913605 conn(0x7f80540994b0 msgr2=0x7f80540b5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.962+0000 7f805359e640 1 -- 172.21.15.29:0/1361913605 shutdown_connections 2024-09-13T18:45:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.962+0000 7f805359e640 1 -- 172.21.15.29:0/1361913605 wait complete. 2024-09-13T18:45:47.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.970+0000 7f5be785a640 1 -- 172.21.15.29:0/2782786270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5be00b2f10 con 0x7f5be014a2a0 2024-09-13T18:45:47.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.971+0000 7f5bd5ffb640 1 -- 172.21.15.29:0/2782786270 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5bdc0540f0 con 0x7f5be014a2a0 2024-09-13T18:45:47.973 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2024-09-13T18:45:47.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-09-13T18:45:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.974+0000 7f5be785a640 1 -- 172.21.15.29:0/2782786270 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5bc406ac50 msgr2=0x7f5bc406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.974+0000 7f5be785a640 1 --2- 172.21.15.29:0/2782786270 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5bc406ac50 0x7f5bc406d110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0034000 tx=0x7f5bd002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.974+0000 7f5be785a640 1 -- 172.21.15.29:0/2782786270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be014a2a0 msgr2=0x7f5be006dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.974+0000 7f5be785a640 1 --2- 172.21.15.29:0/2782786270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be014a2a0 0x7f5be006dbb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00d5d0 tx=0x7f5bdc00da90 comp rx=0 tx=0).stop 2024-09-13T18:45:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.974+0000 7f5be785a640 1 -- 172.21.15.29:0/2782786270 shutdown_connections 2024-09-13T18:45:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.974+0000 7f5be785a640 1 --2- 172.21.15.29:0/2782786270 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5bc406ac50 0x7f5bc406d110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.974+0000 7f5be785a640 1 --2- 172.21.15.29:0/2782786270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be014a2a0 0x7f5be006dbb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.974+0000 7f5be785a640 1 --2- 172.21.15.29:0/2782786270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5be00b88d0 0x7f5be01eb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.974+0000 7f5be785a640 1 --2- 172.21.15.29:0/2782786270 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5be00b1d70 0x7f5be014d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.974+0000 7f5be785a640 1 -- 172.21.15.29:0/2782786270 >> 172.21.15.29:0/2782786270 conn(0x7f5be0071da0 msgr2=0x7f5be0142560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.974+0000 7f5be785a640 1 -- 172.21.15.29:0/2782786270 shutdown_connections 2024-09-13T18:45:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.974+0000 7f5be785a640 1 -- 172.21.15.29:0/2782786270 wait complete. 2024-09-13T18:45:47.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.981+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/3858854796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa1bc01eca0 con 0x7fa1bc0cda60 2024-09-13T18:45:47.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.982+0000 7fa1c0ff9640 1 -- 172.21.15.29:0/3858854796 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa1bc01eca0 con 0x7fa1bc0cda60 2024-09-13T18:45:47.984 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-09-13T18:45:47.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.982+0000 7f7fca2b1640 1 -- 172.21.15.29:0/1725843858 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7fa8005500 con 0x7f7fc406c420 2024-09-13T18:45:47.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.983+0000 7f7fc0ff9640 1 -- 172.21.15.29:0/1725843858 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7fb4058040 con 0x7f7fc406c420 2024-09-13T18:45:47.985 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-09-13T18:45:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.985+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa1a806acd0 msgr2=0x7fa1a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.985+0000 7fa1ca6d7640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa1a806acd0 0x7fa1a806d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8034000 tx=0x7fa1b802e000 comp rx=0 tx=0).stop 2024-09-13T18:45:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.985+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1bc0cda60 msgr2=0x7fa1bc166450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.985+0000 7fa1ca6d7640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1bc0cda60 0x7fa1bc166450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000b440 tx=0x7fa1b000b900 comp rx=0 tx=0).stop 2024-09-13T18:45:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.985+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/3858854796 shutdown_connections 2024-09-13T18:45:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.985+0000 7fa1ca6d7640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa1a806acd0 0x7fa1a806d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.985+0000 7fa1ca6d7640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1bc0cda60 0x7fa1bc166450 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.985+0000 7fa1ca6d7640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1bc03b9d0 0x7fa1bc165f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.985+0000 7fa1ca6d7640 1 --2- 172.21.15.29:0/3858854796 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1bc038f50 0x7fa1bc01fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.985+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/3858854796 >> 172.21.15.29:0/3858854796 conn(0x7fa1bc03ec00 msgr2=0x7fa1bc0cb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.986+0000 7f7fca2b1640 1 -- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7fa406ac90 msgr2=0x7f7fa406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.986+0000 7f7fca2b1640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7fa406ac90 0x7f7fa406d150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7fac007fd0 tx=0x7f7fac009040 comp rx=0 tx=0).stop 2024-09-13T18:45:47.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.986+0000 7f7fca2b1640 1 -- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fc406c420 msgr2=0x7f7fc406e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.985+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/3858854796 shutdown_connections 2024-09-13T18:45:47.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.985+0000 7fa1ca6d7640 1 -- 172.21.15.29:0/3858854796 wait complete. 2024-09-13T18:45:47.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.986+0000 7f7fca2b1640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fc406c420 0x7f7fc406e6f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4007e60 tx=0x7f7fb400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.986+0000 7f7fca2b1640 1 -- 172.21.15.29:0/1725843858 shutdown_connections 2024-09-13T18:45:47.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.986+0000 7f7fca2b1640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7fa406ac90 0x7f7fa406d150 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.986+0000 7f7fca2b1640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc40b7b10 0x7f7fc41e2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.986+0000 7f7fca2b1640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40b2f20 0x7f7fc4070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.986+0000 7f7fca2b1640 1 --2- 172.21.15.29:0/1725843858 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fc406c420 0x7f7fc406e6f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.986+0000 7f7fca2b1640 1 -- 172.21.15.29:0/1725843858 >> 172.21.15.29:0/1725843858 conn(0x7f7fc406a2f0 msgr2=0x7f7fc406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.986+0000 7f7fca2b1640 1 -- 172.21.15.29:0/1725843858 shutdown_connections 2024-09-13T18:45:47.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.986+0000 7f7fca2b1640 1 -- 172.21.15.29:0/1725843858 wait complete. 2024-09-13T18:45:47.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.988+0000 7f5b64765640 1 -- 172.21.15.29:0/4211222410 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5b3c005500 con 0x7f5b44008980 2024-09-13T18:45:47.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.988+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f29a4161aa0 con 0x7f29a4006a20 2024-09-13T18:45:47.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.989+0000 7f5b5affd640 1 -- 172.21.15.29:0/4211222410 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b4c053d60 con 0x7f5b44008980 2024-09-13T18:45:47.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-09-13T18:45:47.995 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-09-13T18:45:47.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.989+0000 7f29a8ff9640 1 -- 172.21.15.29:0/3098168830 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f29a4161aa0 con 0x7f29a4006a20 2024-09-13T18:45:47.995 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-09-13T18:45:47.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.991+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f299006acd0 msgr2=0x7f299006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.991+0000 7f29b284f640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f299006acd0 0x7f299006d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2998007fd0 tx=0x7f2998007960 comp rx=0 tx=0).stop 2024-09-13T18:45:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.991+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29a4006a20 msgr2=0x7f29a4034ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.991+0000 7f29b284f640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29a4006a20 0x7f29a4034ca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29a002a6d0 tx=0x7f29a00046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.991+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 shutdown_connections 2024-09-13T18:45:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.991+0000 7f29b284f640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f299006acd0 0x7f299006d190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.991+0000 7f29b284f640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29a415dd70 0x7f29a40ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.991+0000 7f29b284f640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29a4009be0 0x7f29a40c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.991+0000 7f29b284f640 1 --2- 172.21.15.29:0/3098168830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29a4006a20 0x7f29a4034ca0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.991+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 >> 172.21.15.29:0/3098168830 conn(0x7f29a4008e50 msgr2=0x7f29a4005600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 shutdown_connections 2024-09-13T18:45:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f29b284f640 1 -- 172.21.15.29:0/3098168830 wait complete. 2024-09-13T18:45:47.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f5b64765640 1 -- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5b4806ad00 msgr2=0x7f5b4806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f5b64765640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5b4806ad00 0x7f5b4806d1c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5b50034000 tx=0x7f5b5002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:47.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f5b64765640 1 -- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b44008980 msgr2=0x7f5b5c13e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f5b64765640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b44008980 0x7f5b5c13e8a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00c730 tx=0x7f5b4c00cb30 comp rx=0 tx=0).stop 2024-09-13T18:45:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f5b64765640 1 -- 172.21.15.29:0/4211222410 shutdown_connections 2024-09-13T18:45:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f5b64765640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5b4806ad00 0x7f5b4806d1c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f5b64765640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b5c1dabc0 0x7f5b5c0a7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f5b64765640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b5c0a97c0 0x7f5b5c1da680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f5b64765640 1 --2- 172.21.15.29:0/4211222410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b44008980 0x7f5b5c13e8a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f5b64765640 1 -- 172.21.15.29:0/4211222410 >> 172.21.15.29:0/4211222410 conn(0x7f5b5c0b59d0 msgr2=0x7f5b5c0b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7fbfb7976640 1 -- 172.21.15.29:0/2563441748 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbfb006cf10 con 0x7fbfb00b5d40 2024-09-13T18:45:48.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f5b64765640 1 -- 172.21.15.29:0/4211222410 shutdown_connections 2024-09-13T18:45:48.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.992+0000 7f5b64765640 1 -- 172.21.15.29:0/4211222410 wait complete. 2024-09-13T18:45:48.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.993+0000 7fbfa5ffb640 1 -- 172.21.15.29:0/2563441748 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbfa0057930 con 0x7fbfb00b5d40 2024-09-13T18:45:48.001 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-09-13T18:45:48.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.996+0000 7fbfb7976640 1 -- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbf9406ac50 msgr2=0x7fbf9406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.996+0000 7fbfb7976640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbf9406ac50 0x7fbf9406d110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbfac000f60 tx=0x7fbfac007b50 comp rx=0 tx=0).stop 2024-09-13T18:45:48.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.996+0000 7fbfb7976640 1 -- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfb00b5d40 msgr2=0x7fbfb01d5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.996+0000 7fbfb7976640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfb00b5d40 0x7fbfb01d5040 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000b430 tx=0x7fbfa000b8f0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.996+0000 7fbfb7976640 1 -- 172.21.15.29:0/2563441748 shutdown_connections 2024-09-13T18:45:48.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.996+0000 7fbfb7976640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbf9406ac50 0x7fbf9406d110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.996+0000 7fbfb7976640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfb00b6f30 0x7fbfb0098590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.996+0000 7fbfb7976640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfb00b5d40 0x7fbfb01d5040 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.996+0000 7fbfb7976640 1 --2- 172.21.15.29:0/2563441748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb006c7f0 0x7fbfb00b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.996+0000 7fbfb7976640 1 -- 172.21.15.29:0/2563441748 >> 172.21.15.29:0/2563441748 conn(0x7fbfb0099230 msgr2=0x7fbfb013ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:48.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.997+0000 7fbfb7976640 1 -- 172.21.15.29:0/2563441748 shutdown_connections 2024-09-13T18:45:48.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:47.997+0000 7fbfb7976640 1 -- 172.21.15.29:0/2563441748 wait complete. 2024-09-13T18:45:48.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2024-09-13T18:45:48.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-09-13T18:45:48.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-09-13T18:45:48.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-09-13T18:45:48.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-09-13T18:45:48.940 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:45:48.977 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:45:48.995 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:45:49.006 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:45:49.009 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:45:49.015 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:45:49.016 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:45:49.016 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:45:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.077+0000 7fdad2a61640 1 Processor -- start 2024-09-13T18:45:49.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.077+0000 7fdad2a61640 1 -- start start 2024-09-13T18:45:49.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.078+0000 7fdad2a61640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fdacc093de0 0x7fdacc06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.078+0000 7fdad2a61640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc0b5990 0x7fdacc0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.078+0000 7fdad2a61640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdacc0b70e0 con 0x7fdacc0b6c50 2024-09-13T18:45:49.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.078+0000 7fdad2a61640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0b2230 con 0x7fdacc093de0 2024-09-13T18:45:49.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.078+0000 7fdad2a61640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0b3ae0 con 0x7fdacc0b5990 2024-09-13T18:45:49.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.079+0000 7fdad0ffe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc0b5990 0x7fdacc0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.079+0000 7fdad0ffe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc0b5990 0x7fdacc0b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44366/0 (socket says 172.21.15.29:44366) 2024-09-13T18:45:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.079+0000 7fdad0ffe640 1 -- 172.21.15.29:0/2895908531 learned_addr learned my addr 172.21.15.29:0/2895908531 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.079+0000 7fdacbfff640 1 --2- 172.21.15.29:0/2895908531 >> v2:172.21.15.96:3300/0 conn(0x7fdacc093de0 0x7fdacc06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.080+0000 7fdad0ffe640 1 -- 172.21.15.29:0/2895908531 >> v2:172.21.15.96:3300/0 conn(0x7fdacc093de0 msgr2=0x7fdacc06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.080+0000 7fdad0ffe640 1 --2- 172.21.15.29:0/2895908531 >> v2:172.21.15.96:3300/0 conn(0x7fdacc093de0 0x7fdacc06b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.080+0000 7fdad0ffe640 1 -- 172.21.15.29:0/2895908531 >> v1:172.21.15.96:6789/0 conn(0x7fdacc0b6c50 legacy=0x7fdacc0b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.080+0000 7fdad0ffe640 1 -- 172.21.15.29:0/2895908531 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc0b6170 con 0x7fdacc0b5990 2024-09-13T18:45:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.082+0000 7fdad0ffe640 1 --2- 172.21.15.29:0/2895908531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc0b5990 0x7fdacc0b35a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdac4008e10 tx=0x7fdac4032e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76b922fd0e6d5628 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.082+0000 7fdacaffd640 1 -- 172.21.15.29:0/2895908531 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4033b10 con 0x7fdacc0b5990 2024-09-13T18:45:49.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.082+0000 7fdacaffd640 1 -- 172.21.15.29:0/2895908531 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4033c70 con 0x7fdacc0b5990 2024-09-13T18:45:49.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.083+0000 7fdad2a61640 1 -- 172.21.15.29:0/2895908531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc0b5990 msgr2=0x7fdacc0b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.083+0000 7fdad2a61640 1 --2- 172.21.15.29:0/2895908531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc0b5990 0x7fdacc0b35a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdac4008e10 tx=0x7fdac4032e80 comp rx=0 tx=0).stop 2024-09-13T18:45:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.085+0000 7fdad2a61640 1 -- 172.21.15.29:0/2895908531 shutdown_connections 2024-09-13T18:45:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.085+0000 7fdad2a61640 1 --2- 172.21.15.29:0/2895908531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc0b5990 0x7fdacc0b35a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.085+0000 7fdad2a61640 1 --2- 172.21.15.29:0/2895908531 >> v2:172.21.15.96:3300/0 conn(0x7fdacc093de0 0x7fdacc06b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.085+0000 7fdad2a61640 1 -- 172.21.15.29:0/2895908531 >> 172.21.15.29:0/2895908531 conn(0x7fdacc099230 msgr2=0x7fdacc099640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.085+0000 7fdad2a61640 1 -- 172.21.15.29:0/2895908531 shutdown_connections 2024-09-13T18:45:49.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.085+0000 7fdad2a61640 1 -- 172.21.15.29:0/2895908531 wait complete. 2024-09-13T18:45:49.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.087+0000 7fdad2a61640 1 Processor -- start 2024-09-13T18:45:49.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.087+0000 7fdad2a61640 1 -- start start 2024-09-13T18:45:49.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.088+0000 7fdad2a61640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc093de0 0x7fdacc09ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.088+0000 7fdad2a61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdacc0b5990 0x7fdacc09b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.088+0000 7fdad2a61640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdacc0b6c50 0x7fdacc09bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.088+0000 7fdad2a61640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc071aa0 con 0x7fdacc0b5990 2024-09-13T18:45:49.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.088+0000 7fdad2a61640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc09d560 con 0x7fdacc0b6c50 2024-09-13T18:45:49.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.088+0000 7fdad2a61640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc072000 con 0x7fdacc093de0 2024-09-13T18:45:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.089+0000 7fdacb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdacc0b5990 0x7fdacc09b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.089+0000 7fdacbfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc093de0 0x7fdacc09ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.089+0000 7fdacbfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc093de0 0x7fdacc09ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44374/0 (socket says 172.21.15.29:44374) 2024-09-13T18:45:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.089+0000 7fdacb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdacc0b5990 0x7fdacc09b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41038/0 (socket says 172.21.15.29:41038) 2024-09-13T18:45:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.089+0000 7fdacbfff640 1 -- 172.21.15.29:0/2271065218 learned_addr learned my addr 172.21.15.29:0/2271065218 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.089+0000 7fdad0ffe640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdacc0b6c50 0x7fdacc09bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.089+0000 7fdacbfff640 1 -- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdacc0b6c50 msgr2=0x7fdacc09bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.089+0000 7fdacbfff640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdacc0b6c50 0x7fdacc09bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.089+0000 7fdacbfff640 1 -- 172.21.15.29:0/2271065218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdacc0b5990 msgr2=0x7fdacc09b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.089+0000 7fdacbfff640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdacc0b5990 0x7fdacc09b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.089+0000 7fdacbfff640 1 -- 172.21.15.29:0/2271065218 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4008a70 con 0x7fdacc093de0 2024-09-13T18:45:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.090+0000 7fdacbfff640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc093de0 0x7fdacc09ce40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00fa70 tx=0x7fdabc00ff30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.094+0000 7fdac8ff9640 1 -- 172.21.15.29:0/2271065218 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc00b5a0 con 0x7fdacc093de0 2024-09-13T18:45:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.094+0000 7fdac8ff9640 1 -- 172.21.15.29:0/2271065218 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc00de60 con 0x7fdacc093de0 2024-09-13T18:45:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.094+0000 7fdac8ff9640 1 -- 172.21.15.29:0/2271065218 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc018680 con 0x7fdacc093de0 2024-09-13T18:45:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.096+0000 7fdad2a61640 1 -- 172.21.15.29:0/2271065218 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc09c3f0 con 0x7fdacc093de0 2024-09-13T18:45:49.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.096+0000 7fdad2a61640 1 -- 172.21.15.29:0/2271065218 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc09a930 con 0x7fdacc093de0 2024-09-13T18:45:49.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.098+0000 7fdad2a61640 1 -- 172.21.15.29:0/2271065218 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac005250 con 0x7fdacc093de0 2024-09-13T18:45:49.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.099+0000 7fdac8ff9640 1 -- 172.21.15.29:0/2271065218 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdabc0187e0 con 0x7fdacc093de0 2024-09-13T18:45:49.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.100+0000 7fdac8ff9640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdab806acd0 0x7fdab806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.101+0000 7fdacb7fe640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdab806acd0 0x7fdab806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.101+0000 7fdac8ff9640 1 -- 172.21.15.29:0/2271065218 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdabc089ca0 con 0x7fdacc093de0 2024-09-13T18:45:49.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.101+0000 7fdacb7fe640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdab806acd0 0x7fdab806d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0b18b0 tx=0x7fdac0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.104+0000 7fdac8ff9640 1 -- 172.21.15.29:0/2271065218 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdabc054cb0 con 0x7fdacc093de0 2024-09-13T18:45:49.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.145+0000 7fe121841640 1 Processor -- start 2024-09-13T18:45:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.147+0000 7fe121841640 1 -- start start 2024-09-13T18:45:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.148+0000 7fe121841640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe11c0b9fb0 0x7fe11c147540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.148+0000 7fe121841640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe11c147a80 0x7fe11c13d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.148+0000 7fe121841640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c0b31e0 con 0x7fe11c0b38f0 2024-09-13T18:45:49.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.148+0000 7fe121841640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c0b1a40 con 0x7fe11c0b9fb0 2024-09-13T18:45:49.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.148+0000 7fe121841640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c0ba390 con 0x7fe11c147a80 2024-09-13T18:45:49.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.148+0000 7fe11a7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe11c147a80 0x7fe11c13d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.148+0000 7fe11a7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe11c147a80 0x7fe11c13d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38910/0 (socket says 172.21.15.29:38910) 2024-09-13T18:45:49.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.148+0000 7fe11a7fc640 1 -- 172.21.15.29:0/1567468493 learned_addr learned my addr 172.21.15.29:0/1567468493 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.149+0000 7fe11a7fc640 1 -- 172.21.15.29:0/1567468493 >> v2:172.21.15.29:3300/0 conn(0x7fe11c0b9fb0 msgr2=0x7fe11c147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.149+0000 7fe11affd640 1 --2- 172.21.15.29:0/1567468493 >> v2:172.21.15.29:3300/0 conn(0x7fe11c0b9fb0 0x7fe11c147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.149+0000 7fe11a7fc640 1 --2- 172.21.15.29:0/1567468493 >> v2:172.21.15.29:3300/0 conn(0x7fe11c0b9fb0 0x7fe11c147540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.149+0000 7fe11a7fc640 1 -- 172.21.15.29:0/1567468493 >> v1:172.21.15.96:6789/0 conn(0x7fe11c0b38f0 legacy=0x7fe11c0709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.149+0000 7fe11a7fc640 1 -- 172.21.15.29:0/1567468493 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c146d60 con 0x7fe11c147a80 2024-09-13T18:45:49.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.150+0000 7fe11a7fc640 1 --2- 172.21.15.29:0/1567468493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11c147a80 0x7fe11c13d600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe11c143770 tx=0x7fe10c02e5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f1f81619e52fb18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.151+0000 7fe119ffb640 1 -- 172.21.15.29:0/1567468493 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c033710 con 0x7fe11c147a80 2024-09-13T18:45:49.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.151+0000 7fe119ffb640 1 -- 172.21.15.29:0/1567468493 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c031050 con 0x7fe11c147a80 2024-09-13T18:45:49.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.152+0000 7fe121841640 1 -- 172.21.15.29:0/1567468493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11c147a80 msgr2=0x7fe11c13d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.152+0000 7fe121841640 1 --2- 172.21.15.29:0/1567468493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11c147a80 0x7fe11c13d600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe11c143770 tx=0x7fe10c02e5d0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.152+0000 7fe121841640 1 -- 172.21.15.29:0/1567468493 shutdown_connections 2024-09-13T18:45:49.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.152+0000 7fe121841640 1 --2- 172.21.15.29:0/1567468493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11c147a80 0x7fe11c13d600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.152+0000 7fe121841640 1 --2- 172.21.15.29:0/1567468493 >> v2:172.21.15.29:3300/0 conn(0x7fe11c0b9fb0 0x7fe11c147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.152+0000 7fe121841640 1 -- 172.21.15.29:0/1567468493 >> 172.21.15.29:0/1567468493 conn(0x7fe11c06a500 msgr2=0x7fe11c0b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.152+0000 7fe121841640 1 -- 172.21.15.29:0/1567468493 shutdown_connections 2024-09-13T18:45:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.152+0000 7fe121841640 1 -- 172.21.15.29:0/1567468493 wait complete. 2024-09-13T18:45:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.154+0000 7fe121841640 1 Processor -- start 2024-09-13T18:45:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.154+0000 7fe121841640 1 -- start start 2024-09-13T18:45:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.155+0000 7fe121841640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe11c0b38f0 0x7fe11c142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.155+0000 7fe121841640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe11c0b9fb0 0x7fe11c13c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe121841640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11c147a80 0x7fe11c1ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe121841640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c143570 con 0x7fe11c0b38f0 2024-09-13T18:45:49.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe121841640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1ce170 con 0x7fe11c147a80 2024-09-13T18:45:49.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe121841640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1cde70 con 0x7fe11c0b9fb0 2024-09-13T18:45:49.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11c147a80 0x7fe11c1ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11c147a80 0x7fe11c1ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38918/0 (socket says 172.21.15.29:38918) 2024-09-13T18:45:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe11b7fe640 1 -- 172.21.15.29:0/3046320957 learned_addr learned my addr 172.21.15.29:0/3046320957 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe11a7fc640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe11c0b9fb0 0x7fe11c13c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe11affd640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe11c0b38f0 0x7fe11c142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe11b7fe640 1 -- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe11c0b9fb0 msgr2=0x7fe11c13c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe11b7fe640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe11c0b9fb0 0x7fe11c13c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe11b7fe640 1 -- 172.21.15.29:0/3046320957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe11c0b38f0 msgr2=0x7fe11c142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe11b7fe640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe11c0b38f0 0x7fe11c142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.156+0000 7fe11b7fe640 1 -- 172.21.15.29:0/3046320957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0094d0 con 0x7fe11c147a80 2024-09-13T18:45:49.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.157+0000 7fe11b7fe640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11c147a80 0x7fe11c1ce600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe11400c7e0 tx=0x7fe11400cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.157+0000 7fe103fff640 1 -- 172.21.15.29:0/3046320957 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe114003d80 con 0x7fe11c147a80 2024-09-13T18:45:49.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.157+0000 7fe103fff640 1 -- 172.21.15.29:0/3046320957 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11400ce90 con 0x7fe11c147a80 2024-09-13T18:45:49.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.157+0000 7fe103fff640 1 -- 172.21.15.29:0/3046320957 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140052b0 con 0x7fe11c147a80 2024-09-13T18:45:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.159+0000 7fe121841640 1 -- 172.21.15.29:0/3046320957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c13caa0 con 0x7fe11c147a80 2024-09-13T18:45:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.159+0000 7fe121841640 1 -- 172.21.15.29:0/3046320957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c0b45e0 con 0x7fe11c147a80 2024-09-13T18:45:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.160+0000 7fe121841640 1 -- 172.21.15.29:0/3046320957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c0b21b0 con 0x7fe11c147a80 2024-09-13T18:45:49.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.162+0000 7fe103fff640 1 -- 172.21.15.29:0/3046320957 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe114005410 con 0x7fe11c147a80 2024-09-13T18:45:49.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.162+0000 7fe103fff640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe10406aeb0 0x7fe10406d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.162+0000 7fe103fff640 1 -- 172.21.15.29:0/3046320957 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe114089000 con 0x7fe11c147a80 2024-09-13T18:45:49.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.163+0000 7fe11affd640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe10406aeb0 0x7fe10406d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.164+0000 7fe11affd640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe10406aeb0 0x7fe10406d370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe11000aaf0 tx=0x7fe110008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.165+0000 7fe103fff640 1 -- 172.21.15.29:0/3046320957 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe114054010 con 0x7fe11c147a80 2024-09-13T18:45:49.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.202+0000 7ff00e5b7640 1 Processor -- start 2024-09-13T18:45:49.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.202+0000 7f900d6a6640 1 Processor -- start 2024-09-13T18:45:49.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.202+0000 7f81af0b1640 1 Processor -- start 2024-09-13T18:45:49.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.202+0000 7f81af0b1640 1 -- start start 2024-09-13T18:45:49.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.203+0000 7ff00e5b7640 1 -- start start 2024-09-13T18:45:49.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.203+0000 7f81af0b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81a80b9fb0 0x7f81a8147540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.203+0000 7f81af0b1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81a8147a80 0x7f81a813d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.203+0000 7f81af0b1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f81a80b38f0 0x7f81a80709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.203+0000 7f81af0b1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80b31e0 con 0x7f81a8147a80 2024-09-13T18:45:49.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.203+0000 7f81af0b1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80b1a40 con 0x7f81a80b38f0 2024-09-13T18:45:49.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.203+0000 7f81af0b1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80ba390 con 0x7f81a80b9fb0 2024-09-13T18:45:49.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.203+0000 7f81a7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81a8147a80 0x7f81a813d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.203+0000 7f81ace4d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81a80b9fb0 0x7f81a8147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.203+0000 7f81ace4d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81a80b9fb0 0x7f81a8147540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44388/0 (socket says 172.21.15.29:44388) 2024-09-13T18:45:49.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.203+0000 7f81ace4d640 1 -- 172.21.15.29:0/2309300808 learned_addr learned my addr 172.21.15.29:0/2309300808 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.203+0000 7f81ad64e640 1 --2- 172.21.15.29:0/2309300808 >> v2:172.21.15.96:3300/0 conn(0x7f81a80b38f0 0x7f81a80709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7fd68a0c9640 1 Processor -- start 2024-09-13T18:45:49.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f81ace4d640 1 -- 172.21.15.29:0/2309300808 >> v2:172.21.15.96:3300/0 conn(0x7f81a80b38f0 msgr2=0x7f81a80709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f81ace4d640 1 --2- 172.21.15.29:0/2309300808 >> v2:172.21.15.96:3300/0 conn(0x7f81a80b38f0 0x7f81a80709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f81ace4d640 1 -- 172.21.15.29:0/2309300808 >> v2:172.21.15.29:3300/0 conn(0x7f81a8147a80 msgr2=0x7f81a813d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.202+0000 7f900d6a6640 1 -- start start 2024-09-13T18:45:49.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f900d6a6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 0x7f900814a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f900d6a6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f90080aec00 0x7f900814a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f900d6a6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9008149c80 con 0x7f90080b0e60 2024-09-13T18:45:49.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f900d6a6640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90080b03a0 con 0x7f90080aec00 2024-09-13T18:45:49.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f900d6a6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90080b1390 con 0x7f90080affc0 2024-09-13T18:45:49.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f90077fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f90080aec00 0x7f900814a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f90077fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f90080aec00 0x7f900814a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41072/0 (socket says 172.21.15.29:41072) 2024-09-13T18:45:49.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f90077fe640 1 -- 172.21.15.29:0/4133659312 learned_addr learned my addr 172.21.15.29:0/4133659312 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f9007fff640 1 --2- 172.21.15.29:0/4133659312 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 0x7f900814a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f81ace4d640 1 --2- 172.21.15.29:0/2309300808 >> v2:172.21.15.29:3300/0 conn(0x7f81a8147a80 0x7f81a813d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7f81ace4d640 1 -- 172.21.15.29:0/2309300808 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a8146d60 con 0x7f81a80b9fb0 2024-09-13T18:45:49.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7ff00e5b7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff0080b0e60 0x7ff008155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7ff00d5b5640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff0080affc0 0x7ff00814a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:53286/0 (socket says 172.21.15.29:53286) 2024-09-13T18:45:49.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.205+0000 7f9007fff640 1 -- 172.21.15.29:0/4133659312 >> v2:172.21.15.29:3300/0 conn(0x7f90080aec00 msgr2=0x7f900814a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.205+0000 7f9007fff640 1 --2- 172.21.15.29:0/4133659312 >> v2:172.21.15.29:3300/0 conn(0x7f90080aec00 0x7f900814a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7ff00e5b7640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff008149c80 con 0x7ff0080aec00 2024-09-13T18:45:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7ff00e5b7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0080b03a0 con 0x7ff0080affc0 2024-09-13T18:45:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7ff00e5b7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0080b1390 con 0x7ff0080b0e60 2024-09-13T18:45:49.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7ff00cdb4640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff0080aec00 0x7ff008143800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54426/0 (socket says 172.21.15.29:54426) 2024-09-13T18:45:49.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7ff00cdb4640 1 -- 172.21.15.29:0/1460894484 learned_addr learned my addr 172.21.15.29:0/1460894484 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:49.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7ff00ddb6640 1 --2- 172.21.15.29:0/1460894484 >> v2:172.21.15.96:3300/0 conn(0x7ff0080b0e60 0x7ff008155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7f81ace4d640 1 --2- 172.21.15.29:0/2309300808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81a80b9fb0 0x7f81a8147540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f81a80b4130 tx=0x7f819802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b2c4eb4871681cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.205+0000 7f9007fff640 1 -- 172.21.15.29:0/4133659312 >> v1:172.21.15.96:6789/0 conn(0x7f90080b0e60 legacy=0x7f9008143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.205+0000 7f9007fff640 1 -- 172.21.15.29:0/4133659312 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90080af0b0 con 0x7f90080affc0 2024-09-13T18:45:49.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.205+0000 7f0c13e80640 1 Processor -- start 2024-09-13T18:45:49.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.205+0000 7f0c13e80640 1 -- start start 2024-09-13T18:45:49.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.204+0000 7fd68a0c9640 1 -- start start 2024-09-13T18:45:49.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7fd68a0c9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd67c0d1040 0x7fd67c01aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7fd68a0c9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c01c550 con 0x7fd67c006c90 2024-09-13T18:45:49.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7fd68a0c9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c030d60 con 0x7fd67c01f0d0 2024-09-13T18:45:49.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7fd68a0c9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c01c350 con 0x7fd67c0d1040 2024-09-13T18:45:49.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7fd682ffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd67c0d1040 0x7fd67c01aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7fd682ffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd67c0d1040 0x7fd67c01aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44398/0 (socket says 172.21.15.29:44398) 2024-09-13T18:45:49.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7fd682ffd640 1 -- 172.21.15.29:0/3642640425 learned_addr learned my addr 172.21.15.29:0/3642640425 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7f81a77fe640 1 -- 172.21.15.29:0/2309300808 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198032440 con 0x7f81a80b9fb0 2024-09-13T18:45:49.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7f81a77fe640 1 -- 172.21.15.29:0/2309300808 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81980325a0 con 0x7f81a80b9fb0 2024-09-13T18:45:49.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7feffbfff640 1 -- 172.21.15.29:0/1460894484 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682131671 0 0) 0x7ff008149c80 con 0x7ff0080aec00 2024-09-13T18:45:49.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7feffbfff640 1 -- 172.21.15.29:0/1460894484 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff4003520 con 0x7ff0080aec00 2024-09-13T18:45:49.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7ff00ddb6640 1 -- 172.21.15.29:0/1460894484 >> v1:172.21.15.96:6789/0 conn(0x7ff0080affc0 legacy=0x7ff00814a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7ff00ddb6640 1 -- 172.21.15.29:0/1460894484 >> v1:172.21.15.29:6789/0 conn(0x7ff0080aec00 legacy=0x7ff008143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7ff00ddb6640 1 -- 172.21.15.29:0/1460894484 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0080af0b0 con 0x7ff0080b0e60 2024-09-13T18:45:49.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7f9007fff640 1 --2- 172.21.15.29:0/4133659312 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 0x7f900814a110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0097a0 tx=0x7f8ffc02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a2e9959e9f2c51e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f81af0b1640 1 -- 172.21.15.29:0/2309300808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81a80b9fb0 msgr2=0x7f81a8147540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c13e80640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c040ca2e0 0x7f0c040ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c13e80640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0c040d2640 0x7f0c040d4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c13e80640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0401cf00 con 0x7f0c0400bdf0 2024-09-13T18:45:49.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c13e80640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0401ccf0 con 0x7f0c040d2640 2024-09-13T18:45:49.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c13e80640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0401e2e0 con 0x7f0c040ca2e0 2024-09-13T18:45:49.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c1141b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c040ca2e0 0x7f0c040ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c1141b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c040ca2e0 0x7f0c040ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44410/0 (socket says 172.21.15.29:44410) 2024-09-13T18:45:49.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c1141b640 1 -- 172.21.15.29:0/3487284246 learned_addr learned my addr 172.21.15.29:0/3487284246 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f81af0b1640 1 --2- 172.21.15.29:0/2309300808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81a80b9fb0 0x7f81a8147540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f81a80b4130 tx=0x7f819802a200 comp rx=0 tx=0).stop 2024-09-13T18:45:49.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c1241d640 1 --2- 172.21.15.29:0/3487284246 >> v2:172.21.15.29:3300/0 conn(0x7f0c040d2640 0x7f0c040d4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f3a7d3df640 1 Processor -- start 2024-09-13T18:45:49.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f9006ffd640 1 -- 172.21.15.29:0/4133659312 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc02adb0 con 0x7f90080affc0 2024-09-13T18:45:49.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7fd682ffd640 1 -- 172.21.15.29:0/3642640425 >> v1:172.21.15.96:6789/0 conn(0x7fd67c01f0d0 legacy=0x7fd67c01f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7fd682ffd640 1 -- 172.21.15.29:0/3642640425 >> v1:172.21.15.29:6789/0 conn(0x7fd67c006c90 legacy=0x7fd67c0d0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.206+0000 7fd682ffd640 1 -- 172.21.15.29:0/3642640425 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c01b2a0 con 0x7fd67c0d1040 2024-09-13T18:45:49.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f3a7d3df640 1 -- start start 2024-09-13T18:45:49.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f9006ffd640 1 -- 172.21.15.29:0/4133659312 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc032440 con 0x7f90080affc0 2024-09-13T18:45:49.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f9006ffd640 1 -- 172.21.15.29:0/4133659312 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0327d0 con 0x7f90080affc0 2024-09-13T18:45:49.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f81af0b1640 1 -- 172.21.15.29:0/2309300808 shutdown_connections 2024-09-13T18:45:49.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f81af0b1640 1 --2- 172.21.15.29:0/2309300808 >> v2:172.21.15.96:3300/0 conn(0x7f81a80b38f0 0x7f81a80709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f81af0b1640 1 --2- 172.21.15.29:0/2309300808 >> v2:172.21.15.29:3300/0 conn(0x7f81a8147a80 0x7f81a813d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f81af0b1640 1 --2- 172.21.15.29:0/2309300808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81a80b9fb0 0x7f81a8147540 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f81af0b1640 1 -- 172.21.15.29:0/2309300808 >> 172.21.15.29:0/2309300808 conn(0x7f81a806a500 msgr2=0x7f81a80b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.208+0000 7f81af0b1640 1 -- 172.21.15.29:0/2309300808 shutdown_connections 2024-09-13T18:45:49.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.208+0000 7f81af0b1640 1 -- 172.21.15.29:0/2309300808 wait complete. 2024-09-13T18:45:49.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c1141b640 1 -- 172.21.15.29:0/3487284246 >> v2:172.21.15.29:3300/0 conn(0x7f0c040d2640 msgr2=0x7f0c040d4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c1141b640 1 --2- 172.21.15.29:0/3487284246 >> v2:172.21.15.29:3300/0 conn(0x7f0c040d2640 0x7f0c040d4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c1141b640 1 -- 172.21.15.29:0/3487284246 >> v1:172.21.15.96:6789/0 conn(0x7f0c0400bdf0 legacy=0x7f0c0403a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.207+0000 7f0c1141b640 1 -- 172.21.15.29:0/3487284246 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0401f640 con 0x7f0c040ca2e0 2024-09-13T18:45:49.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.208+0000 7ff00ddb6640 1 --2- 172.21.15.29:0/1460894484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0080b0e60 0x7ff008155470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff0040097d0 tx=0x7ff00402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a8f00b53ab42665 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.208+0000 7fd682ffd640 1 --2- 172.21.15.29:0/3642640425 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd67c0d1040 0x7fd67c01aae0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd684068c20 tx=0x7fd6840b50b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c287a7a1a61de83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.208+0000 7feffbfff640 1 -- 172.21.15.29:0/1460894484 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00402ae10 con 0x7ff0080b0e60 2024-09-13T18:45:49.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.208+0000 7feffbfff640 1 -- 172.21.15.29:0/1460894484 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff004032440 con 0x7ff0080b0e60 2024-09-13T18:45:49.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.208+0000 7feffbfff640 1 -- 172.21.15.29:0/1460894484 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0040327d0 con 0x7ff0080b0e60 2024-09-13T18:45:49.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.208+0000 7f0c1141b640 1 --2- 172.21.15.29:0/3487284246 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c040ca2e0 0x7f0c040ca720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c068c20 tx=0x7f0c0c0a3f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e551112b453bb4c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.208+0000 7f900d6a6640 1 -- 172.21.15.29:0/4133659312 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 msgr2=0x7f900814a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.208+0000 7f900d6a6640 1 --2- 172.21.15.29:0/4133659312 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 0x7f900814a110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0097a0 tx=0x7f8ffc02a080 comp rx=0 tx=0).stop 2024-09-13T18:45:49.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.208+0000 7f0c10c1a640 1 -- 172.21.15.29:0/3487284246 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0a4cb0 con 0x7f0c040ca2e0 2024-09-13T18:45:49.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f3a7d3df640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a780abb30 0x7f3a780abf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f0c10c1a640 1 -- 172.21.15.29:0/3487284246 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c0a4e10 con 0x7f0c040ca2e0 2024-09-13T18:45:49.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f0c10c1a640 1 -- 172.21.15.29:0/3487284246 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0ac640 con 0x7f0c040ca2e0 2024-09-13T18:45:49.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f900d6a6640 1 -- 172.21.15.29:0/4133659312 shutdown_connections 2024-09-13T18:45:49.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f900d6a6640 1 --2- 172.21.15.29:0/4133659312 >> v2:172.21.15.29:3300/0 conn(0x7f90080aec00 0x7f900814a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f900d6a6640 1 --2- 172.21.15.29:0/4133659312 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 0x7f900814a110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f3a77fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a780abb30 0x7f3a780abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f3a77fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a780abb30 0x7f3a780abf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41088/0 (socket says 172.21.15.29:41088) 2024-09-13T18:45:49.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f3a77fff640 1 -- 172.21.15.29:0/3226300653 learned_addr learned my addr 172.21.15.29:0/3226300653 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f3a7d3df640 1 --2- 172.21.15.29:0/3226300653 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a78146460 0x7f3a78071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f900d6a6640 1 -- 172.21.15.29:0/4133659312 >> 172.21.15.29:0/4133659312 conn(0x7f90080b7250 msgr2=0x7f90080b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f3a7d3df640 1 -- 172.21.15.29:0/3226300653 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a78145890 con 0x7f3a78071960 2024-09-13T18:45:49.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f3a7d3df640 1 -- 172.21.15.29:0/3226300653 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a780ad560 con 0x7f3a780abb30 2024-09-13T18:45:49.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f3a7d3df640 1 -- 172.21.15.29:0/3226300653 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a780ac450 con 0x7f3a78146460 2024-09-13T18:45:49.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7fd6827fc640 1 -- 172.21.15.29:0/3642640425 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6840b5e80 con 0x7fd67c0d1040 2024-09-13T18:45:49.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7fd6827fc640 1 -- 172.21.15.29:0/3642640425 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6840bd440 con 0x7fd67c0d1040 2024-09-13T18:45:49.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7fd6827fc640 1 -- 172.21.15.29:0/3642640425 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6840bd830 con 0x7fd67c0d1040 2024-09-13T18:45:49.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7ff00e5b7640 1 -- 172.21.15.29:0/1460894484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0080b0e60 msgr2=0x7ff008155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7ff00e5b7640 1 --2- 172.21.15.29:0/1460894484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0080b0e60 0x7ff008155470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff0040097d0 tx=0x7ff00402a100 comp rx=0 tx=0).stop 2024-09-13T18:45:49.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f900d6a6640 1 -- 172.21.15.29:0/4133659312 shutdown_connections 2024-09-13T18:45:49.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f81af0b1640 1 Processor -- start 2024-09-13T18:45:49.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f0c13e80640 1 -- 172.21.15.29:0/3487284246 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c040ca2e0 msgr2=0x7f0c040ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f0c13e80640 1 --2- 172.21.15.29:0/3487284246 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c040ca2e0 0x7f0c040ca720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c068c20 tx=0x7f0c0c0a3f60 comp rx=0 tx=0).stop 2024-09-13T18:45:49.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7ff00e5b7640 1 -- 172.21.15.29:0/1460894484 shutdown_connections 2024-09-13T18:45:49.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7ff00e5b7640 1 --2- 172.21.15.29:0/1460894484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0080b0e60 0x7ff008155470 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7ff00e5b7640 1 -- 172.21.15.29:0/1460894484 >> 172.21.15.29:0/1460894484 conn(0x7ff0080b7250 msgr2=0x7ff0080b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7f3a77fff640 1 -- 172.21.15.29:0/3226300653 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a78146460 msgr2=0x7f3a78071dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:45:49.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7f3a77fff640 1 --2- 172.21.15.29:0/3226300653 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a78146460 0x7f3a78071dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7f3a77fff640 1 -- 172.21.15.29:0/3226300653 >> v1:172.21.15.29:6789/0 conn(0x7f3a78071960 legacy=0x7f3a78145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7f3a77fff640 1 -- 172.21.15.29:0/3226300653 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a780acfa0 con 0x7f3a780abb30 2024-09-13T18:45:49.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7fd68a0c9640 1 -- 172.21.15.29:0/3642640425 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd67c0d1040 msgr2=0x7fd67c01aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7ff00e5b7640 1 -- 172.21.15.29:0/1460894484 shutdown_connections 2024-09-13T18:45:49.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.209+0000 7f81af0b1640 1 -- start start 2024-09-13T18:45:49.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7ff00e5b7640 1 -- 172.21.15.29:0/1460894484 wait complete. 2024-09-13T18:45:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7fd68a0c9640 1 --2- 172.21.15.29:0/3642640425 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd67c0d1040 0x7fd67c01aae0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd684068c20 tx=0x7fd6840b50b0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7f900d6a6640 1 -- 172.21.15.29:0/4133659312 wait complete. 2024-09-13T18:45:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7f0c13e80640 1 -- 172.21.15.29:0/3487284246 shutdown_connections 2024-09-13T18:45:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7f0c13e80640 1 --2- 172.21.15.29:0/3487284246 >> v2:172.21.15.29:3300/0 conn(0x7f0c040d2640 0x7f0c040d4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7f0c13e80640 1 --2- 172.21.15.29:0/3487284246 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c040ca2e0 0x7f0c040ca720 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7f0c13e80640 1 -- 172.21.15.29:0/3487284246 >> 172.21.15.29:0/3487284246 conn(0x7f0c0400b060 msgr2=0x7f0c0400b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7fd68a0c9640 1 -- 172.21.15.29:0/3642640425 shutdown_connections 2024-09-13T18:45:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7fd68a0c9640 1 --2- 172.21.15.29:0/3642640425 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd67c0d1040 0x7fd67c01aae0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.210+0000 7fd68a0c9640 1 -- 172.21.15.29:0/3642640425 >> 172.21.15.29:0/3642640425 conn(0x7fd67c009030 msgr2=0x7fd67c009440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7fd68a0c9640 1 -- 172.21.15.29:0/3642640425 shutdown_connections 2024-09-13T18:45:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7f81af0b1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81a80b38f0 0x7f81a80afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7f81af0b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81a80b9fb0 0x7f81a813deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7f81af0b1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81a8147a80 0x7f81a813e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7f81af0b1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80b03e0 con 0x7f81a80b38f0 2024-09-13T18:45:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7f81af0b1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a813fbe0 con 0x7f81a8147a80 2024-09-13T18:45:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7f81af0b1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a814e4d0 con 0x7f81a80b9fb0 2024-09-13T18:45:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7f81ace4d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81a80b38f0 0x7f81a80afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7f81ace4d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81a80b38f0 0x7f81a80afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41094/0 (socket says 172.21.15.29:41094) 2024-09-13T18:45:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7f81ace4d640 1 -- 172.21.15.29:0/1685459663 learned_addr learned my addr 172.21.15.29:0/1685459663 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7f81a7fff640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81a80b9fb0 0x7f81a813deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7f81ace4d640 1 -- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81a80b9fb0 msgr2=0x7f81a813deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7f81ace4d640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81a80b9fb0 0x7f81a813deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7f81ace4d640 1 -- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81a8147a80 msgr2=0x7f81a813e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7f81ace4d640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81a8147a80 0x7f81a813e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7f900d6a6640 1 Processor -- start 2024-09-13T18:45:49.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7f81ace4d640 1 -- 172.21.15.29:0/1685459663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81980094d0 con 0x7f81a80b38f0 2024-09-13T18:45:49.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7ff00e5b7640 1 Processor -- start 2024-09-13T18:45:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7f81ace4d640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81a80b38f0 0x7f81a80afea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f819802a240 tx=0x7f81980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7ff00e5b7640 1 -- start start 2024-09-13T18:45:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7f900d6a6640 1 -- start start 2024-09-13T18:45:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f81a57fa640 1 -- 172.21.15.29:0/1685459663 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198003a20 con 0x7f81a80b38f0 2024-09-13T18:45:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f81a57fa640 1 -- 172.21.15.29:0/1685459663 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198003b80 con 0x7f81a80b38f0 2024-09-13T18:45:49.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7f3a77fff640 1 --2- 172.21.15.29:0/3226300653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a780abb30 0x7f3a780abf10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009870 tx=0x7f3a6802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb1c134774014bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f0c13e80640 1 -- 172.21.15.29:0/3487284246 shutdown_connections 2024-09-13T18:45:49.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f900d6a6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90080aec00 0x7f9008140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f900d6a6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 0x7f9008142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7f3a777fe640 1 -- 172.21.15.29:0/3226300653 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6802acf0 con 0x7f3a780abb30 2024-09-13T18:45:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f900d6a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90080b0e60 0x7f90081431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f900d6a6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90080ac340 con 0x7f90080b0e60 2024-09-13T18:45:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f900d6a6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90080ac620 con 0x7f90080aec00 2024-09-13T18:45:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f900d6a6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9008140480 con 0x7f90080affc0 2024-09-13T18:45:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f81a57fa640 1 -- 172.21.15.29:0/1685459663 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819803d470 con 0x7f81a80b38f0 2024-09-13T18:45:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f81af0b1640 1 -- 172.21.15.29:0/1685459663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a814f200 con 0x7f81a80b38f0 2024-09-13T18:45:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f81af0b1640 1 -- 172.21.15.29:0/1685459663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a8146670 con 0x7f81a80b38f0 2024-09-13T18:45:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7f3a777fe640 1 -- 172.21.15.29:0/3226300653 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6802ae50 con 0x7f3a780abb30 2024-09-13T18:45:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f0c13e80640 1 -- 172.21.15.29:0/3487284246 wait complete. 2024-09-13T18:45:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7ff00e5b7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0080aec00 0x7ff00814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7f3a777fe640 1 -- 172.21.15.29:0/3226300653 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68032660 con 0x7f3a780abb30 2024-09-13T18:45:49.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7f90077fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 0x7f9008142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7ff00e5b7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff0080affc0 0x7ff00814d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.211+0000 7fd68a0c9640 1 -- 172.21.15.29:0/3642640425 wait complete. 2024-09-13T18:45:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.212+0000 7fd68a0c9640 1 Processor -- start 2024-09-13T18:45:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7fd68a0c9640 1 -- start start 2024-09-13T18:45:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7fd68a0c9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd67c006c90 0x7fd67c0cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7fd68a0c9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67c01f0d0 0x7fd67c035e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7fd68a0c9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd67c0d1040 0x7fd67c036390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7fd68a0c9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0d1890 con 0x7fd67c0d1040 2024-09-13T18:45:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7fd68a0c9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0cdc00 con 0x7fd67c01f0d0 2024-09-13T18:45:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7fd68a0c9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c035370 con 0x7fd67c006c90 2024-09-13T18:45:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f3a7d3df640 1 -- 172.21.15.29:0/3226300653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a780abb30 msgr2=0x7f3a780abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7ff00e5b7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0080b0e60 0x7ff0081e2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f3a7d3df640 1 --2- 172.21.15.29:0/3226300653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a780abb30 0x7f3a780abf10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009870 tx=0x7f3a6802a060 comp rx=0 tx=0).stop 2024-09-13T18:45:49.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f3a7d3df640 1 -- 172.21.15.29:0/3226300653 shutdown_connections 2024-09-13T18:45:49.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f3a7d3df640 1 --2- 172.21.15.29:0/3226300653 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a78146460 0x7f3a78071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f3a7d3df640 1 --2- 172.21.15.29:0/3226300653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a780abb30 0x7f3a780abf10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7ff00d5b5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0080aec00 0x7ff00814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7ff00d5b5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0080aec00 0x7ff00814b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:38972/0 (socket says 172.21.15.29:38972) 2024-09-13T18:45:49.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7ff00cdb4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff0080affc0 0x7ff00814d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7ff00cdb4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff0080affc0 0x7ff00814d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44454/0 (socket says 172.21.15.29:44454) 2024-09-13T18:45:49.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7ff00d5b5640 1 -- 172.21.15.29:0/19221808 learned_addr learned my addr 172.21.15.29:0/19221808 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff008140730 con 0x7ff0080b0e60 2024-09-13T18:45:49.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00814caf0 con 0x7ff0080aec00 2024-09-13T18:45:49.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0081468e0 con 0x7ff0080affc0 2024-09-13T18:45:49.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.213+0000 7f3a7d3df640 1 -- 172.21.15.29:0/3226300653 >> 172.21.15.29:0/3226300653 conn(0x7f3a780b71e0 msgr2=0x7f3a780b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7ff00ddb6640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0080b0e60 0x7ff0081e2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7f900cea5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90080b0e60 0x7f90081431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7f3a7d3df640 1 -- 172.21.15.29:0/3226300653 shutdown_connections 2024-09-13T18:45:49.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.214+0000 7f3a7d3df640 1 -- 172.21.15.29:0/3226300653 wait complete. 2024-09-13T18:45:49.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7f0c13e80640 1 Processor -- start 2024-09-13T18:45:49.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7ff00cdb4640 1 -- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0080aec00 msgr2=0x7ff00814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7ff00cdb4640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0080aec00 0x7ff00814b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7ff00cdb4640 1 -- 172.21.15.29:0/19221808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0080b0e60 msgr2=0x7ff0081e2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7f9007fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90080aec00 0x7f9008140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7f90077fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 0x7f9008142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44444/0 (socket says 172.21.15.29:44444) 2024-09-13T18:45:49.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7f90077fe640 1 -- 172.21.15.29:0/3768033760 learned_addr learned my addr 172.21.15.29:0/3768033760 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7f90077fe640 1 -- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90080aec00 msgr2=0x7f9008140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7f90077fe640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90080aec00 0x7f9008140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7f90077fe640 1 -- 172.21.15.29:0/3768033760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90080b0e60 msgr2=0x7f90081431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7f81af0b1640 1 -- 172.21.15.29:0/1685459663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8188005250 con 0x7f81a80b38f0 2024-09-13T18:45:49.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7f0c13e80640 1 -- start start 2024-09-13T18:45:49.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7ff00cdb4640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0080b0e60 0x7ff0081e2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7ff00cdb4640 1 -- 172.21.15.29:0/19221808 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004009400 con 0x7ff0080affc0 2024-09-13T18:45:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7f90077fe640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90080b0e60 0x7f90081431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7f90077fe640 1 -- 172.21.15.29:0/3768033760 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc009400 con 0x7f90080affc0 2024-09-13T18:45:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7ff00d5b5640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0080aec00 0x7ff00814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:49.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f900cea5640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90080b0e60 0x7f90081431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:49.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7fd683fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd67c0d1040 0x7fd67c036390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7fd6837fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd67c006c90 0x7fd67c0cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7fd683fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd67c0d1040 0x7fd67c036390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41124/0 (socket says 172.21.15.29:41124) 2024-09-13T18:45:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7fd683fff640 1 -- 172.21.15.29:0/1516041432 learned_addr learned my addr 172.21.15.29:0/1516041432 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7ff00ddb6640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0080b0e60 0x7ff0081e2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f90077fe640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 0x7f9008142c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f900000efc0 tx=0x7f900000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.215+0000 7ff00cdb4640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff0080affc0 0x7ff00814d260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feffc00c390 tx=0x7feffc001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7feff9ffb640 1 -- 172.21.15.29:0/19221808 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc005ce0 con 0x7ff0080affc0 2024-09-13T18:45:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7feff9ffb640 1 -- 172.21.15.29:0/19221808 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc005e40 con 0x7ff0080affc0 2024-09-13T18:45:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f9004ff9640 1 -- 172.21.15.29:0/3768033760 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900000cda0 con 0x7f90080affc0 2024-09-13T18:45:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f9004ff9640 1 -- 172.21.15.29:0/3768033760 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900000f040 con 0x7f90080affc0 2024-09-13T18:45:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f9004ff9640 1 -- 172.21.15.29:0/3768033760 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000014680 con 0x7f90080affc0 2024-09-13T18:45:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7fd683fff640 1 -- 172.21.15.29:0/1516041432 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd67c006c90 msgr2=0x7fd67c0cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7fd683fff640 1 --2- 172.21.15.29:0/1516041432 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd67c006c90 0x7fd67c0cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7fd683fff640 1 -- 172.21.15.29:0/1516041432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67c01f0d0 msgr2=0x7fd67c035e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7fd683fff640 1 --2- 172.21.15.29:0/1516041432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67c01f0d0 0x7fd67c035e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7fd683fff640 1 -- 172.21.15.29:0/1516041432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c035650 con 0x7fd67c0d1040 2024-09-13T18:45:49.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7feff9ffb640 1 -- 172.21.15.29:0/19221808 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc0072f0 con 0x7ff0080affc0 2024-09-13T18:45:49.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0081470e0 con 0x7ff0080affc0 2024-09-13T18:45:49.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.217+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00814aca0 con 0x7ff0080affc0 2024-09-13T18:45:49.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f3a7d3df640 1 Processor -- start 2024-09-13T18:45:49.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f3a7d3df640 1 -- start start 2024-09-13T18:45:49.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.217+0000 7f900d6a6640 1 -- 172.21.15.29:0/3768033760 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9008140760 con 0x7f90080affc0 2024-09-13T18:45:49.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.217+0000 7f900d6a6640 1 -- 172.21.15.29:0/3768033760 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90080a9720 con 0x7f90080affc0 2024-09-13T18:45:49.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.217+0000 7f3a7d3df640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a78071960 0x7f3a781408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.217+0000 7f3a7d3df640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a780abb30 0x7f3a7806fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.217+0000 7f3a77fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a78071960 0x7f3a781408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.217+0000 7f3a77fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a78071960 0x7f3a781408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44486/0 (socket says 172.21.15.29:44486) 2024-09-13T18:45:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.217+0000 7f3a77fff640 1 -- 172.21.15.29:0/2306464576 learned_addr learned my addr 172.21.15.29:0/2306464576 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.217+0000 7f3a7d3df640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a78146460 0x7f3a780704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.218+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78136d80 con 0x7f3a780abb30 2024-09-13T18:45:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.218+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78140fb0 con 0x7f3a78146460 2024-09-13T18:45:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.218+0000 7f3a7cbde640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a78146460 0x7f3a780704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.218+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78136730 con 0x7f3a78071960 2024-09-13T18:45:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.218+0000 7f3a6ffff640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a780abb30 0x7f3a7806fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.217+0000 7fd683fff640 1 --2- 172.21.15.29:0/1516041432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd67c0d1040 0x7fd67c036390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c410 tx=0x7fd67800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.218+0000 7f3a77fff640 1 -- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a78146460 msgr2=0x7f3a780704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.218+0000 7f3a77fff640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a78146460 0x7f3a780704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.218+0000 7f3a77fff640 1 -- 172.21.15.29:0/2306464576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a780abb30 msgr2=0x7f3a7806fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.218+0000 7f3a77fff640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a780abb30 0x7f3a7806fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.218+0000 7f3a77fff640 1 -- 172.21.15.29:0/2306464576 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680094d0 con 0x7f3a78071960 2024-09-13T18:45:49.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.218+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00814af20 con 0x7ff0080affc0 2024-09-13T18:45:49.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.219+0000 7f3a6ffff640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a780abb30 0x7f3a7806fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:49.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7f900d6a6640 1 -- 172.21.15.29:0/3768033760 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9008143800 con 0x7f90080affc0 2024-09-13T18:45:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.219+0000 7f3a77fff640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a78071960 0x7f3a781408d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009870 tx=0x7f3a680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.219+0000 7f3a757fa640 1 -- 172.21.15.29:0/2306464576 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68004230 con 0x7f3a78071960 2024-09-13T18:45:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.219+0000 7f3a757fa640 1 -- 172.21.15.29:0/2306464576 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a68004390 con 0x7f3a78071960 2024-09-13T18:45:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.219+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a78136a10 con 0x7f3a78071960 2024-09-13T18:45:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a78070000 con 0x7f3a78071960 2024-09-13T18:45:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.219+0000 7f81a57fa640 1 -- 172.21.15.29:0/1685459663 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8198039070 con 0x7f81a80b38f0 2024-09-13T18:45:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f0c13e80640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c0400bdf0 0x7f0c040d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f0c13e80640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c040ca2e0 0x7f0c040354e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f0c13e80640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c040d2640 0x7f0c04038ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f0c13e80640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c040365c0 con 0x7f0c0400bdf0 2024-09-13T18:45:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f0c13e80640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0402c670 con 0x7f0c040ca2e0 2024-09-13T18:45:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f0c13e80640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c040d3080 con 0x7f0c040d2640 2024-09-13T18:45:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f0c1141b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c040ca2e0 0x7f0c040354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f0c11c1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c0400bdf0 0x7f0c040d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f0c11c1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c0400bdf0 0x7f0c040d2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41138/0 (socket says 172.21.15.29:41138) 2024-09-13T18:45:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.216+0000 7f0c11c1c640 1 -- 172.21.15.29:0/3711797262 learned_addr learned my addr 172.21.15.29:0/3711797262 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7feff9ffb640 1 -- 172.21.15.29:0/19221808 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feffc007450 con 0x7ff0080affc0 2024-09-13T18:45:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7f81a57fa640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f819406ac00 0x7f819406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7f81a57fa640 1 -- 172.21.15.29:0/1685459663 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f81980aae10 con 0x7f81a80b38f0 2024-09-13T18:45:49.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7feff9ffb640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fefec06acd0 0x7fefec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7f9004ff9640 1 -- 172.21.15.29:0/3768033760 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f90000147e0 con 0x7f90080affc0 2024-09-13T18:45:49.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7feff9ffb640 1 -- 172.21.15.29:0/19221808 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feffc088a90 con 0x7ff0080affc0 2024-09-13T18:45:49.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7f9004ff9640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8ff406acd0 0x7f8ff406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7f0c1141b640 1 -- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c040d2640 msgr2=0x7f0c04038ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:45:49.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7f0c1141b640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c040d2640 0x7f0c04038ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7f0c1141b640 1 -- 172.21.15.29:0/3711797262 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c0400bdf0 msgr2=0x7f0c040d2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7f0c1141b640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c0400bdf0 0x7f0c040d2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.220+0000 7f0c1141b640 1 -- 172.21.15.29:0/3711797262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c04038030 con 0x7f0c040ca2e0 2024-09-13T18:45:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7f0c11c1c640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c0400bdf0 0x7f0c040d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7f0c1141b640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c040ca2e0 0x7f0c040354e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c063830 tx=0x7f0c0c069b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7f9004ff9640 1 -- 172.21.15.29:0/3768033760 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9000089c30 con 0x7f90080affc0 2024-09-13T18:45:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7ff00d5b5640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fefec06acd0 0x7fefec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7f3a757fa640 1 -- 172.21.15.29:0/2306464576 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68003830 con 0x7f3a78071960 2024-09-13T18:45:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7f81a7fff640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f819406ac00 0x7f819406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7f9007fff640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8ff406acd0 0x7f8ff406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7f0c027fc640 1 -- 172.21.15.29:0/3711797262 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0b6610 con 0x7f0c040ca2e0 2024-09-13T18:45:49.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7f0c027fc640 1 -- 172.21.15.29:0/3711797262 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c0b6770 con 0x7f0c040ca2e0 2024-09-13T18:45:49.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7f0c027fc640 1 -- 172.21.15.29:0/3711797262 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0b6ae0 con 0x7f0c040ca2e0 2024-09-13T18:45:49.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7f0c13e80640 1 -- 172.21.15.29:0/3711797262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c040d3360 con 0x7f0c040ca2e0 2024-09-13T18:45:49.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.222+0000 7f0c13e80640 1 -- 172.21.15.29:0/3711797262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c040385b0 con 0x7f0c040ca2e0 2024-09-13T18:45:49.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7ff00d5b5640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fefec06acd0 0x7fefec06d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff0000058d0 tx=0x7ff000005020 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.222+0000 7f9007fff640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8ff406acd0 0x7f8ff406d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc034000 tx=0x7f8ffc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.221+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5c005250 con 0x7f3a78071960 2024-09-13T18:45:49.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.222+0000 7f81a7fff640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f819406ac00 0x7f819406d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81a80b8e20 tx=0x7f819c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.223+0000 7f0c13e80640 1 -- 172.21.15.29:0/3711797262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c040387d0 con 0x7f0c040ca2e0 2024-09-13T18:45:49.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.224+0000 7f0c027fc640 1 -- 172.21.15.29:0/3711797262 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0c0c0b3050 con 0x7f0c040ca2e0 2024-09-13T18:45:49.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.224+0000 7f0c027fc640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0bf006ac80 0x7f0bf006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.224+0000 7fd66ffff640 1 -- 172.21.15.29:0/1516041432 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678005230 con 0x7fd67c0d1040 2024-09-13T18:45:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.224+0000 7fd66ffff640 1 -- 172.21.15.29:0/1516041432 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678005390 con 0x7fd67c0d1040 2024-09-13T18:45:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.224+0000 7fd66ffff640 1 -- 172.21.15.29:0/1516041432 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780117b0 con 0x7fd67c0d1040 2024-09-13T18:45:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.224+0000 7fd68a0c9640 1 -- 172.21.15.29:0/1516041432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67c035930 con 0x7fd67c0d1040 2024-09-13T18:45:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.224+0000 7fd68a0c9640 1 -- 172.21.15.29:0/1516041432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c036ed0 con 0x7fd67c0d1040 2024-09-13T18:45:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.224+0000 7f0c11c1c640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0bf006ac80 0x7f0bf006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.225+0000 7f0c027fc640 1 -- 172.21.15.29:0/3711797262 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0c0c122e50 con 0x7f0c040ca2e0 2024-09-13T18:45:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.224+0000 7feff9ffb640 1 -- 172.21.15.29:0/19221808 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feffc053aa0 con 0x7ff0080affc0 2024-09-13T18:45:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.225+0000 7f0c11c1c640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0bf006ac80 0x7f0bf006d140 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c08001900 tx=0x7f0c08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.225+0000 7f81a57fa640 1 -- 172.21.15.29:0/1685459663 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8198075f00 con 0x7f81a80b38f0 2024-09-13T18:45:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.226+0000 7fd68a0c9640 1 -- 172.21.15.29:0/1516041432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd664005250 con 0x7fd67c0d1040 2024-09-13T18:45:49.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.227+0000 7f3a757fa640 1 -- 172.21.15.29:0/2306464576 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3a68043030 con 0x7f3a78071960 2024-09-13T18:45:49.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.227+0000 7fd66ffff640 1 -- 172.21.15.29:0/1516041432 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd678011910 con 0x7fd67c0d1040 2024-09-13T18:45:49.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.227+0000 7fd66ffff640 1 --2- 172.21.15.29:0/1516041432 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd66806ac50 0x7fd66806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.227+0000 7f3a757fa640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f3a5806ac80 0x7f3a5806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.227+0000 7fd66ffff640 1 -- 172.21.15.29:0/1516041432 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd678088a40 con 0x7fd67c0d1040 2024-09-13T18:45:49.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.228+0000 7fd6837fe640 1 --2- 172.21.15.29:0/1516041432 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd66806ac50 0x7fd66806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.228+0000 7f3a6ffff640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f3a5806ac80 0x7f3a5806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.228+0000 7fd6837fe640 1 --2- 172.21.15.29:0/1516041432 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd66806ac50 0x7fd66806d110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd670004ea0 tx=0x7fd670009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.228+0000 7f3a6ffff640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f3a5806ac80 0x7f3a5806d140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3a781374f0 tx=0x7f3a60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.229+0000 7f3a757fa640 1 -- 172.21.15.29:0/2306464576 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3a68041070 con 0x7f3a78071960 2024-09-13T18:45:49.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.230+0000 7f9004ff9640 1 -- 172.21.15.29:0/3768033760 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9000054b90 con 0x7f90080affc0 2024-09-13T18:45:49.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.230+0000 7f0c027fc640 1 -- 172.21.15.29:0/3711797262 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0c0c0edeb0 con 0x7f0c040ca2e0 2024-09-13T18:45:49.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.234+0000 7f3a757fa640 1 -- 172.21.15.29:0/2306464576 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3a68074ff0 con 0x7f3a78071960 2024-09-13T18:45:49.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.234+0000 7fd66ffff640 1 -- 172.21.15.29:0/1516041432 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd678053aa0 con 0x7fd67c0d1040 2024-09-13T18:45:49.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.481+0000 7fdad2a61640 1 -- 172.21.15.29:0/2271065218 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdaac005500 con 0x7fdacc093de0 2024-09-13T18:45:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.483+0000 7fdac8ff9640 1 -- 172.21.15.29:0/2271065218 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdabc0582d0 con 0x7fdacc093de0 2024-09-13T18:45:49.485 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-09-13T18:45:49.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.486+0000 7fdad2a61640 1 -- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdab806acd0 msgr2=0x7fdab806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.486+0000 7fdad2a61640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdab806acd0 0x7fdab806d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0b18b0 tx=0x7fdac0009040 comp rx=0 tx=0).stop 2024-09-13T18:45:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.486+0000 7fdad2a61640 1 -- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc093de0 msgr2=0x7fdacc09ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.486+0000 7fdad2a61640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc093de0 0x7fdacc09ce40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00fa70 tx=0x7fdabc00ff30 comp rx=0 tx=0).stop 2024-09-13T18:45:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.486+0000 7fdad2a61640 1 -- 172.21.15.29:0/2271065218 shutdown_connections 2024-09-13T18:45:49.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.486+0000 7fdad2a61640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdab806acd0 0x7fdab806d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.486+0000 7fdad2a61640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdacc0b6c50 0x7fdacc09bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.486+0000 7fdad2a61640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdacc0b5990 0x7fdacc09b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.487+0000 7fdad2a61640 1 --2- 172.21.15.29:0/2271065218 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdacc093de0 0x7fdacc09ce40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.487+0000 7fdad2a61640 1 -- 172.21.15.29:0/2271065218 >> 172.21.15.29:0/2271065218 conn(0x7fdacc099230 msgr2=0x7fdacc0b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.487+0000 7fdad2a61640 1 -- 172.21.15.29:0/2271065218 shutdown_connections 2024-09-13T18:45:49.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.487+0000 7fdad2a61640 1 -- 172.21.15.29:0/2271065218 wait complete. 2024-09-13T18:45:49.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.3 2024-09-13T18:45:49.506 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:49.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.550+0000 7f900d6a6640 1 -- 172.21.15.29:0/3768033760 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f90081405c0 con 0x7f90080affc0 2024-09-13T18:45:49.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.551+0000 7f9004ff9640 1 -- 172.21.15.29:0/3768033760 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90081405c0 con 0x7f90080affc0 2024-09-13T18:45:49.554 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-09-13T18:45:49.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.553+0000 7f900d6a6640 1 -- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8ff406acd0 msgr2=0x7f8ff406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.553+0000 7f900d6a6640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8ff406acd0 0x7f8ff406d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc034000 tx=0x7f8ffc02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:49.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.553+0000 7f900d6a6640 1 -- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 msgr2=0x7f9008142c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.553+0000 7f900d6a6640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 0x7f9008142c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f900000efc0 tx=0x7f900000c490 comp rx=0 tx=0).stop 2024-09-13T18:45:49.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.553+0000 7f900d6a6640 1 -- 172.21.15.29:0/3768033760 shutdown_connections 2024-09-13T18:45:49.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.553+0000 7f900d6a6640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8ff406acd0 0x7f8ff406d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.553+0000 7f900d6a6640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90080b0e60 0x7f90081431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.553+0000 7f900d6a6640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f90080affc0 0x7f9008142c80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.553+0000 7f900d6a6640 1 --2- 172.21.15.29:0/3768033760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90080aec00 0x7f9008140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.553+0000 7f900d6a6640 1 -- 172.21.15.29:0/3768033760 >> 172.21.15.29:0/3768033760 conn(0x7f90080b7250 msgr2=0x7f9008071450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.553+0000 7f900d6a6640 1 -- 172.21.15.29:0/3768033760 shutdown_connections 2024-09-13T18:45:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.553+0000 7f900d6a6640 1 -- 172.21.15.29:0/3768033760 wait complete. 2024-09-13T18:45:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.555+0000 7fe121841640 1 -- 172.21.15.29:0/3046320957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe11c1cdfb0 con 0x7fe11c147a80 2024-09-13T18:45:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.556+0000 7fe103fff640 1 -- 172.21.15.29:0/3046320957 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe11c1cdfb0 con 0x7fe11c147a80 2024-09-13T18:45:49.559 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-09-13T18:45:49.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.560+0000 7fe121841640 1 -- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe10406aeb0 msgr2=0x7fe10406d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.560+0000 7fe121841640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe10406aeb0 0x7fe10406d370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe11000aaf0 tx=0x7fe110008040 comp rx=0 tx=0).stop 2024-09-13T18:45:49.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.560+0000 7fe121841640 1 -- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11c147a80 msgr2=0x7fe11c1ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.560+0000 7fe121841640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11c147a80 0x7fe11c1ce600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe11400c7e0 tx=0x7fe11400cca0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.560+0000 7fe121841640 1 -- 172.21.15.29:0/3046320957 shutdown_connections 2024-09-13T18:45:49.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.560+0000 7fe121841640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe10406aeb0 0x7fe10406d370 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.560+0000 7fe121841640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe11c147a80 0x7fe11c1ce600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.560+0000 7fe121841640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe11c0b9fb0 0x7fe11c13c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.560+0000 7fe121841640 1 --2- 172.21.15.29:0/3046320957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe11c0b38f0 0x7fe11c142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.560+0000 7fe121841640 1 -- 172.21.15.29:0/3046320957 >> 172.21.15.29:0/3046320957 conn(0x7fe11c06a500 msgr2=0x7fe11c0709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.560+0000 7fe121841640 1 -- 172.21.15.29:0/3046320957 shutdown_connections 2024-09-13T18:45:49.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.560+0000 7fe121841640 1 -- 172.21.15.29:0/3046320957 wait complete. 2024-09-13T18:45:49.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.0 2024-09-13T18:45:49.568 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:49.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.4 2024-09-13T18:45:49.578 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:49.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.593+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff0080b0af0 con 0x7ff0080affc0 2024-09-13T18:45:49.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.593+0000 7feff9ffb640 1 -- 172.21.15.29:0/19221808 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feffc017020 con 0x7ff0080affc0 2024-09-13T18:45:49.596 INFO:teuthology.orchestra.run.smithi029.stdout:55834574858 2024-09-13T18:45:49.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.595+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fefec06acd0 msgr2=0x7fefec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.595+0000 7ff00e5b7640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fefec06acd0 0x7fefec06d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff0000058d0 tx=0x7ff000005020 comp rx=0 tx=0).stop 2024-09-13T18:45:49.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.595+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff0080affc0 msgr2=0x7ff00814d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.595+0000 7ff00e5b7640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff0080affc0 0x7ff00814d260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feffc00c390 tx=0x7feffc001e70 comp rx=0 tx=0).stop 2024-09-13T18:45:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.595+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 shutdown_connections 2024-09-13T18:45:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.595+0000 7ff00e5b7640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fefec06acd0 0x7fefec06d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.595+0000 7ff00e5b7640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0080b0e60 0x7ff0081e2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.595+0000 7ff00e5b7640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff0080affc0 0x7ff00814d260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.595+0000 7ff00e5b7640 1 --2- 172.21.15.29:0/19221808 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0080aec00 0x7ff00814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.595+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 >> 172.21.15.29:0/19221808 conn(0x7ff0080b7250 msgr2=0x7ff008147a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.595+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 shutdown_connections 2024-09-13T18:45:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.595+0000 7ff00e5b7640 1 -- 172.21.15.29:0/19221808 wait complete. 2024-09-13T18:45:49.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.1 2024-09-13T18:45:49.609 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:49.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.623+0000 7f81af0b1640 1 -- 172.21.15.29:0/1685459663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f81880057d0 con 0x7f81a80b38f0 2024-09-13T18:45:49.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.623+0000 7f81a57fa640 1 -- 172.21.15.29:0/1685459663 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8198037090 con 0x7f81a80b38f0 2024-09-13T18:45:49.626 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-09-13T18:45:49.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.627+0000 7f81af0b1640 1 -- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f819406ac00 msgr2=0x7f819406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.627+0000 7f81af0b1640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f819406ac00 0x7f819406d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81a80b8e20 tx=0x7f819c008040 comp rx=0 tx=0).stop 2024-09-13T18:45:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.627+0000 7f81af0b1640 1 -- 172.21.15.29:0/1685459663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81a80b38f0 msgr2=0x7f81a80afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.627+0000 7f81af0b1640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81a80b38f0 0x7f81a80afea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f819802a240 tx=0x7f81980046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.627+0000 7f81af0b1640 1 -- 172.21.15.29:0/1685459663 shutdown_connections 2024-09-13T18:45:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.627+0000 7f81af0b1640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f819406ac00 0x7f819406d0c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.627+0000 7f81af0b1640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81a8147a80 0x7f81a813e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.627+0000 7f81af0b1640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81a80b9fb0 0x7f81a813deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.627+0000 7f81af0b1640 1 --2- 172.21.15.29:0/1685459663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81a80b38f0 0x7f81a80afea0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.627+0000 7f81af0b1640 1 -- 172.21.15.29:0/1685459663 >> 172.21.15.29:0/1685459663 conn(0x7f81a806a500 msgr2=0x7f81a8142e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.627+0000 7f81af0b1640 1 -- 172.21.15.29:0/1685459663 shutdown_connections 2024-09-13T18:45:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.627+0000 7f81af0b1640 1 -- 172.21.15.29:0/1685459663 wait complete. 2024-09-13T18:45:49.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.637+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3a5c0057d0 con 0x7f3a78071960 2024-09-13T18:45:49.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.638+0000 7f3a757fa640 1 -- 172.21.15.29:0/2306464576 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a6804b090 con 0x7f3a78071960 2024-09-13T18:45:49.640 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-09-13T18:45:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.639+0000 7f0c13e80640 1 -- 172.21.15.29:0/3711797262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0c0401d800 con 0x7f0c040ca2e0 2024-09-13T18:45:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.640+0000 7f0c027fc640 1 -- 172.21.15.29:0/3711797262 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0c0c072040 con 0x7f0c040ca2e0 2024-09-13T18:45:49.643 INFO:teuthology.orchestra.run.smithi029.stdout:55834574858 2024-09-13T18:45:49.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.640+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f3a5806ac80 msgr2=0x7f3a5806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.640+0000 7f3a7d3df640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f3a5806ac80 0x7f3a5806d140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3a781374f0 tx=0x7f3a60009040 comp rx=0 tx=0).stop 2024-09-13T18:45:49.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.640+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a78071960 msgr2=0x7f3a781408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.640+0000 7f3a7d3df640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a78071960 0x7f3a781408d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009870 tx=0x7f3a680046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.640+0000 7fd68a0c9640 1 -- 172.21.15.29:0/1516041432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd6640057d0 con 0x7fd67c0d1040 2024-09-13T18:45:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.640+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 shutdown_connections 2024-09-13T18:45:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.640+0000 7f3a7d3df640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f3a5806ac80 0x7f3a5806d140 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.640+0000 7f3a7d3df640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a78146460 0x7f3a780704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.640+0000 7f3a7d3df640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a780abb30 0x7f3a7806fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.640+0000 7f3a7d3df640 1 --2- 172.21.15.29:0/2306464576 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a78071960 0x7f3a781408d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.640+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 >> 172.21.15.29:0/2306464576 conn(0x7f3a780b71e0 msgr2=0x7f3a780b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.641+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 shutdown_connections 2024-09-13T18:45:49.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.641+0000 7f3a7d3df640 1 -- 172.21.15.29:0/2306464576 wait complete. 2024-09-13T18:45:49.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.2 2024-09-13T18:45:49.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.641+0000 7fd66ffff640 1 -- 172.21.15.29:0/1516041432 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd678017090 con 0x7fd67c0d1040 2024-09-13T18:45:49.649 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-09-13T18:45:49.649 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:49.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.642+0000 7f0c13e80640 1 -- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0bf006ac80 msgr2=0x7f0bf006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.642+0000 7f0c13e80640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0bf006ac80 0x7f0bf006d140 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c08001900 tx=0x7f0c08009040 comp rx=0 tx=0).stop 2024-09-13T18:45:49.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.642+0000 7f0c13e80640 1 -- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c040ca2e0 msgr2=0x7f0c040354e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.642+0000 7f0c13e80640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c040ca2e0 0x7f0c040354e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c063830 tx=0x7f0c0c069b80 comp rx=0 tx=0).stop 2024-09-13T18:45:49.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.642+0000 7f0c13e80640 1 -- 172.21.15.29:0/3711797262 shutdown_connections 2024-09-13T18:45:49.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.642+0000 7f0c13e80640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0bf006ac80 0x7f0bf006d140 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.642+0000 7f0c13e80640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c040d2640 0x7f0c04038ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.642+0000 7f0c13e80640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c040ca2e0 0x7f0c040354e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.642+0000 7f0c13e80640 1 --2- 172.21.15.29:0/3711797262 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c0400bdf0 0x7f0c040d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.642+0000 7f0c13e80640 1 -- 172.21.15.29:0/3711797262 >> 172.21.15.29:0/3711797262 conn(0x7f0c0400b060 msgr2=0x7f0c04005c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.642+0000 7f0c13e80640 1 -- 172.21.15.29:0/3711797262 shutdown_connections 2024-09-13T18:45:49.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.642+0000 7f0c13e80640 1 -- 172.21.15.29:0/3711797262 wait complete. 2024-09-13T18:45:49.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.643+0000 7fd68a0c9640 1 -- 172.21.15.29:0/1516041432 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd66806ac50 msgr2=0x7fd66806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.643+0000 7fd68a0c9640 1 --2- 172.21.15.29:0/1516041432 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd66806ac50 0x7fd66806d110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd670004ea0 tx=0x7fd670009040 comp rx=0 tx=0).stop 2024-09-13T18:45:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.643+0000 7fd68a0c9640 1 -- 172.21.15.29:0/1516041432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd67c0d1040 msgr2=0x7fd67c036390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.643+0000 7fd68a0c9640 1 --2- 172.21.15.29:0/1516041432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd67c0d1040 0x7fd67c036390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c410 tx=0x7fd67800c8d0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.643+0000 7fd68a0c9640 1 -- 172.21.15.29:0/1516041432 shutdown_connections 2024-09-13T18:45:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.643+0000 7fd68a0c9640 1 --2- 172.21.15.29:0/1516041432 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd66806ac50 0x7fd66806d110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.643+0000 7fd68a0c9640 1 --2- 172.21.15.29:0/1516041432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd67c0d1040 0x7fd67c036390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.643+0000 7fd68a0c9640 1 --2- 172.21.15.29:0/1516041432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67c01f0d0 0x7fd67c035e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.643+0000 7fd68a0c9640 1 --2- 172.21.15.29:0/1516041432 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd67c006c90 0x7fd67c0cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.643+0000 7fd68a0c9640 1 -- 172.21.15.29:0/1516041432 >> 172.21.15.29:0/1516041432 conn(0x7fd67c009030 msgr2=0x7fd67c038560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.643+0000 7fd68a0c9640 1 -- 172.21.15.29:0/1516041432 shutdown_connections 2024-09-13T18:45:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.643+0000 7fd68a0c9640 1 -- 172.21.15.29:0/1516041432 wait complete. 2024-09-13T18:45:49.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.5 2024-09-13T18:45:49.656 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:49.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.6 2024-09-13T18:45:49.658 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:49.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.7 2024-09-13T18:45:49.659 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:49.659 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:45:49.659 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:49.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.797+0000 7fb2a4dc7640 1 Processor -- start 2024-09-13T18:45:49.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.797+0000 7fb2a4dc7640 1 -- start start 2024-09-13T18:45:49.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb2a4dc7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2a00b4ae0 0x7fb2a013f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb2a4dc7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb2a0070140 0x7fb2a013fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb2a4dc7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a0140280 con 0x7fb2a006a140 2024-09-13T18:45:49.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb2a4dc7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a0071370 con 0x7fb2a00b4ae0 2024-09-13T18:45:49.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb2a4dc7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a006a520 con 0x7fb2a0070140 2024-09-13T18:45:49.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb295d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2a00b4ae0 0x7fb2a013f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb295d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2a00b4ae0 0x7fb2a013f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41166/0 (socket says 172.21.15.29:41166) 2024-09-13T18:45:49.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb295d9b640 1 -- 172.21.15.29:0/3845284025 learned_addr learned my addr 172.21.15.29:0/3845284025 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb29ed9d640 1 --2- 172.21.15.29:0/3845284025 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb2a0070140 0x7fb2a013fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb295d9b640 1 -- 172.21.15.29:0/3845284025 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb2a0070140 msgr2=0x7fb2a013fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb295d9b640 1 --2- 172.21.15.29:0/3845284025 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb2a0070140 0x7fb2a013fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb295d9b640 1 -- 172.21.15.29:0/3845284025 >> v1:172.21.15.96:6789/0 conn(0x7fb2a006a140 legacy=0x7fb2a00b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.798+0000 7fb295d9b640 1 -- 172.21.15.29:0/3845284025 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a00715e0 con 0x7fb2a00b4ae0 2024-09-13T18:45:49.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.799+0000 7fb295d9b640 1 --2- 172.21.15.29:0/3845284025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a00b4ae0 0x7fb2a013f800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb288009870 tx=0x7fb28802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f0a99bf25f38ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.799+0000 7fb29dd9b640 1 -- 172.21.15.29:0/3845284025 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28802ae10 con 0x7fb2a00b4ae0 2024-09-13T18:45:49.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.799+0000 7fb29dd9b640 1 -- 172.21.15.29:0/3845284025 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb288032440 con 0x7fb2a00b4ae0 2024-09-13T18:45:49.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.799+0000 7fb29dd9b640 1 -- 172.21.15.29:0/3845284025 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2880327d0 con 0x7fb2a00b4ae0 2024-09-13T18:45:49.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.800+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3845284025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a00b4ae0 msgr2=0x7fb2a013f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.800+0000 7fb2a4dc7640 1 --2- 172.21.15.29:0/3845284025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a00b4ae0 0x7fb2a013f800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb288009870 tx=0x7fb28802a100 comp rx=0 tx=0).stop 2024-09-13T18:45:49.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.800+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3845284025 shutdown_connections 2024-09-13T18:45:49.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.800+0000 7fb2a4dc7640 1 --2- 172.21.15.29:0/3845284025 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb2a0070140 0x7fb2a013fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.800+0000 7fb2a4dc7640 1 --2- 172.21.15.29:0/3845284025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a00b4ae0 0x7fb2a013f800 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.800+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3845284025 >> 172.21.15.29:0/3845284025 conn(0x7fb2a00b8440 msgr2=0x7fb2a00b8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.800+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3845284025 shutdown_connections 2024-09-13T18:45:49.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.800+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3845284025 wait complete. 2024-09-13T18:45:49.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.801+0000 7fb2a4dc7640 1 Processor -- start 2024-09-13T18:45:49.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.801+0000 7fb2a4dc7640 1 -- start start 2024-09-13T18:45:49.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb2a4dc7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a006a140 0x7fb2a0146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb2a4dc7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a0070140 0x7fb2a00ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb2a4dc7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb2a00b4ae0 0x7fb2a00abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb2a4dc7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a00adc10 con 0x7fb2a006a140 2024-09-13T18:45:49.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb2a4dc7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a00ade80 con 0x7fb2a0070140 2024-09-13T18:45:49.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb2a4dc7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a00ae9c0 con 0x7fb2a00b4ae0 2024-09-13T18:45:49.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb29e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a006a140 0x7fb2a0146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb29e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a006a140 0x7fb2a0146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41172/0 (socket says 172.21.15.29:41172) 2024-09-13T18:45:49.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb29e59c640 1 -- 172.21.15.29:0/3428879895 learned_addr learned my addr 172.21.15.29:0/3428879895 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:49.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb29ed9d640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb2a00b4ae0 0x7fb2a00abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb295d9b640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a0070140 0x7fb2a00ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb29e59c640 1 -- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb2a00b4ae0 msgr2=0x7fb2a00abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb29e59c640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb2a00b4ae0 0x7fb2a00abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb29e59c640 1 -- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a0070140 msgr2=0x7fb2a00ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb29e59c640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a0070140 0x7fb2a00ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb29e59c640 1 -- 172.21.15.29:0/3428879895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2880094d0 con 0x7fb2a006a140 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb29e59c640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a006a140 0x7fb2a0146690 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb29000b3f0 tx=0x7fb29000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb2977fe640 1 -- 172.21.15.29:0/3428879895 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290011830 con 0x7fb2a006a140 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb2977fe640 1 -- 172.21.15.29:0/3428879895 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb290011990 con 0x7fb2a006a140 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb2977fe640 1 -- 172.21.15.29:0/3428879895 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290011d40 con 0x7fb2a006a140 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.802+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3428879895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a00aeca0 con 0x7fb2a006a140 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.803+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3428879895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a01457f0 con 0x7fb2a006a140 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.803+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3428879895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a00ab8c0 con 0x7fb2a006a140 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.804+0000 7fb2977fe640 1 -- 172.21.15.29:0/3428879895 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb29001a400 con 0x7fb2a006a140 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.804+0000 7fb2977fe640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb28006ac00 0x7fb28006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.804+0000 7fb2977fe640 1 -- 172.21.15.29:0/3428879895 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb2900892b0 con 0x7fb2a006a140 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.805+0000 7fb295d9b640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb28006ac00 0x7fb28006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.805+0000 7fb295d9b640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb28006ac00 0x7fb28006d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb288034000 tx=0x7fb28802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.809+0000 7fb2977fe640 1 -- 172.21.15.29:0/3428879895 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb2900542e0 con 0x7fb2a006a140 2024-09-13T18:45:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.978+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3428879895 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2a00ae850 con 0x7fb28006ac00 2024-09-13T18:45:49.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.987+0000 7fb2977fe640 1 -- 172.21.15.29:0/3428879895 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345344 (secure 0 0 0) 0x7fb2a00ae850 con 0x7fb28006ac00 2024-09-13T18:45:49.993 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:49.995 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-13T18:45:49.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.991+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb28006ac00 msgr2=0x7fb28006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.991+0000 7fb2a4dc7640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb28006ac00 0x7fb28006d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb288034000 tx=0x7fb28802e000 comp rx=0 tx=0).stop 2024-09-13T18:45:49.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.991+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3428879895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a006a140 msgr2=0x7fb2a0146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.991+0000 7fb2a4dc7640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a006a140 0x7fb2a0146690 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb29000b3f0 tx=0x7fb29000b8b0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.991+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3428879895 shutdown_connections 2024-09-13T18:45:49.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.991+0000 7fb2a4dc7640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb28006ac00 0x7fb28006d0c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.991+0000 7fb2a4dc7640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb2a00b4ae0 0x7fb2a00abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.991+0000 7fb2a4dc7640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a0070140 0x7fb2a00ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.991+0000 7fb2a4dc7640 1 --2- 172.21.15.29:0/3428879895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a006a140 0x7fb2a0146690 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.991+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3428879895 >> 172.21.15.29:0/3428879895 conn(0x7fb2a00b8440 msgr2=0x7fb2a00b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.991+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3428879895 shutdown_connections 2024-09-13T18:45:49.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:49.991+0000 7fb2a4dc7640 1 -- 172.21.15.29:0/3428879895 wait complete. 2024-09-13T18:45:50.005 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-13T18:45:49.593973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234748,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739972,"statfs":{"total":773094113280,"available":772853731328,"internally_reserved":0,"allocated":2228224,"data_stored":1985074,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003403"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.052330+0000","last_change":"2024-09-13T18:45:21.668274+0000","last_active":"2024-09-13T18:45:26.052330+0000","last_peered":"2024-09-13T18:45:26.052330+0000","last_clean":"2024-09-13T18:45:26.052330+0000","last_became_active":"2024-09-13T18:45:21.667985+0000","last_became_peered":"2024-09-13T18:45:21.667985+0000","last_unstale":"2024-09-13T18:45:26.052330+0000","last_undegraded":"2024-09-13T18:45:26.052330+0000","last_fullsized":"2024-09-13T18:45:26.052330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:45.703424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601092+0000","last_change":"2024-09-13T18:45:22.034389+0000","last_active":"2024-09-13T18:45:26.601092+0000","last_peered":"2024-09-13T18:45:26.601092+0000","last_clean":"2024-09-13T18:45:26.601092+0000","last_became_active":"2024-09-13T18:45:22.034125+0000","last_became_peered":"2024-09-13T18:45:22.034125+0000","last_unstale":"2024-09-13T18:45:26.601092+0000","last_undegraded":"2024-09-13T18:45:26.601092+0000","last_fullsized":"2024-09-13T18:45:26.601092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600983+0000","last_change":"2024-09-13T18:45:26.253118+0000","last_active":"2024-09-13T18:45:26.600983+0000","last_peered":"2024-09-13T18:45:26.600983+0000","last_clean":"2024-09-13T18:45:26.600983+0000","last_became_active":"2024-09-13T18:45:26.252747+0000","last_became_peered":"2024-09-13T18:45:26.252747+0000","last_unstale":"2024-09-13T18:45:26.600983+0000","last_undegraded":"2024-09-13T18:45:26.600983+0000","last_fullsized":"2024-09-13T18:45:26.600983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:11.065130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.036006+0000","last_change":"2024-09-13T18:45:21.666664+0000","last_active":"2024-09-13T18:45:26.036006+0000","last_peered":"2024-09-13T18:45:26.036006+0000","last_clean":"2024-09-13T18:45:26.036006+0000","last_became_active":"2024-09-13T18:45:21.666398+0000","last_became_peered":"2024-09-13T18:45:21.666398+0000","last_unstale":"2024-09-13T18:45:26.036006+0000","last_undegraded":"2024-09-13T18:45:26.036006+0000","last_fullsized":"2024-09-13T18:45:26.036006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:06.210838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599906+0000","last_change":"2024-09-13T18:45:22.024774+0000","last_active":"2024-09-13T18:45:26.599906+0000","last_peered":"2024-09-13T18:45:26.599906+0000","last_clean":"2024-09-13T18:45:26.599906+0000","last_became_active":"2024-09-13T18:45:22.024424+0000","last_became_peered":"2024-09-13T18:45:22.024424+0000","last_unstale":"2024-09-13T18:45:26.599906+0000","last_undegraded":"2024-09-13T18:45:26.599906+0000","last_fullsized":"2024-09-13T18:45:26.599906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409608+0000","last_change":"2024-09-13T18:45:26.050411+0000","last_active":"2024-09-13T18:45:26.409608+0000","last_peered":"2024-09-13T18:45:26.409608+0000","last_clean":"2024-09-13T18:45:26.409608+0000","last_became_active":"2024-09-13T18:45:26.049414+0000","last_became_peered":"2024-09-13T18:45:26.049414+0000","last_unstale":"2024-09-13T18:45:26.409608+0000","last_undegraded":"2024-09-13T18:45:26.409608+0000","last_fullsized":"2024-09-13T18:45:26.409608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.251372+0000","last_change":"2024-09-13T18:45:21.667928+0000","last_active":"2024-09-13T18:45:26.251372+0000","last_peered":"2024-09-13T18:45:26.251372+0000","last_clean":"2024-09-13T18:45:26.251372+0000","last_became_active":"2024-09-13T18:45:21.667602+0000","last_became_peered":"2024-09-13T18:45:21.667602+0000","last_unstale":"2024-09-13T18:45:26.251372+0000","last_undegraded":"2024-09-13T18:45:26.251372+0000","last_fullsized":"2024-09-13T18:45:26.251372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:53.936326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600361+0000","last_change":"2024-09-13T18:45:22.036952+0000","last_active":"2024-09-13T18:45:26.600361+0000","last_peered":"2024-09-13T18:45:26.600361+0000","last_clean":"2024-09-13T18:45:26.600361+0000","last_became_active":"2024-09-13T18:45:22.035790+0000","last_became_peered":"2024-09-13T18:45:22.035790+0000","last_unstale":"2024-09-13T18:45:26.600361+0000","last_undegraded":"2024-09-13T18:45:26.600361+0000","last_fullsized":"2024-09-13T18:45:26.600361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410405+0000","last_change":"2024-09-13T18:45:26.052333+0000","last_active":"2024-09-13T18:45:26.410405+0000","last_peered":"2024-09-13T18:45:26.410405+0000","last_clean":"2024-09-13T18:45:26.410405+0000","last_became_active":"2024-09-13T18:45:26.051873+0000","last_became_peered":"2024-09-13T18:45:26.051873+0000","last_unstale":"2024-09-13T18:45:26.410405+0000","last_undegraded":"2024-09-13T18:45:26.410405+0000","last_fullsized":"2024-09-13T18:45:26.410405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:03.925946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.250039+0000","last_change":"2024-09-13T18:45:21.669914+0000","last_active":"2024-09-13T18:45:26.250039+0000","last_peered":"2024-09-13T18:45:26.250039+0000","last_clean":"2024-09-13T18:45:26.250039+0000","last_became_active":"2024-09-13T18:45:21.669622+0000","last_became_peered":"2024-09-13T18:45:21.669622+0000","last_unstale":"2024-09-13T18:45:26.250039+0000","last_undegraded":"2024-09-13T18:45:26.250039+0000","last_fullsized":"2024-09-13T18:45:26.250039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.765670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600397+0000","last_change":"2024-09-13T18:45:22.035675+0000","last_active":"2024-09-13T18:45:26.600397+0000","last_peered":"2024-09-13T18:45:26.600397+0000","last_clean":"2024-09-13T18:45:26.600397+0000","last_became_active":"2024-09-13T18:45:22.034431+0000","last_became_peered":"2024-09-13T18:45:22.034431+0000","last_unstale":"2024-09-13T18:45:26.600397+0000","last_undegraded":"2024-09-13T18:45:26.600397+0000","last_fullsized":"2024-09-13T18:45:26.600397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410278+0000","last_change":"2024-09-13T18:45:26.052892+0000","last_active":"2024-09-13T18:45:26.410278+0000","last_peered":"2024-09-13T18:45:26.410278+0000","last_clean":"2024-09-13T18:45:26.410278+0000","last_became_active":"2024-09-13T18:45:26.052441+0000","last_became_peered":"2024-09-13T18:45:26.052441+0000","last_unstale":"2024-09-13T18:45:26.410278+0000","last_undegraded":"2024-09-13T18:45:26.410278+0000","last_fullsized":"2024-09-13T18:45:26.410278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:26.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409959+0000","last_change":"2024-09-13T18:45:22.017741+0000","last_active":"2024-09-13T18:45:26.409959+0000","last_peered":"2024-09-13T18:45:26.409959+0000","last_clean":"2024-09-13T18:45:26.409959+0000","last_became_active":"2024-09-13T18:45:22.015758+0000","last_became_peered":"2024-09-13T18:45:22.015758+0000","last_unstale":"2024-09-13T18:45:26.409959+0000","last_undegraded":"2024-09-13T18:45:26.409959+0000","last_fullsized":"2024-09-13T18:45:26.409959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.250273+0000","last_change":"2024-09-13T18:45:21.672627+0000","last_active":"2024-09-13T18:45:26.250273+0000","last_peered":"2024-09-13T18:45:26.250273+0000","last_clean":"2024-09-13T18:45:26.250273+0000","last_became_active":"2024-09-13T18:45:21.672388+0000","last_became_peered":"2024-09-13T18:45:21.672388+0000","last_unstale":"2024-09-13T18:45:26.250273+0000","last_undegraded":"2024-09-13T18:45:26.250273+0000","last_fullsized":"2024-09-13T18:45:26.250273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410013+0000","last_change":"2024-09-13T18:45:26.052609+0000","last_active":"2024-09-13T18:45:26.410013+0000","last_peered":"2024-09-13T18:45:26.410013+0000","last_clean":"2024-09-13T18:45:26.410013+0000","last_became_active":"2024-09-13T18:45:26.052245+0000","last_became_peered":"2024-09-13T18:45:26.052245+0000","last_unstale":"2024-09-13T18:45:26.410013+0000","last_undegraded":"2024-09-13T18:45:26.410013+0000","last_fullsized":"2024-09-13T18:45:26.410013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:50.583636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601039+0000","last_change":"2024-09-13T18:45:22.028858+0000","last_active":"2024-09-13T18:45:26.601039+0000","last_peered":"2024-09-13T18:45:26.601039+0000","last_clean":"2024-09-13T18:45:26.601039+0000","last_became_active":"2024-09-13T18:45:22.028336+0000","last_became_peered":"2024-09-13T18:45:22.028336+0000","last_unstale":"2024-09-13T18:45:26.601039+0000","last_undegraded":"2024-09-13T18:45:26.601039+0000","last_fullsized":"2024-09-13T18:45:26.601039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.046785+0000","last_change":"2024-09-13T18:45:21.667983+0000","last_active":"2024-09-13T18:45:26.046785+0000","last_peered":"2024-09-13T18:45:26.046785+0000","last_clean":"2024-09-13T18:45:26.046785+0000","last_became_active":"2024-09-13T18:45:21.667625+0000","last_became_peered":"2024-09-13T18:45:21.667625+0000","last_unstale":"2024-09-13T18:45:26.046785+0000","last_undegraded":"2024-09-13T18:45:26.046785+0000","last_fullsized":"2024-09-13T18:45:26.046785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409827+0000","last_change":"2024-09-13T18:45:26.050576+0000","last_active":"2024-09-13T18:45:26.409827+0000","last_peered":"2024-09-13T18:45:26.409827+0000","last_clean":"2024-09-13T18:45:26.409827+0000","last_became_active":"2024-09-13T18:45:26.049129+0000","last_became_peered":"2024-09-13T18:45:26.049129+0000","last_unstale":"2024-09-13T18:45:26.409827+0000","last_undegraded":"2024-09-13T18:45:26.409827+0000","last_fullsized":"2024-09-13T18:45:26.409827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600972+0000","last_change":"2024-09-13T18:45:22.025900+0000","last_active":"2024-09-13T18:45:26.600972+0000","last_peered":"2024-09-13T18:45:26.600972+0000","last_clean":"2024-09-13T18:45:26.600972+0000","last_became_active":"2024-09-13T18:45:22.025624+0000","last_became_peered":"2024-09-13T18:45:22.025624+0000","last_unstale":"2024-09-13T18:45:26.600972+0000","last_undegraded":"2024-09-13T18:45:26.600972+0000","last_fullsized":"2024-09-13T18:45:26.600972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.045814+0000","last_change":"2024-09-13T18:45:21.668525+0000","last_active":"2024-09-13T18:45:26.045814+0000","last_peered":"2024-09-13T18:45:26.045814+0000","last_clean":"2024-09-13T18:45:26.045814+0000","last_became_active":"2024-09-13T18:45:21.668242+0000","last_became_peered":"2024-09-13T18:45:21.668242+0000","last_unstale":"2024-09-13T18:45:26.045814+0000","last_undegraded":"2024-09-13T18:45:26.045814+0000","last_fullsized":"2024-09-13T18:45:26.045814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605435+0000","last_change":"2024-09-13T18:45:26.255263+0000","last_active":"2024-09-13T18:45:26.605435+0000","last_peered":"2024-09-13T18:45:26.605435+0000","last_clean":"2024-09-13T18:45:26.605435+0000","last_became_active":"2024-09-13T18:45:26.254886+0000","last_became_peered":"2024-09-13T18:45:26.254886+0000","last_unstale":"2024-09-13T18:45:26.605435+0000","last_undegraded":"2024-09-13T18:45:26.605435+0000","last_fullsized":"2024-09-13T18:45:26.605435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410916+0000","last_change":"2024-09-13T18:45:22.029624+0000","last_active":"2024-09-13T18:45:26.410916+0000","last_peered":"2024-09-13T18:45:26.410916+0000","last_clean":"2024-09-13T18:45:26.410916+0000","last_became_active":"2024-09-13T18:45:22.027835+0000","last_became_peered":"2024-09-13T18:45:22.027835+0000","last_unstale":"2024-09-13T18:45:26.410916+0000","last_undegraded":"2024-09-13T18:45:26.410916+0000","last_fullsized":"2024-09-13T18:45:26.410916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:16.317986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.249681+0000","last_change":"2024-09-13T18:45:21.669073+0000","last_active":"2024-09-13T18:45:26.249681+0000","last_peered":"2024-09-13T18:45:26.249681+0000","last_clean":"2024-09-13T18:45:26.249681+0000","last_became_active":"2024-09-13T18:45:21.668765+0000","last_became_peered":"2024-09-13T18:45:21.668765+0000","last_unstale":"2024-09-13T18:45:26.249681+0000","last_undegraded":"2024-09-13T18:45:26.249681+0000","last_fullsized":"2024-09-13T18:45:26.249681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409880+0000","last_change":"2024-09-13T18:45:26.050623+0000","last_active":"2024-09-13T18:45:26.409880+0000","last_peered":"2024-09-13T18:45:26.409880+0000","last_clean":"2024-09-13T18:45:26.409880+0000","last_became_active":"2024-09-13T18:45:26.049408+0000","last_became_peered":"2024-09-13T18:45:26.049408+0000","last_unstale":"2024-09-13T18:45:26.409880+0000","last_undegraded":"2024-09-13T18:45:26.409880+0000","last_fullsized":"2024-09-13T18:45:26.409880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:14.574386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599890+0000","last_change":"2024-09-13T18:45:22.022220+0000","last_active":"2024-09-13T18:45:26.599890+0000","last_peered":"2024-09-13T18:45:26.599890+0000","last_clean":"2024-09-13T18:45:26.599890+0000","last_became_active":"2024-09-13T18:45:22.021976+0000","last_became_peered":"2024-09-13T18:45:22.021976+0000","last_unstale":"2024-09-13T18:45:26.599890+0000","last_undegraded":"2024-09-13T18:45:26.599890+0000","last_fullsized":"2024-09-13T18:45:26.599890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.037252+0000","last_change":"2024-09-13T18:45:21.667931+0000","last_active":"2024-09-13T18:45:26.037252+0000","last_peered":"2024-09-13T18:45:26.037252+0000","last_clean":"2024-09-13T18:45:26.037252+0000","last_became_active":"2024-09-13T18:45:21.667680+0000","last_became_peered":"2024-09-13T18:45:21.667680+0000","last_unstale":"2024-09-13T18:45:26.037252+0000","last_undegraded":"2024-09-13T18:45:26.037252+0000","last_fullsized":"2024-09-13T18:45:26.037252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410658+0000","last_change":"2024-09-13T18:45:26.255088+0000","last_active":"2024-09-13T18:45:26.410658+0000","last_peered":"2024-09-13T18:45:26.410658+0000","last_clean":"2024-09-13T18:45:26.410658+0000","last_became_active":"2024-09-13T18:45:26.254662+0000","last_became_peered":"2024-09-13T18:45:26.254662+0000","last_unstale":"2024-09-13T18:45:26.410658+0000","last_undegraded":"2024-09-13T18:45:26.410658+0000","last_fullsized":"2024-09-13T18:45:26.410658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601131+0000","last_change":"2024-09-13T18:45:22.026678+0000","last_active":"2024-09-13T18:45:26.601131+0000","last_peered":"2024-09-13T18:45:26.601131+0000","last_clean":"2024-09-13T18:45:26.601131+0000","last_became_active":"2024-09-13T18:45:22.026419+0000","last_became_peered":"2024-09-13T18:45:22.026419+0000","last_unstale":"2024-09-13T18:45:26.601131+0000","last_undegraded":"2024-09-13T18:45:26.601131+0000","last_fullsized":"2024-09-13T18:45:26.601131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.043788+0000","last_change":"2024-09-13T18:45:21.664622+0000","last_active":"2024-09-13T18:45:26.043788+0000","last_peered":"2024-09-13T18:45:26.043788+0000","last_clean":"2024-09-13T18:45:26.043788+0000","last_became_active":"2024-09-13T18:45:21.664066+0000","last_became_peered":"2024-09-13T18:45:21.664066+0000","last_unstale":"2024-09-13T18:45:26.043788+0000","last_undegraded":"2024-09-13T18:45:26.043788+0000","last_fullsized":"2024-09-13T18:45:26.043788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600919+0000","last_change":"2024-09-13T18:45:26.253888+0000","last_active":"2024-09-13T18:45:26.600919+0000","last_peered":"2024-09-13T18:45:26.600919+0000","last_clean":"2024-09-13T18:45:26.600919+0000","last_became_active":"2024-09-13T18:45:26.253488+0000","last_became_peered":"2024-09-13T18:45:26.253488+0000","last_unstale":"2024-09-13T18:45:26.600919+0000","last_undegraded":"2024-09-13T18:45:26.600919+0000","last_fullsized":"2024-09-13T18:45:26.600919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:44.826493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605373+0000","last_change":"2024-09-13T18:45:22.022940+0000","last_active":"2024-09-13T18:45:26.605373+0000","last_peered":"2024-09-13T18:45:26.605373+0000","last_clean":"2024-09-13T18:45:26.605373+0000","last_became_active":"2024-09-13T18:45:22.022628+0000","last_became_peered":"2024-09-13T18:45:22.022628+0000","last_unstale":"2024-09-13T18:45:26.605373+0000","last_undegraded":"2024-09-13T18:45:26.605373+0000","last_fullsized":"2024-09-13T18:45:26.605373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.251762+0000","last_change":"2024-09-13T18:45:21.668903+0000","last_active":"2024-09-13T18:45:26.251762+0000","last_peered":"2024-09-13T18:45:26.251762+0000","last_clean":"2024-09-13T18:45:26.251762+0000","last_became_active":"2024-09-13T18:45:21.668645+0000","last_became_peered":"2024-09-13T18:45:21.668645+0000","last_unstale":"2024-09-13T18:45:26.251762+0000","last_undegraded":"2024-09-13T18:45:26.251762+0000","last_fullsized":"2024-09-13T18:45:26.251762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599791+0000","last_change":"2024-09-13T18:45:26.250454+0000","last_active":"2024-09-13T18:45:26.599791+0000","last_peered":"2024-09-13T18:45:26.599791+0000","last_clean":"2024-09-13T18:45:26.599791+0000","last_became_active":"2024-09-13T18:45:26.250034+0000","last_became_peered":"2024-09-13T18:45:26.250034+0000","last_unstale":"2024-09-13T18:45:26.599791+0000","last_undegraded":"2024-09-13T18:45:26.599791+0000","last_fullsized":"2024-09-13T18:45:26.599791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.971516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600409+0000","last_change":"2024-09-13T18:45:22.032362+0000","last_active":"2024-09-13T18:45:26.600409+0000","last_peered":"2024-09-13T18:45:26.600409+0000","last_clean":"2024-09-13T18:45:26.600409+0000","last_became_active":"2024-09-13T18:45:22.032022+0000","last_became_peered":"2024-09-13T18:45:22.032022+0000","last_unstale":"2024-09-13T18:45:26.600409+0000","last_undegraded":"2024-09-13T18:45:26.600409+0000","last_fullsized":"2024-09-13T18:45:26.600409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.046217+0000","last_change":"2024-09-13T18:45:21.661117+0000","last_active":"2024-09-13T18:45:26.046217+0000","last_peered":"2024-09-13T18:45:26.046217+0000","last_clean":"2024-09-13T18:45:26.046217+0000","last_became_active":"2024-09-13T18:45:21.660577+0000","last_became_peered":"2024-09-13T18:45:21.660577+0000","last_unstale":"2024-09-13T18:45:26.046217+0000","last_undegraded":"2024-09-13T18:45:26.046217+0000","last_fullsized":"2024-09-13T18:45:26.046217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605338+0000","last_change":"2024-09-13T18:45:26.056021+0000","last_active":"2024-09-13T18:45:26.605338+0000","last_peered":"2024-09-13T18:45:26.605338+0000","last_clean":"2024-09-13T18:45:26.605338+0000","last_became_active":"2024-09-13T18:45:26.053877+0000","last_became_peered":"2024-09-13T18:45:26.053877+0000","last_unstale":"2024-09-13T18:45:26.605338+0000","last_undegraded":"2024-09-13T18:45:26.605338+0000","last_fullsized":"2024-09-13T18:45:26.605338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:51.489422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.411006+0000","last_change":"2024-09-13T18:45:22.029936+0000","last_active":"2024-09-13T18:45:26.411006+0000","last_peered":"2024-09-13T18:45:26.411006+0000","last_clean":"2024-09-13T18:45:26.411006+0000","last_became_active":"2024-09-13T18:45:22.028714+0000","last_became_peered":"2024-09-13T18:45:22.028714+0000","last_unstale":"2024-09-13T18:45:26.411006+0000","last_undegraded":"2024-09-13T18:45:26.411006+0000","last_fullsized":"2024-09-13T18:45:26.411006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:35.746368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044364+0000","last_change":"2024-09-13T18:45:21.667926+0000","last_active":"2024-09-13T18:45:26.044364+0000","last_peered":"2024-09-13T18:45:26.044364+0000","last_clean":"2024-09-13T18:45:26.044364+0000","last_became_active":"2024-09-13T18:45:21.667320+0000","last_became_peered":"2024-09-13T18:45:21.667320+0000","last_unstale":"2024-09-13T18:45:26.044364+0000","last_undegraded":"2024-09-13T18:45:26.044364+0000","last_fullsized":"2024-09-13T18:45:26.044364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605364+0000","last_change":"2024-09-13T18:45:26.055615+0000","last_active":"2024-09-13T18:45:26.605364+0000","last_peered":"2024-09-13T18:45:26.605364+0000","last_clean":"2024-09-13T18:45:26.605364+0000","last_became_active":"2024-09-13T18:45:26.053681+0000","last_became_peered":"2024-09-13T18:45:26.053681+0000","last_unstale":"2024-09-13T18:45:26.605364+0000","last_undegraded":"2024-09-13T18:45:26.605364+0000","last_fullsized":"2024-09-13T18:45:26.605364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605300+0000","last_change":"2024-09-13T18:45:22.023623+0000","last_active":"2024-09-13T18:45:26.605300+0000","last_peered":"2024-09-13T18:45:26.605300+0000","last_clean":"2024-09-13T18:45:26.605300+0000","last_became_active":"2024-09-13T18:45:22.023357+0000","last_became_peered":"2024-09-13T18:45:22.023357+0000","last_unstale":"2024-09-13T18:45:26.605300+0000","last_undegraded":"2024-09-13T18:45:26.605300+0000","last_fullsized":"2024-09-13T18:45:26.605300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.039394+0000","last_change":"2024-09-13T18:45:21.668065+0000","last_active":"2024-09-13T18:45:26.039394+0000","last_peered":"2024-09-13T18:45:26.039394+0000","last_clean":"2024-09-13T18:45:26.039394+0000","last_became_active":"2024-09-13T18:45:21.667768+0000","last_became_peered":"2024-09-13T18:45:21.667768+0000","last_unstale":"2024-09-13T18:45:26.039394+0000","last_undegraded":"2024-09-13T18:45:26.039394+0000","last_fullsized":"2024-09-13T18:45:26.039394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605444+0000","last_change":"2024-09-13T18:45:26.057274+0000","last_active":"2024-09-13T18:45:26.605444+0000","last_peered":"2024-09-13T18:45:26.605444+0000","last_clean":"2024-09-13T18:45:26.605444+0000","last_became_active":"2024-09-13T18:45:26.056850+0000","last_became_peered":"2024-09-13T18:45:26.056850+0000","last_unstale":"2024-09-13T18:45:26.605444+0000","last_undegraded":"2024-09-13T18:45:26.605444+0000","last_fullsized":"2024-09-13T18:45:26.605444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.971516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599753+0000","last_change":"2024-09-13T18:45:22.020577+0000","last_active":"2024-09-13T18:45:26.599753+0000","last_peered":"2024-09-13T18:45:26.599753+0000","last_clean":"2024-09-13T18:45:26.599753+0000","last_became_active":"2024-09-13T18:45:22.020317+0000","last_became_peered":"2024-09-13T18:45:22.020317+0000","last_unstale":"2024-09-13T18:45:26.599753+0000","last_undegraded":"2024-09-13T18:45:26.599753+0000","last_fullsized":"2024-09-13T18:45:26.599753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.249771+0000","last_change":"2024-09-13T18:45:21.667753+0000","last_active":"2024-09-13T18:45:26.249771+0000","last_peered":"2024-09-13T18:45:26.249771+0000","last_clean":"2024-09-13T18:45:26.249771+0000","last_became_active":"2024-09-13T18:45:21.667483+0000","last_became_peered":"2024-09-13T18:45:21.667483+0000","last_unstale":"2024-09-13T18:45:26.249771+0000","last_undegraded":"2024-09-13T18:45:26.249771+0000","last_fullsized":"2024-09-13T18:45:26.249771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:22.171336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599881+0000","last_change":"2024-09-13T18:45:26.254703+0000","last_active":"2024-09-13T18:45:26.599881+0000","last_peered":"2024-09-13T18:45:26.599881+0000","last_clean":"2024-09-13T18:45:26.599881+0000","last_became_active":"2024-09-13T18:45:26.253533+0000","last_became_peered":"2024-09-13T18:45:26.253533+0000","last_unstale":"2024-09-13T18:45:26.599881+0000","last_undegraded":"2024-09-13T18:45:26.599881+0000","last_fullsized":"2024-09-13T18:45:26.599881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601018+0000","last_change":"2024-09-13T18:45:22.032365+0000","last_active":"2024-09-13T18:45:26.601018+0000","last_peered":"2024-09-13T18:45:26.601018+0000","last_clean":"2024-09-13T18:45:26.601018+0000","last_became_active":"2024-09-13T18:45:22.032109+0000","last_became_peered":"2024-09-13T18:45:22.032109+0000","last_unstale":"2024-09-13T18:45:26.601018+0000","last_undegraded":"2024-09-13T18:45:26.601018+0000","last_fullsized":"2024-09-13T18:45:26.601018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044305+0000","last_change":"2024-09-13T18:45:21.662636+0000","last_active":"2024-09-13T18:45:26.044305+0000","last_peered":"2024-09-13T18:45:26.044305+0000","last_clean":"2024-09-13T18:45:26.044305+0000","last_became_active":"2024-09-13T18:45:21.662344+0000","last_became_peered":"2024-09-13T18:45:21.662344+0000","last_unstale":"2024-09-13T18:45:26.044305+0000","last_undegraded":"2024-09-13T18:45:26.044305+0000","last_fullsized":"2024-09-13T18:45:26.044305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.249885+0000","last_change":"2024-09-13T18:45:19.778048+0000","last_active":"2024-09-13T18:45:26.249885+0000","last_peered":"2024-09-13T18:45:26.249885+0000","last_clean":"2024-09-13T18:45:26.249885+0000","last_became_active":"2024-09-13T18:45:19.777172+0000","last_became_peered":"2024-09-13T18:45:19.777172+0000","last_unstale":"2024-09-13T18:45:26.249885+0000","last_undegraded":"2024-09-13T18:45:26.249885+0000","last_fullsized":"2024-09-13T18:45:26.249885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_clean_scrub_stamp":"2024-09-13T18:45:17.981407+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:51.905955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410145+0000","last_change":"2024-09-13T18:45:26.253260+0000","last_active":"2024-09-13T18:45:26.410145+0000","last_peered":"2024-09-13T18:45:26.410145+0000","last_clean":"2024-09-13T18:45:26.410145+0000","last_became_active":"2024-09-13T18:45:26.252890+0000","last_became_peered":"2024-09-13T18:45:26.252890+0000","last_unstale":"2024-09-13T18:45:26.410145+0000","last_undegraded":"2024-09-13T18:45:26.410145+0000","last_fullsized":"2024-09-13T18:45:26.410145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599981+0000","last_change":"2024-09-13T18:45:22.036446+0000","last_active":"2024-09-13T18:45:26.599981+0000","last_peered":"2024-09-13T18:45:26.599981+0000","last_clean":"2024-09-13T18:45:26.599981+0000","last_became_active":"2024-09-13T18:45:22.036153+0000","last_became_peered":"2024-09-13T18:45:22.036153+0000","last_unstale":"2024-09-13T18:45:26.599981+0000","last_undegraded":"2024-09-13T18:45:26.599981+0000","last_fullsized":"2024-09-13T18:45:26.599981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.041776+0000","last_change":"2024-09-13T18:45:21.665847+0000","last_active":"2024-09-13T18:45:26.041776+0000","last_peered":"2024-09-13T18:45:26.041776+0000","last_clean":"2024-09-13T18:45:26.041776+0000","last_became_active":"2024-09-13T18:45:21.665582+0000","last_became_peered":"2024-09-13T18:45:21.665582+0000","last_unstale":"2024-09-13T18:45:26.041776+0000","last_undegraded":"2024-09-13T18:45:26.041776+0000","last_fullsized":"2024-09-13T18:45:26.041776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409441+0000","last_change":"2024-09-13T18:45:26.250391+0000","last_active":"2024-09-13T18:45:26.409441+0000","last_peered":"2024-09-13T18:45:26.409441+0000","last_clean":"2024-09-13T18:45:26.409441+0000","last_became_active":"2024-09-13T18:45:26.249986+0000","last_became_peered":"2024-09-13T18:45:26.249986+0000","last_unstale":"2024-09-13T18:45:26.409441+0000","last_undegraded":"2024-09-13T18:45:26.409441+0000","last_fullsized":"2024-09-13T18:45:26.409441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600372+0000","last_change":"2024-09-13T18:45:22.037142+0000","last_active":"2024-09-13T18:45:26.600372+0000","last_peered":"2024-09-13T18:45:26.600372+0000","last_clean":"2024-09-13T18:45:26.600372+0000","last_became_active":"2024-09-13T18:45:22.036523+0000","last_became_peered":"2024-09-13T18:45:22.036523+0000","last_unstale":"2024-09-13T18:45:26.600372+0000","last_undegraded":"2024-09-13T18:45:26.600372+0000","last_fullsized":"2024-09-13T18:45:26.600372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.045297+0000","last_change":"2024-09-13T18:45:21.662924+0000","last_active":"2024-09-13T18:45:26.045297+0000","last_peered":"2024-09-13T18:45:26.045297+0000","last_clean":"2024-09-13T18:45:26.045297+0000","last_became_active":"2024-09-13T18:45:21.662405+0000","last_became_peered":"2024-09-13T18:45:21.662405+0000","last_unstale":"2024-09-13T18:45:26.045297+0000","last_undegraded":"2024-09-13T18:45:26.045297+0000","last_fullsized":"2024-09-13T18:45:26.045297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599813+0000","last_change":"2024-09-13T18:45:26.055309+0000","last_active":"2024-09-13T18:45:26.599813+0000","last_peered":"2024-09-13T18:45:26.599813+0000","last_clean":"2024-09-13T18:45:26.599813+0000","last_became_active":"2024-09-13T18:45:26.054449+0000","last_became_peered":"2024-09-13T18:45:26.054449+0000","last_unstale":"2024-09-13T18:45:26.599813+0000","last_undegraded":"2024-09-13T18:45:26.599813+0000","last_fullsized":"2024-09-13T18:45:26.599813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600056+0000","last_change":"2024-09-13T18:45:22.034277+0000","last_active":"2024-09-13T18:45:26.600056+0000","last_peered":"2024-09-13T18:45:26.600056+0000","last_clean":"2024-09-13T18:45:26.600056+0000","last_became_active":"2024-09-13T18:45:22.033562+0000","last_became_peered":"2024-09-13T18:45:22.033562+0000","last_unstale":"2024-09-13T18:45:26.600056+0000","last_undegraded":"2024-09-13T18:45:26.600056+0000","last_fullsized":"2024-09-13T18:45:26.600056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:07.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.041599+0000","last_change":"2024-09-13T18:45:21.667622+0000","last_active":"2024-09-13T18:45:26.041599+0000","last_peered":"2024-09-13T18:45:26.041599+0000","last_clean":"2024-09-13T18:45:26.041599+0000","last_became_active":"2024-09-13T18:45:21.667340+0000","last_became_peered":"2024-09-13T18:45:21.667340+0000","last_unstale":"2024-09-13T18:45:26.041599+0000","last_undegraded":"2024-09-13T18:45:26.041599+0000","last_fullsized":"2024-09-13T18:45:26.041599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600221+0000","last_change":"2024-09-13T18:45:26.250450+0000","last_active":"2024-09-13T18:45:26.600221+0000","last_peered":"2024-09-13T18:45:26.600221+0000","last_clean":"2024-09-13T18:45:26.600221+0000","last_became_active":"2024-09-13T18:45:26.250020+0000","last_became_peered":"2024-09-13T18:45:26.250020+0000","last_unstale":"2024-09-13T18:45:26.600221+0000","last_undegraded":"2024-09-13T18:45:26.600221+0000","last_fullsized":"2024-09-13T18:45:26.600221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:46.567482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600026+0000","last_change":"2024-09-13T18:45:22.030584+0000","last_active":"2024-09-13T18:45:26.600026+0000","last_peered":"2024-09-13T18:45:26.600026+0000","last_clean":"2024-09-13T18:45:26.600026+0000","last_became_active":"2024-09-13T18:45:22.030275+0000","last_became_peered":"2024-09-13T18:45:22.030275+0000","last_unstale":"2024-09-13T18:45:26.600026+0000","last_undegraded":"2024-09-13T18:45:26.600026+0000","last_fullsized":"2024-09-13T18:45:26.600026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.038135+0000","last_change":"2024-09-13T18:45:21.662490+0000","last_active":"2024-09-13T18:45:26.038135+0000","last_peered":"2024-09-13T18:45:26.038135+0000","last_clean":"2024-09-13T18:45:26.038135+0000","last_became_active":"2024-09-13T18:45:21.662210+0000","last_became_peered":"2024-09-13T18:45:21.662210+0000","last_unstale":"2024-09-13T18:45:26.038135+0000","last_undegraded":"2024-09-13T18:45:26.038135+0000","last_fullsized":"2024-09-13T18:45:26.038135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410593+0000","last_change":"2024-09-13T18:45:26.053575+0000","last_active":"2024-09-13T18:45:26.410593+0000","last_peered":"2024-09-13T18:45:26.410593+0000","last_clean":"2024-09-13T18:45:26.410593+0000","last_became_active":"2024-09-13T18:45:26.053195+0000","last_became_peered":"2024-09-13T18:45:26.053195+0000","last_unstale":"2024-09-13T18:45:26.410593+0000","last_undegraded":"2024-09-13T18:45:26.410593+0000","last_fullsized":"2024-09-13T18:45:26.410593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:28.745002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599910+0000","last_change":"2024-09-13T18:45:22.031817+0000","last_active":"2024-09-13T18:45:26.599910+0000","last_peered":"2024-09-13T18:45:26.599910+0000","last_clean":"2024-09-13T18:45:26.599910+0000","last_became_active":"2024-09-13T18:45:22.031312+0000","last_became_peered":"2024-09-13T18:45:22.031312+0000","last_unstale":"2024-09-13T18:45:26.599910+0000","last_undegraded":"2024-09-13T18:45:26.599910+0000","last_fullsized":"2024-09-13T18:45:26.599910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.039206+0000","last_change":"2024-09-13T18:45:21.655353+0000","last_active":"2024-09-13T18:45:26.039206+0000","last_peered":"2024-09-13T18:45:26.039206+0000","last_clean":"2024-09-13T18:45:26.039206+0000","last_became_active":"2024-09-13T18:45:21.654844+0000","last_became_peered":"2024-09-13T18:45:21.654844+0000","last_unstale":"2024-09-13T18:45:26.039206+0000","last_undegraded":"2024-09-13T18:45:26.039206+0000","last_fullsized":"2024-09-13T18:45:26.039206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599871+0000","last_change":"2024-09-13T18:45:26.056440+0000","last_active":"2024-09-13T18:45:26.599871+0000","last_peered":"2024-09-13T18:45:26.599871+0000","last_clean":"2024-09-13T18:45:26.599871+0000","last_became_active":"2024-09-13T18:45:26.055955+0000","last_became_peered":"2024-09-13T18:45:26.055955+0000","last_unstale":"2024-09-13T18:45:26.599871+0000","last_undegraded":"2024-09-13T18:45:26.599871+0000","last_fullsized":"2024-09-13T18:45:26.599871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:38.309349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409660+0000","last_change":"2024-09-13T18:45:22.027821+0000","last_active":"2024-09-13T18:45:26.409660+0000","last_peered":"2024-09-13T18:45:26.409660+0000","last_clean":"2024-09-13T18:45:26.409660+0000","last_became_active":"2024-09-13T18:45:22.027172+0000","last_became_peered":"2024-09-13T18:45:22.027172+0000","last_unstale":"2024-09-13T18:45:26.409660+0000","last_undegraded":"2024-09-13T18:45:26.409660+0000","last_fullsized":"2024-09-13T18:45:26.409660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.035641+0000","last_change":"2024-09-13T18:45:21.664084+0000","last_active":"2024-09-13T18:45:26.035641+0000","last_peered":"2024-09-13T18:45:26.035641+0000","last_clean":"2024-09-13T18:45:26.035641+0000","last_became_active":"2024-09-13T18:45:21.663746+0000","last_became_peered":"2024-09-13T18:45:21.663746+0000","last_unstale":"2024-09-13T18:45:26.035641+0000","last_undegraded":"2024-09-13T18:45:26.035641+0000","last_fullsized":"2024-09-13T18:45:26.035641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601109+0000","last_change":"2024-09-13T18:45:26.253221+0000","last_active":"2024-09-13T18:45:26.601109+0000","last_peered":"2024-09-13T18:45:26.601109+0000","last_clean":"2024-09-13T18:45:26.601109+0000","last_became_active":"2024-09-13T18:45:26.252841+0000","last_became_peered":"2024-09-13T18:45:26.252841+0000","last_unstale":"2024-09-13T18:45:26.601109+0000","last_undegraded":"2024-09-13T18:45:26.601109+0000","last_fullsized":"2024-09-13T18:45:26.601109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:26.396713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599947+0000","last_change":"2024-09-13T18:45:22.033554+0000","last_active":"2024-09-13T18:45:26.599947+0000","last_peered":"2024-09-13T18:45:26.599947+0000","last_clean":"2024-09-13T18:45:26.599947+0000","last_became_active":"2024-09-13T18:45:22.032862+0000","last_became_peered":"2024-09-13T18:45:22.032862+0000","last_unstale":"2024-09-13T18:45:26.599947+0000","last_undegraded":"2024-09-13T18:45:26.599947+0000","last_fullsized":"2024-09-13T18:45:26.599947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044282+0000","last_change":"2024-09-13T18:45:21.668025+0000","last_active":"2024-09-13T18:45:26.044282+0000","last_peered":"2024-09-13T18:45:26.044282+0000","last_clean":"2024-09-13T18:45:26.044282+0000","last_became_active":"2024-09-13T18:45:21.667457+0000","last_became_peered":"2024-09-13T18:45:21.667457+0000","last_unstale":"2024-09-13T18:45:26.044282+0000","last_undegraded":"2024-09-13T18:45:26.044282+0000","last_fullsized":"2024-09-13T18:45:26.044282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601060+0000","last_change":"2024-09-13T18:45:26.250464+0000","last_active":"2024-09-13T18:45:26.601060+0000","last_peered":"2024-09-13T18:45:26.601060+0000","last_clean":"2024-09-13T18:45:26.601060+0000","last_became_active":"2024-09-13T18:45:26.250041+0000","last_became_peered":"2024-09-13T18:45:26.250041+0000","last_unstale":"2024-09-13T18:45:26.601060+0000","last_undegraded":"2024-09-13T18:45:26.601060+0000","last_fullsized":"2024-09-13T18:45:26.601060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:20.013806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599781+0000","last_change":"2024-09-13T18:45:22.024133+0000","last_active":"2024-09-13T18:45:26.599781+0000","last_peered":"2024-09-13T18:45:26.599781+0000","last_clean":"2024-09-13T18:45:26.599781+0000","last_became_active":"2024-09-13T18:45:22.023882+0000","last_became_peered":"2024-09-13T18:45:22.023882+0000","last_unstale":"2024-09-13T18:45:26.599781+0000","last_undegraded":"2024-09-13T18:45:26.599781+0000","last_fullsized":"2024-09-13T18:45:26.599781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.053020+0000","last_change":"2024-09-13T18:45:21.663297+0000","last_active":"2024-09-13T18:45:26.053020+0000","last_peered":"2024-09-13T18:45:26.053020+0000","last_clean":"2024-09-13T18:45:26.053020+0000","last_became_active":"2024-09-13T18:45:21.662980+0000","last_became_peered":"2024-09-13T18:45:21.662980+0000","last_unstale":"2024-09-13T18:45:26.053020+0000","last_undegraded":"2024-09-13T18:45:26.053020+0000","last_fullsized":"2024-09-13T18:45:26.053020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600385+0000","last_change":"2024-09-13T18:45:26.253184+0000","last_active":"2024-09-13T18:45:26.600385+0000","last_peered":"2024-09-13T18:45:26.600385+0000","last_clean":"2024-09-13T18:45:26.600385+0000","last_became_active":"2024-09-13T18:45:26.252786+0000","last_became_peered":"2024-09-13T18:45:26.252786+0000","last_unstale":"2024-09-13T18:45:26.600385+0000","last_undegraded":"2024-09-13T18:45:26.600385+0000","last_fullsized":"2024-09-13T18:45:26.600385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599971+0000","last_change":"2024-09-13T18:45:22.035052+0000","last_active":"2024-09-13T18:45:26.599971+0000","last_peered":"2024-09-13T18:45:26.599971+0000","last_clean":"2024-09-13T18:45:26.599971+0000","last_became_active":"2024-09-13T18:45:22.034765+0000","last_became_peered":"2024-09-13T18:45:22.034765+0000","last_unstale":"2024-09-13T18:45:26.599971+0000","last_undegraded":"2024-09-13T18:45:26.599971+0000","last_fullsized":"2024-09-13T18:45:26.599971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:28.674827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:30.681690+0000","last_change":"2024-09-13T18:45:21.668054+0000","last_active":"2024-09-13T18:45:30.681690+0000","last_peered":"2024-09-13T18:45:30.681690+0000","last_clean":"2024-09-13T18:45:30.681690+0000","last_became_active":"2024-09-13T18:45:21.667587+0000","last_became_peered":"2024-09-13T18:45:21.667587+0000","last_unstale":"2024-09-13T18:45:30.681690+0000","last_undegraded":"2024-09-13T18:45:30.681690+0000","last_fullsized":"2024-09-13T18:45:30.681690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605348+0000","last_change":"2024-09-13T18:45:26.052997+0000","last_active":"2024-09-13T18:45:26.605348+0000","last_peered":"2024-09-13T18:45:26.605348+0000","last_clean":"2024-09-13T18:45:26.605348+0000","last_became_active":"2024-09-13T18:45:26.052614+0000","last_became_peered":"2024-09-13T18:45:26.052614+0000","last_unstale":"2024-09-13T18:45:26.605348+0000","last_undegraded":"2024-09-13T18:45:26.605348+0000","last_fullsized":"2024-09-13T18:45:26.605348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410522+0000","last_change":"2024-09-13T18:45:22.020754+0000","last_active":"2024-09-13T18:45:26.410522+0000","last_peered":"2024-09-13T18:45:26.410522+0000","last_clean":"2024-09-13T18:45:26.410522+0000","last_became_active":"2024-09-13T18:45:22.020461+0000","last_became_peered":"2024-09-13T18:45:22.020461+0000","last_unstale":"2024-09-13T18:45:26.410522+0000","last_undegraded":"2024-09-13T18:45:26.410522+0000","last_fullsized":"2024-09-13T18:45:26.410522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.045194+0000","last_change":"2024-09-13T18:45:21.664387+0000","last_active":"2024-09-13T18:45:26.045194+0000","last_peered":"2024-09-13T18:45:26.045194+0000","last_clean":"2024-09-13T18:45:26.045194+0000","last_became_active":"2024-09-13T18:45:21.663941+0000","last_became_peered":"2024-09-13T18:45:21.663941+0000","last_unstale":"2024-09-13T18:45:26.045194+0000","last_undegraded":"2024-09-13T18:45:26.045194+0000","last_fullsized":"2024-09-13T18:45:26.045194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410895+0000","last_change":"2024-09-13T18:45:26.051227+0000","last_active":"2024-09-13T18:45:26.410895+0000","last_peered":"2024-09-13T18:45:26.410895+0000","last_clean":"2024-09-13T18:45:26.410895+0000","last_became_active":"2024-09-13T18:45:26.050757+0000","last_became_peered":"2024-09-13T18:45:26.050757+0000","last_unstale":"2024-09-13T18:45:26.410895+0000","last_undegraded":"2024-09-13T18:45:26.410895+0000","last_fullsized":"2024-09-13T18:45:26.410895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:59.045390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599915+0000","last_change":"2024-09-13T18:45:22.025223+0000","last_active":"2024-09-13T18:45:26.599915+0000","last_peered":"2024-09-13T18:45:26.599915+0000","last_clean":"2024-09-13T18:45:26.599915+0000","last_became_active":"2024-09-13T18:45:22.024972+0000","last_became_peered":"2024-09-13T18:45:22.024972+0000","last_unstale":"2024-09-13T18:45:26.599915+0000","last_undegraded":"2024-09-13T18:45:26.599915+0000","last_fullsized":"2024-09-13T18:45:26.599915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044352+0000","last_change":"2024-09-13T18:45:21.666814+0000","last_active":"2024-09-13T18:45:26.044352+0000","last_peered":"2024-09-13T18:45:26.044352+0000","last_clean":"2024-09-13T18:45:26.044352+0000","last_became_active":"2024-09-13T18:45:21.666516+0000","last_became_peered":"2024-09-13T18:45:21.666516+0000","last_unstale":"2024-09-13T18:45:26.044352+0000","last_undegraded":"2024-09-13T18:45:26.044352+0000","last_fullsized":"2024-09-13T18:45:26.044352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600944+0000","last_change":"2024-09-13T18:45:26.057746+0000","last_active":"2024-09-13T18:45:26.600944+0000","last_peered":"2024-09-13T18:45:26.600944+0000","last_clean":"2024-09-13T18:45:26.600944+0000","last_became_active":"2024-09-13T18:45:26.057285+0000","last_became_peered":"2024-09-13T18:45:26.057285+0000","last_unstale":"2024-09-13T18:45:26.600944+0000","last_undegraded":"2024-09-13T18:45:26.600944+0000","last_fullsized":"2024-09-13T18:45:26.600944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600419+0000","last_change":"2024-09-13T18:45:22.031653+0000","last_active":"2024-09-13T18:45:26.600419+0000","last_peered":"2024-09-13T18:45:26.600419+0000","last_clean":"2024-09-13T18:45:26.600419+0000","last_became_active":"2024-09-13T18:45:22.031341+0000","last_became_peered":"2024-09-13T18:45:22.031341+0000","last_unstale":"2024-09-13T18:45:26.600419+0000","last_undegraded":"2024-09-13T18:45:26.600419+0000","last_fullsized":"2024-09-13T18:45:26.600419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.037413+0000","last_change":"2024-09-13T18:45:21.664695+0000","last_active":"2024-09-13T18:45:26.037413+0000","last_peered":"2024-09-13T18:45:26.037413+0000","last_clean":"2024-09-13T18:45:26.037413+0000","last_became_active":"2024-09-13T18:45:21.664401+0000","last_became_peered":"2024-09-13T18:45:21.664401+0000","last_unstale":"2024-09-13T18:45:26.037413+0000","last_undegraded":"2024-09-13T18:45:26.037413+0000","last_fullsized":"2024-09-13T18:45:26.037413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600992+0000","last_change":"2024-09-13T18:45:26.254041+0000","last_active":"2024-09-13T18:45:26.600992+0000","last_peered":"2024-09-13T18:45:26.600992+0000","last_clean":"2024-09-13T18:45:26.600992+0000","last_became_active":"2024-09-13T18:45:26.253579+0000","last_became_peered":"2024-09-13T18:45:26.253579+0000","last_unstale":"2024-09-13T18:45:26.600992+0000","last_undegraded":"2024-09-13T18:45:26.600992+0000","last_fullsized":"2024-09-13T18:45:26.600992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:19.171737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599855+0000","last_change":"2024-09-13T18:45:26.253962+0000","last_active":"2024-09-13T18:45:26.599855+0000","last_peered":"2024-09-13T18:45:26.599855+0000","last_clean":"2024-09-13T18:45:26.599855+0000","last_became_active":"2024-09-13T18:45:26.252979+0000","last_became_peered":"2024-09-13T18:45:26.252979+0000","last_unstale":"2024-09-13T18:45:26.599855+0000","last_undegraded":"2024-09-13T18:45:26.599855+0000","last_fullsized":"2024-09-13T18:45:26.599855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605312+0000","last_change":"2024-09-13T18:45:22.030919+0000","last_active":"2024-09-13T18:45:26.605312+0000","last_peered":"2024-09-13T18:45:26.605312+0000","last_clean":"2024-09-13T18:45:26.605312+0000","last_became_active":"2024-09-13T18:45:22.030453+0000","last_became_peered":"2024-09-13T18:45:22.030453+0000","last_unstale":"2024-09-13T18:45:26.605312+0000","last_undegraded":"2024-09-13T18:45:26.605312+0000","last_fullsized":"2024-09-13T18:45:26.605312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.043671+0000","last_change":"2024-09-13T18:45:21.664824+0000","last_active":"2024-09-13T18:45:26.043671+0000","last_peered":"2024-09-13T18:45:26.043671+0000","last_clean":"2024-09-13T18:45:26.043671+0000","last_became_active":"2024-09-13T18:45:21.664571+0000","last_became_peered":"2024-09-13T18:45:21.664571+0000","last_unstale":"2024-09-13T18:45:26.043671+0000","last_undegraded":"2024-09-13T18:45:26.043671+0000","last_fullsized":"2024-09-13T18:45:26.043671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410703+0000","last_change":"2024-09-13T18:45:26.054920+0000","last_active":"2024-09-13T18:45:26.410703+0000","last_peered":"2024-09-13T18:45:26.410703+0000","last_clean":"2024-09-13T18:45:26.410703+0000","last_became_active":"2024-09-13T18:45:26.054510+0000","last_became_peered":"2024-09-13T18:45:26.054510+0000","last_unstale":"2024-09-13T18:45:26.410703+0000","last_undegraded":"2024-09-13T18:45:26.410703+0000","last_fullsized":"2024-09-13T18:45:26.410703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:32.061769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600953+0000","last_change":"2024-09-13T18:45:22.028321+0000","last_active":"2024-09-13T18:45:26.600953+0000","last_peered":"2024-09-13T18:45:26.600953+0000","last_clean":"2024-09-13T18:45:26.600953+0000","last_became_active":"2024-09-13T18:45:22.028062+0000","last_became_peered":"2024-09-13T18:45:22.028062+0000","last_unstale":"2024-09-13T18:45:26.600953+0000","last_undegraded":"2024-09-13T18:45:26.600953+0000","last_fullsized":"2024-09-13T18:45:26.600953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.036033+0000","last_change":"2024-09-13T18:45:21.672763+0000","last_active":"2024-09-13T18:45:26.036033+0000","last_peered":"2024-09-13T18:45:26.036033+0000","last_clean":"2024-09-13T18:45:26.036033+0000","last_became_active":"2024-09-13T18:45:21.672470+0000","last_became_peered":"2024-09-13T18:45:21.672470+0000","last_unstale":"2024-09-13T18:45:26.036033+0000","last_undegraded":"2024-09-13T18:45:26.036033+0000","last_fullsized":"2024-09-13T18:45:26.036033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.036402+0000","last_change":"2024-09-13T18:45:21.660195+0000","last_active":"2024-09-13T18:45:26.036402+0000","last_peered":"2024-09-13T18:45:26.036402+0000","last_clean":"2024-09-13T18:45:26.036402+0000","last_became_active":"2024-09-13T18:45:21.659912+0000","last_became_peered":"2024-09-13T18:45:21.659912+0000","last_unstale":"2024-09-13T18:45:26.036402+0000","last_undegraded":"2024-09-13T18:45:26.036402+0000","last_fullsized":"2024-09-13T18:45:26.036402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599830+0000","last_change":"2024-09-13T18:45:22.024571+0000","last_active":"2024-09-13T18:45:26.599830+0000","last_peered":"2024-09-13T18:45:26.599830+0000","last_clean":"2024-09-13T18:45:26.599830+0000","last_became_active":"2024-09-13T18:45:22.024305+0000","last_became_peered":"2024-09-13T18:45:22.024305+0000","last_unstale":"2024-09-13T18:45:26.599830+0000","last_undegraded":"2024-09-13T18:45:26.599830+0000","last_fullsized":"2024-09-13T18:45:26.599830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.408537+0000","last_change":"2024-09-13T18:45:26.056207+0000","last_active":"2024-09-13T18:45:26.408537+0000","last_peered":"2024-09-13T18:45:26.408537+0000","last_clean":"2024-09-13T18:45:26.408537+0000","last_became_active":"2024-09-13T18:45:26.055794+0000","last_became_peered":"2024-09-13T18:45:26.055794+0000","last_unstale":"2024-09-13T18:45:26.408537+0000","last_undegraded":"2024-09-13T18:45:26.408537+0000","last_fullsized":"2024-09-13T18:45:26.408537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:29.520825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.035461+0000","last_change":"2024-09-13T18:45:21.670376+0000","last_active":"2024-09-13T18:45:26.035461+0000","last_peered":"2024-09-13T18:45:26.035461+0000","last_clean":"2024-09-13T18:45:26.035461+0000","last_became_active":"2024-09-13T18:45:21.670083+0000","last_became_peered":"2024-09-13T18:45:21.670083+0000","last_unstale":"2024-09-13T18:45:26.035461+0000","last_undegraded":"2024-09-13T18:45:26.035461+0000","last_fullsized":"2024-09-13T18:45:26.035461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410560+0000","last_change":"2024-09-13T18:45:22.021774+0000","last_active":"2024-09-13T18:45:26.410560+0000","last_peered":"2024-09-13T18:45:26.410560+0000","last_clean":"2024-09-13T18:45:26.410560+0000","last_became_active":"2024-09-13T18:45:22.021496+0000","last_became_peered":"2024-09-13T18:45:22.021496+0000","last_unstale":"2024-09-13T18:45:26.410560+0000","last_undegraded":"2024-09-13T18:45:26.410560+0000","last_fullsized":"2024-09-13T18:45:26.410560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:44.234639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601081+0000","last_change":"2024-09-13T18:45:26.050478+0000","last_active":"2024-09-13T18:45:26.601081+0000","last_peered":"2024-09-13T18:45:26.601081+0000","last_clean":"2024-09-13T18:45:26.601081+0000","last_became_active":"2024-09-13T18:45:26.050095+0000","last_became_peered":"2024-09-13T18:45:26.050095+0000","last_unstale":"2024-09-13T18:45:26.601081+0000","last_undegraded":"2024-09-13T18:45:26.601081+0000","last_fullsized":"2024-09-13T18:45:26.601081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:28.276515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409518+0000","last_change":"2024-09-13T18:45:22.028025+0000","last_active":"2024-09-13T18:45:26.409518+0000","last_peered":"2024-09-13T18:45:26.409518+0000","last_clean":"2024-09-13T18:45:26.409518+0000","last_became_active":"2024-09-13T18:45:22.027528+0000","last_became_peered":"2024-09-13T18:45:22.027528+0000","last_unstale":"2024-09-13T18:45:26.409518+0000","last_undegraded":"2024-09-13T18:45:26.409518+0000","last_fullsized":"2024-09-13T18:45:26.409518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.408408+0000","last_change":"2024-09-13T18:45:22.024615+0000","last_active":"2024-09-13T18:45:26.408408+0000","last_peered":"2024-09-13T18:45:26.408408+0000","last_clean":"2024-09-13T18:45:26.408408+0000","last_became_active":"2024-09-13T18:45:22.024369+0000","last_became_peered":"2024-09-13T18:45:22.024369+0000","last_unstale":"2024-09-13T18:45:26.408408+0000","last_undegraded":"2024-09-13T18:45:26.408408+0000","last_fullsized":"2024-09-13T18:45:26.408408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600313+0000","last_change":"2024-09-13T18:45:22.035861+0000","last_active":"2024-09-13T18:45:26.600313+0000","last_peered":"2024-09-13T18:45:26.600313+0000","last_clean":"2024-09-13T18:45:26.600313+0000","last_became_active":"2024-09-13T18:45:22.034318+0000","last_became_peered":"2024-09-13T18:45:22.034318+0000","last_unstale":"2024-09-13T18:45:26.600313+0000","last_undegraded":"2024-09-13T18:45:26.600313+0000","last_fullsized":"2024-09-13T18:45:26.600313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599822+0000","last_change":"2024-09-13T18:45:22.033266+0000","last_active":"2024-09-13T18:45:26.599822+0000","last_peered":"2024-09-13T18:45:26.599822+0000","last_clean":"2024-09-13T18:45:26.599822+0000","last_became_active":"2024-09-13T18:45:22.032851+0000","last_became_peered":"2024-09-13T18:45:22.032851+0000","last_unstale":"2024-09-13T18:45:26.599822+0000","last_undegraded":"2024-09-13T18:45:26.599822+0000","last_fullsized":"2024-09-13T18:45:26.599822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601071+0000","last_change":"2024-09-13T18:45:22.033500+0000","last_active":"2024-09-13T18:45:26.601071+0000","last_peered":"2024-09-13T18:45:26.601071+0000","last_clean":"2024-09-13T18:45:26.601071+0000","last_became_active":"2024-09-13T18:45:22.033156+0000","last_became_peered":"2024-09-13T18:45:22.033156+0000","last_unstale":"2024-09-13T18:45:26.601071+0000","last_undegraded":"2024-09-13T18:45:26.601071+0000","last_fullsized":"2024-09-13T18:45:26.601071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605389+0000","last_change":"2024-09-13T18:45:22.029906+0000","last_active":"2024-09-13T18:45:26.605389+0000","last_peered":"2024-09-13T18:45:26.605389+0000","last_clean":"2024-09-13T18:45:26.605389+0000","last_became_active":"2024-09-13T18:45:22.029654+0000","last_became_peered":"2024-09-13T18:45:22.029654+0000","last_unstale":"2024-09-13T18:45:26.605389+0000","last_undegraded":"2024-09-13T18:45:26.605389+0000","last_fullsized":"2024-09-13T18:45:26.605389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410838+0000","last_change":"2024-09-13T18:45:22.028396+0000","last_active":"2024-09-13T18:45:26.410838+0000","last_peered":"2024-09-13T18:45:26.410838+0000","last_clean":"2024-09-13T18:45:26.410838+0000","last_became_active":"2024-09-13T18:45:22.028031+0000","last_became_peered":"2024-09-13T18:45:22.028031+0000","last_unstale":"2024-09-13T18:45:26.410838+0000","last_undegraded":"2024-09-13T18:45:26.410838+0000","last_fullsized":"2024-09-13T18:45:26.410838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601118+0000","last_change":"2024-09-13T18:45:22.032816+0000","last_active":"2024-09-13T18:45:26.601118+0000","last_peered":"2024-09-13T18:45:26.601118+0000","last_clean":"2024-09-13T18:45:26.601118+0000","last_became_active":"2024-09-13T18:45:22.032561+0000","last_became_peered":"2024-09-13T18:45:22.032561+0000","last_unstale":"2024-09-13T18:45:26.601118+0000","last_undegraded":"2024-09-13T18:45:26.601118+0000","last_fullsized":"2024-09-13T18:45:26.601118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600256+0000","last_change":"2024-09-13T18:45:22.036615+0000","last_active":"2024-09-13T18:45:26.600256+0000","last_peered":"2024-09-13T18:45:26.600256+0000","last_clean":"2024-09-13T18:45:26.600256+0000","last_became_active":"2024-09-13T18:45:22.036380+0000","last_became_peered":"2024-09-13T18:45:22.036380+0000","last_unstale":"2024-09-13T18:45:26.600256+0000","last_undegraded":"2024-09-13T18:45:26.600256+0000","last_fullsized":"2024-09-13T18:45:26.600256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601002+0000","last_change":"2024-09-13T18:45:22.035082+0000","last_active":"2024-09-13T18:45:26.601002+0000","last_peered":"2024-09-13T18:45:26.601002+0000","last_clean":"2024-09-13T18:45:26.601002+0000","last_became_active":"2024-09-13T18:45:22.034646+0000","last_became_peered":"2024-09-13T18:45:22.034646+0000","last_unstale":"2024-09-13T18:45:26.601002+0000","last_undegraded":"2024-09-13T18:45:26.601002+0000","last_fullsized":"2024-09-13T18:45:26.601002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600302+0000","last_change":"2024-09-13T18:45:22.029195+0000","last_active":"2024-09-13T18:45:26.600302+0000","last_peered":"2024-09-13T18:45:26.600302+0000","last_clean":"2024-09-13T18:45:26.600302+0000","last_became_active":"2024-09-13T18:45:22.028430+0000","last_became_peered":"2024-09-13T18:45:22.028430+0000","last_unstale":"2024-09-13T18:45:26.600302+0000","last_undegraded":"2024-09-13T18:45:26.600302+0000","last_fullsized":"2024-09-13T18:45:26.600302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599802+0000","last_change":"2024-09-13T18:45:22.019974+0000","last_active":"2024-09-13T18:45:26.599802+0000","last_peered":"2024-09-13T18:45:26.599802+0000","last_clean":"2024-09-13T18:45:26.599802+0000","last_became_active":"2024-09-13T18:45:22.019733+0000","last_became_peered":"2024-09-13T18:45:22.019733+0000","last_unstale":"2024-09-13T18:45:26.599802+0000","last_undegraded":"2024-09-13T18:45:26.599802+0000","last_fullsized":"2024-09-13T18:45:26.599802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410236+0000","last_change":"2024-09-13T18:45:22.016110+0000","last_active":"2024-09-13T18:45:26.410236+0000","last_peered":"2024-09-13T18:45:26.410236+0000","last_clean":"2024-09-13T18:45:26.410236+0000","last_became_active":"2024-09-13T18:45:22.015868+0000","last_became_peered":"2024-09-13T18:45:22.015868+0000","last_unstale":"2024-09-13T18:45:26.410236+0000","last_undegraded":"2024-09-13T18:45:26.410236+0000","last_fullsized":"2024-09-13T18:45:26.410236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599998+0000","last_change":"2024-09-13T18:45:22.034477+0000","last_active":"2024-09-13T18:45:26.599998+0000","last_peered":"2024-09-13T18:45:26.599998+0000","last_clean":"2024-09-13T18:45:26.599998+0000","last_became_active":"2024-09-13T18:45:22.034019+0000","last_became_peered":"2024-09-13T18:45:22.034019+0000","last_unstale":"2024-09-13T18:45:26.599998+0000","last_undegraded":"2024-09-13T18:45:26.599998+0000","last_fullsized":"2024-09-13T18:45:26.599998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.408670+0000","last_change":"2024-09-13T18:45:22.021787+0000","last_active":"2024-09-13T18:45:26.408670+0000","last_peered":"2024-09-13T18:45:26.408670+0000","last_clean":"2024-09-13T18:45:26.408670+0000","last_became_active":"2024-09-13T18:45:22.020415+0000","last_became_peered":"2024-09-13T18:45:22.020415+0000","last_unstale":"2024-09-13T18:45:26.408670+0000","last_undegraded":"2024-09-13T18:45:26.408670+0000","last_fullsized":"2024-09-13T18:45:26.408670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600442+0000","last_change":"2024-09-13T18:45:22.035941+0000","last_active":"2024-09-13T18:45:26.600442+0000","last_peered":"2024-09-13T18:45:26.600442+0000","last_clean":"2024-09-13T18:45:26.600442+0000","last_became_active":"2024-09-13T18:45:22.035491+0000","last_became_peered":"2024-09-13T18:45:22.035491+0000","last_unstale":"2024-09-13T18:45:26.600442+0000","last_undegraded":"2024-09-13T18:45:26.600442+0000","last_fullsized":"2024-09-13T18:45:26.600442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600236+0000","last_change":"2024-09-13T18:45:22.027416+0000","last_active":"2024-09-13T18:45:26.600236+0000","last_peered":"2024-09-13T18:45:26.600236+0000","last_clean":"2024-09-13T18:45:26.600236+0000","last_became_active":"2024-09-13T18:45:22.027170+0000","last_became_peered":"2024-09-13T18:45:22.027170+0000","last_unstale":"2024-09-13T18:45:26.600236+0000","last_undegraded":"2024-09-13T18:45:26.600236+0000","last_fullsized":"2024-09-13T18:45:26.600236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605321+0000","last_change":"2024-09-13T18:45:22.021298+0000","last_active":"2024-09-13T18:45:26.605321+0000","last_peered":"2024-09-13T18:45:26.605321+0000","last_clean":"2024-09-13T18:45:26.605321+0000","last_became_active":"2024-09-13T18:45:22.021042+0000","last_became_peered":"2024-09-13T18:45:22.021042+0000","last_unstale":"2024-09-13T18:45:26.605321+0000","last_undegraded":"2024-09-13T18:45:26.605321+0000","last_fullsized":"2024-09-13T18:45:26.605321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599771+0000","last_change":"2024-09-13T18:45:22.021628+0000","last_active":"2024-09-13T18:45:26.599771+0000","last_peered":"2024-09-13T18:45:26.599771+0000","last_clean":"2024-09-13T18:45:26.599771+0000","last_became_active":"2024-09-13T18:45:22.021366+0000","last_became_peered":"2024-09-13T18:45:22.021366+0000","last_unstale":"2024-09-13T18:45:26.599771+0000","last_undegraded":"2024-09-13T18:45:26.599771+0000","last_fullsized":"2024-09-13T18:45:26.599771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601029+0000","last_change":"2024-09-13T18:45:22.029051+0000","last_active":"2024-09-13T18:45:26.601029+0000","last_peered":"2024-09-13T18:45:26.601029+0000","last_clean":"2024-09-13T18:45:26.601029+0000","last_became_active":"2024-09-13T18:45:22.028594+0000","last_became_peered":"2024-09-13T18:45:22.028594+0000","last_unstale":"2024-09-13T18:45:26.601029+0000","last_undegraded":"2024-09-13T18:45:26.601029+0000","last_fullsized":"2024-09-13T18:45:26.601029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410403+0000","last_change":"2024-09-13T18:45:22.016996+0000","last_active":"2024-09-13T18:45:26.410403+0000","last_peered":"2024-09-13T18:45:26.410403+0000","last_clean":"2024-09-13T18:45:26.410403+0000","last_became_active":"2024-09-13T18:45:22.016731+0000","last_became_peered":"2024-09-13T18:45:22.016731+0000","last_unstale":"2024-09-13T18:45:26.410403+0000","last_undegraded":"2024-09-13T18:45:26.410403+0000","last_fullsized":"2024-09-13T18:45:26.410403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410341+0000","last_change":"2024-09-13T18:45:22.028649+0000","last_active":"2024-09-13T18:45:26.410341+0000","last_peered":"2024-09-13T18:45:26.410341+0000","last_clean":"2024-09-13T18:45:26.410341+0000","last_became_active":"2024-09-13T18:45:22.027899+0000","last_became_peered":"2024-09-13T18:45:22.027899+0000","last_unstale":"2024-09-13T18:45:26.410341+0000","last_undegraded":"2024-09-13T18:45:26.410341+0000","last_fullsized":"2024-09-13T18:45:26.410341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410750+0000","last_change":"2024-09-13T18:45:22.024291+0000","last_active":"2024-09-13T18:45:26.410750+0000","last_peered":"2024-09-13T18:45:26.410750+0000","last_clean":"2024-09-13T18:45:26.410750+0000","last_became_active":"2024-09-13T18:45:22.024014+0000","last_became_peered":"2024-09-13T18:45:22.024014+0000","last_unstale":"2024-09-13T18:45:26.410750+0000","last_undegraded":"2024-09-13T18:45:26.410750+0000","last_fullsized":"2024-09-13T18:45:26.410750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600045+0000","last_change":"2024-09-13T18:45:22.036551+0000","last_active":"2024-09-13T18:45:26.600045+0000","last_peered":"2024-09-13T18:45:26.600045+0000","last_clean":"2024-09-13T18:45:26.600045+0000","last_became_active":"2024-09-13T18:45:22.036269+0000","last_became_peered":"2024-09-13T18:45:22.036269+0000","last_unstale":"2024-09-13T18:45:26.600045+0000","last_undegraded":"2024-09-13T18:45:26.600045+0000","last_fullsized":"2024-09-13T18:45:26.600045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600933+0000","last_change":"2024-09-13T18:45:22.032392+0000","last_active":"2024-09-13T18:45:26.600933+0000","last_peered":"2024-09-13T18:45:26.600933+0000","last_clean":"2024-09-13T18:45:26.600933+0000","last_became_active":"2024-09-13T18:45:22.027605+0000","last_became_peered":"2024-09-13T18:45:22.027605+0000","last_unstale":"2024-09-13T18:45:26.600933+0000","last_undegraded":"2024-09-13T18:45:26.600933+0000","last_fullsized":"2024-09-13T18:45:26.600933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599883+0000","last_change":"2024-09-13T18:45:22.029307+0000","last_active":"2024-09-13T18:45:26.599883+0000","last_peered":"2024-09-13T18:45:26.599883+0000","last_clean":"2024-09-13T18:45:26.599883+0000","last_became_active":"2024-09-13T18:45:22.029018+0000","last_became_peered":"2024-09-13T18:45:22.029018+0000","last_unstale":"2024-09-13T18:45:26.599883+0000","last_undegraded":"2024-09-13T18:45:26.599883+0000","last_fullsized":"2024-09-13T18:45:26.599883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600287+0000","last_change":"2024-09-13T18:45:22.029061+0000","last_active":"2024-09-13T18:45:26.600287+0000","last_peered":"2024-09-13T18:45:26.600287+0000","last_clean":"2024-09-13T18:45:26.600287+0000","last_became_active":"2024-09-13T18:45:22.028758+0000","last_became_peered":"2024-09-13T18:45:22.028758+0000","last_unstale":"2024-09-13T18:45:26.600287+0000","last_undegraded":"2024-09-13T18:45:26.600287+0000","last_fullsized":"2024-09-13T18:45:26.600287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599926+0000","last_change":"2024-09-13T18:45:22.029690+0000","last_active":"2024-09-13T18:45:26.599926+0000","last_peered":"2024-09-13T18:45:26.599926+0000","last_clean":"2024-09-13T18:45:26.599926+0000","last_became_active":"2024-09-13T18:45:22.029403+0000","last_became_peered":"2024-09-13T18:45:22.029403+0000","last_unstale":"2024-09-13T18:45:26.599926+0000","last_undegraded":"2024-09-13T18:45:26.599926+0000","last_fullsized":"2024-09-13T18:45:26.599926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600349+0000","last_change":"2024-09-13T18:45:22.038483+0000","last_active":"2024-09-13T18:45:26.600349+0000","last_peered":"2024-09-13T18:45:26.600349+0000","last_clean":"2024-09-13T18:45:26.600349+0000","last_became_active":"2024-09-13T18:45:22.036877+0000","last_became_peered":"2024-09-13T18:45:22.036877+0000","last_unstale":"2024-09-13T18:45:26.600349+0000","last_undegraded":"2024-09-13T18:45:26.600349+0000","last_fullsized":"2024-09-13T18:45:26.600349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599845+0000","last_change":"2024-09-13T18:45:22.022846+0000","last_active":"2024-09-13T18:45:26.599845+0000","last_peered":"2024-09-13T18:45:26.599845+0000","last_clean":"2024-09-13T18:45:26.599845+0000","last_became_active":"2024-09-13T18:45:22.022618+0000","last_became_peered":"2024-09-13T18:45:22.022618+0000","last_unstale":"2024-09-13T18:45:26.599845+0000","last_undegraded":"2024-09-13T18:45:26.599845+0000","last_fullsized":"2024-09-13T18:45:26.599845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605420+0000","last_change":"2024-09-13T18:45:22.028545+0000","last_active":"2024-09-13T18:45:26.605420+0000","last_peered":"2024-09-13T18:45:26.605420+0000","last_clean":"2024-09-13T18:45:26.605420+0000","last_became_active":"2024-09-13T18:45:22.028291+0000","last_became_peered":"2024-09-13T18:45:22.028291+0000","last_unstale":"2024-09-13T18:45:26.605420+0000","last_undegraded":"2024-09-13T18:45:26.605420+0000","last_fullsized":"2024-09-13T18:45:26.605420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600036+0000","last_change":"2024-09-13T18:45:22.034460+0000","last_active":"2024-09-13T18:45:26.600036+0000","last_peered":"2024-09-13T18:45:26.600036+0000","last_clean":"2024-09-13T18:45:26.600036+0000","last_became_active":"2024-09-13T18:45:22.033974+0000","last_became_peered":"2024-09-13T18:45:22.033974+0000","last_unstale":"2024-09-13T18:45:26.600036+0000","last_undegraded":"2024-09-13T18:45:26.600036+0000","last_fullsized":"2024-09-13T18:45:26.600036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":690344,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":266240,"data_stored":103189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":253952,"data_stored":99394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":262144,"data_stored":99554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":331776,"data_stored":690400,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:45:50.010 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:50.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.147+0000 7f1f82f65640 1 Processor -- start 2024-09-13T18:45:50.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.147+0000 7f1f82f65640 1 -- start start 2024-09-13T18:45:50.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f82f65640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1f7c0b9e20 0x7f1f7c13f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f82f65640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c0b45a0 con 0x7f1f7c0b5930 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f82f65640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c06c1d0 con 0x7f1f7c0b4fa0 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f82f65640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7c06b500 con 0x7f1f7c0b9e20 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f81502640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1f7c0b5930 0x7f1f7c150360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54438/0 (socket says 172.21.15.29:54438) 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f81502640 1 -- 172.21.15.29:0/1880849060 learned_addr learned my addr 172.21.15.29:0/1880849060 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f80d01640 1 --2- 172.21.15.29:0/1880849060 >> v2:172.21.15.96:3300/0 conn(0x7f1f7c0b9e20 0x7f1f7c13f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622266090 0 0) 0x7f1f7c0b45a0 con 0x7f1f7c0b5930 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f6c003520 con 0x7f1f7c0b5930 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1293468151 0 0) 0x7f1f6c003520 con 0x7f1f7c0b5930 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 >> v2:172.21.15.96:3300/0 conn(0x7f1f7c0b9e20 msgr2=0x7f1f7c13f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 --2- 172.21.15.29:0/1880849060 >> v2:172.21.15.96:3300/0 conn(0x7f1f7c0b9e20 0x7f1f7c13f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 >> v1:172.21.15.96:6789/0 conn(0x7f1f7c0b4fa0 legacy=0x7f1f7c06c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c0ba200 con 0x7f1f7c0b5930 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f1f740019f0 con 0x7f1f7c0b5930 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 >> v1:172.21.15.29:6789/0 conn(0x7f1f7c0b5930 legacy=0x7f1f7c150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 --2- 172.21.15.29:0/1880849060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1f6c003970 0x7f1f6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 --2- 172.21.15.29:0/1880849060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c0047c0 0x7f1f6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 --2- 172.21.15.29:0/1880849060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c005180 0x7f1f6c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c00c0f0 con 0x7f1f6c0047c0 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c00c260 con 0x7f1f6c005180 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c00c420 con 0x7f1f6c003970 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.148+0000 7f1f7bfff640 1 --2- 172.21.15.29:0/1880849060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c0047c0 0x7f1f6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.149+0000 7f1f81502640 1 --2- 172.21.15.29:0/1880849060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c005180 0x7f1f6c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.149+0000 7f1f80d01640 1 --2- 172.21.15.29:0/1880849060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1f6c003970 0x7f1f6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.149+0000 7f1f7bfff640 1 -- 172.21.15.29:0/1880849060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1f6c003970 msgr2=0x7f1f6c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:50.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.149+0000 7f1f7bfff640 1 --2- 172.21.15.29:0/1880849060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1f6c003970 0x7f1f6c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.149+0000 7f1f7bfff640 1 -- 172.21.15.29:0/1880849060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c005180 msgr2=0x7f1f6c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.149+0000 7f1f7bfff640 1 --2- 172.21.15.29:0/1880849060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c005180 0x7f1f6c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.149+0000 7f1f81502640 1 -- 172.21.15.29:0/1880849060 reap_dead start 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.149+0000 7f1f7bfff640 1 -- 172.21.15.29:0/1880849060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c003520 con 0x7f1f6c0047c0 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.150+0000 7f1f7bfff640 1 --2- 172.21.15.29:0/1880849060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c0047c0 0x7f1f6c004c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f68001750 tx=0x7f1f6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9597e43ef7b69c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.150+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f680052d0 con 0x7f1f6c0047c0 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.150+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f68005430 con 0x7f1f6c0047c0 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.150+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/1880849060 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6802abc0 con 0x7f1f6c0047c0 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.150+0000 7f1f82f65640 1 -- 172.21.15.29:0/1880849060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c0047c0 msgr2=0x7f1f6c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.150+0000 7f1f82f65640 1 --2- 172.21.15.29:0/1880849060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c0047c0 0x7f1f6c004c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f68001750 tx=0x7f1f6c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.150+0000 7f1f82f65640 1 -- 172.21.15.29:0/1880849060 shutdown_connections 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.150+0000 7f1f82f65640 1 --2- 172.21.15.29:0/1880849060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c0047c0 0x7f1f6c004c40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.150+0000 7f1f82f65640 1 -- 172.21.15.29:0/1880849060 >> 172.21.15.29:0/1880849060 conn(0x7f1f7c06a5c0 msgr2=0x7f1f7c0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:50.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.150+0000 7f1f82f65640 1 -- 172.21.15.29:0/1880849060 shutdown_connections 2024-09-13T18:45:50.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.150+0000 7f1f82f65640 1 -- 172.21.15.29:0/1880849060 wait complete. 2024-09-13T18:45:50.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.151+0000 7f1f82f65640 1 Processor -- start 2024-09-13T18:45:50.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.151+0000 7f1f82f65640 1 -- start start 2024-09-13T18:45:50.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.152+0000 7f1f82f65640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c0047c0 0x7f1f7c0ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.152+0000 7f1f82f65640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1f7c0b2f60 0x7f1f7c1de090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.152+0000 7f1f82f65640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c1de5d0 0x7f1f7c13c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.152+0000 7f1f82f65640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c0b33e0 con 0x7f1f7c1de5d0 2024-09-13T18:45:50.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.152+0000 7f1f82f65640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c1dea50 con 0x7f1f6c0047c0 2024-09-13T18:45:50.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.152+0000 7f1f82f65640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c0ad340 con 0x7f1f7c0b2f60 2024-09-13T18:45:50.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.152+0000 7f1f81502640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c1de5d0 0x7f1f7c13c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.152+0000 7f1f81502640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c1de5d0 0x7f1f7c13c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41192/0 (socket says 172.21.15.29:41192) 2024-09-13T18:45:50.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.152+0000 7f1f81502640 1 -- 172.21.15.29:0/1486677445 learned_addr learned my addr 172.21.15.29:0/1486677445 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:50.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.152+0000 7f1f7bfff640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1f7c0b2f60 0x7f1f7c1de090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.152+0000 7f1f80d01640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c0047c0 0x7f1f7c0ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.153+0000 7f1f81502640 1 -- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1f7c0b2f60 msgr2=0x7f1f7c1de090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.153+0000 7f1f81502640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1f7c0b2f60 0x7f1f7c1de090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.153+0000 7f1f81502640 1 -- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c0047c0 msgr2=0x7f1f7c0ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.153+0000 7f1f81502640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c0047c0 0x7f1f7c0ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.153+0000 7f1f81502640 1 -- 172.21.15.29:0/1486677445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c0ad620 con 0x7f1f7c1de5d0 2024-09-13T18:45:50.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.153+0000 7f1f81502640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c1de5d0 0x7f1f7c13c730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c06bdb0 tx=0x7f1f74007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:50.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.153+0000 7f1f797fa640 1 -- 172.21.15.29:0/1486677445 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400aab0 con 0x7f1f7c1de5d0 2024-09-13T18:45:50.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.153+0000 7f1f797fa640 1 -- 172.21.15.29:0/1486677445 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7400ac10 con 0x7f1f7c1de5d0 2024-09-13T18:45:50.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.153+0000 7f1f82f65640 1 -- 172.21.15.29:0/1486677445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c0abea0 con 0x7f1f7c1de5d0 2024-09-13T18:45:50.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.153+0000 7f1f797fa640 1 -- 172.21.15.29:0/1486677445 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f740133f0 con 0x7f1f7c1de5d0 2024-09-13T18:45:50.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.153+0000 7f1f82f65640 1 -- 172.21.15.29:0/1486677445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7c0ac460 con 0x7f1f7c1de5d0 2024-09-13T18:45:50.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.154+0000 7f1f82f65640 1 -- 172.21.15.29:0/1486677445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7c1dddb0 con 0x7f1f7c1de5d0 2024-09-13T18:45:50.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.154+0000 7f1f797fa640 1 -- 172.21.15.29:0/1486677445 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1f74013550 con 0x7f1f7c1de5d0 2024-09-13T18:45:50.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.155+0000 7f1f797fa640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1f6006ac00 0x7f1f6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.155+0000 7f1f797fa640 1 -- 172.21.15.29:0/1486677445 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f74089ab0 con 0x7f1f7c1de5d0 2024-09-13T18:45:50.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.155+0000 7f1f80d01640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1f6006ac00 0x7f1f6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.156+0000 7f1f80d01640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1f6006ac00 0x7f1f6006d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009b40 tx=0x7f1f70009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:50.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.159+0000 7f1f797fa640 1 -- 172.21.15.29:0/1486677445 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1f7c1dddb0 con 0x7f1f7c1de5d0 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.327+0000 7f1f82f65640 1 -- 172.21.15.29:0/1486677445 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f7c13f9b0 con 0x7f1f6006ac00 2024-09-13T18:45:50.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.336+0000 7f1f797fa640 1 -- 172.21.15.29:0/1486677445 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345344 (secure 0 0 0) 0x7f1f70019070 con 0x7f1f6006ac00 2024-09-13T18:45:50.342 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:50.344 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-13T18:45:50.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.339+0000 7f1f82f65640 1 -- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1f6006ac00 msgr2=0x7f1f6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.339+0000 7f1f82f65640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1f6006ac00 0x7f1f6006d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009b40 tx=0x7f1f70009190 comp rx=0 tx=0).stop 2024-09-13T18:45:50.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.339+0000 7f1f82f65640 1 -- 172.21.15.29:0/1486677445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c1de5d0 msgr2=0x7f1f7c13c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.339+0000 7f1f82f65640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c1de5d0 0x7f1f7c13c730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c06bdb0 tx=0x7f1f74007af0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.339+0000 7f1f82f65640 1 -- 172.21.15.29:0/1486677445 shutdown_connections 2024-09-13T18:45:50.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.339+0000 7f1f82f65640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f1f6006ac00 0x7f1f6006d0c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.339+0000 7f1f82f65640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c1de5d0 0x7f1f7c13c730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.339+0000 7f1f82f65640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1f7c0b2f60 0x7f1f7c1de090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.339+0000 7f1f82f65640 1 --2- 172.21.15.29:0/1486677445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f6c0047c0 0x7f1f7c0ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.339+0000 7f1f82f65640 1 -- 172.21.15.29:0/1486677445 >> 172.21.15.29:0/1486677445 conn(0x7f1f7c06a5c0 msgr2=0x7f1f7c145a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:50.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.339+0000 7f1f82f65640 1 -- 172.21.15.29:0/1486677445 shutdown_connections 2024-09-13T18:45:50.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.340+0000 7f1f82f65640 1 -- 172.21.15.29:0/1486677445 wait complete. 2024-09-13T18:45:50.353 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-13T18:45:49.593973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234748,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739972,"statfs":{"total":773094113280,"available":772853731328,"internally_reserved":0,"allocated":2228224,"data_stored":1985074,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003403"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.052330+0000","last_change":"2024-09-13T18:45:21.668274+0000","last_active":"2024-09-13T18:45:26.052330+0000","last_peered":"2024-09-13T18:45:26.052330+0000","last_clean":"2024-09-13T18:45:26.052330+0000","last_became_active":"2024-09-13T18:45:21.667985+0000","last_became_peered":"2024-09-13T18:45:21.667985+0000","last_unstale":"2024-09-13T18:45:26.052330+0000","last_undegraded":"2024-09-13T18:45:26.052330+0000","last_fullsized":"2024-09-13T18:45:26.052330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:45.703424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601092+0000","last_change":"2024-09-13T18:45:22.034389+0000","last_active":"2024-09-13T18:45:26.601092+0000","last_peered":"2024-09-13T18:45:26.601092+0000","last_clean":"2024-09-13T18:45:26.601092+0000","last_became_active":"2024-09-13T18:45:22.034125+0000","last_became_peered":"2024-09-13T18:45:22.034125+0000","last_unstale":"2024-09-13T18:45:26.601092+0000","last_undegraded":"2024-09-13T18:45:26.601092+0000","last_fullsized":"2024-09-13T18:45:26.601092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600983+0000","last_change":"2024-09-13T18:45:26.253118+0000","last_active":"2024-09-13T18:45:26.600983+0000","last_peered":"2024-09-13T18:45:26.600983+0000","last_clean":"2024-09-13T18:45:26.600983+0000","last_became_active":"2024-09-13T18:45:26.252747+0000","last_became_peered":"2024-09-13T18:45:26.252747+0000","last_unstale":"2024-09-13T18:45:26.600983+0000","last_undegraded":"2024-09-13T18:45:26.600983+0000","last_fullsized":"2024-09-13T18:45:26.600983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:11.065130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.036006+0000","last_change":"2024-09-13T18:45:21.666664+0000","last_active":"2024-09-13T18:45:26.036006+0000","last_peered":"2024-09-13T18:45:26.036006+0000","last_clean":"2024-09-13T18:45:26.036006+0000","last_became_active":"2024-09-13T18:45:21.666398+0000","last_became_peered":"2024-09-13T18:45:21.666398+0000","last_unstale":"2024-09-13T18:45:26.036006+0000","last_undegraded":"2024-09-13T18:45:26.036006+0000","last_fullsized":"2024-09-13T18:45:26.036006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:06.210838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599906+0000","last_change":"2024-09-13T18:45:22.024774+0000","last_active":"2024-09-13T18:45:26.599906+0000","last_peered":"2024-09-13T18:45:26.599906+0000","last_clean":"2024-09-13T18:45:26.599906+0000","last_became_active":"2024-09-13T18:45:22.024424+0000","last_became_peered":"2024-09-13T18:45:22.024424+0000","last_unstale":"2024-09-13T18:45:26.599906+0000","last_undegraded":"2024-09-13T18:45:26.599906+0000","last_fullsized":"2024-09-13T18:45:26.599906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409608+0000","last_change":"2024-09-13T18:45:26.050411+0000","last_active":"2024-09-13T18:45:26.409608+0000","last_peered":"2024-09-13T18:45:26.409608+0000","last_clean":"2024-09-13T18:45:26.409608+0000","last_became_active":"2024-09-13T18:45:26.049414+0000","last_became_peered":"2024-09-13T18:45:26.049414+0000","last_unstale":"2024-09-13T18:45:26.409608+0000","last_undegraded":"2024-09-13T18:45:26.409608+0000","last_fullsized":"2024-09-13T18:45:26.409608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.251372+0000","last_change":"2024-09-13T18:45:21.667928+0000","last_active":"2024-09-13T18:45:26.251372+0000","last_peered":"2024-09-13T18:45:26.251372+0000","last_clean":"2024-09-13T18:45:26.251372+0000","last_became_active":"2024-09-13T18:45:21.667602+0000","last_became_peered":"2024-09-13T18:45:21.667602+0000","last_unstale":"2024-09-13T18:45:26.251372+0000","last_undegraded":"2024-09-13T18:45:26.251372+0000","last_fullsized":"2024-09-13T18:45:26.251372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:53.936326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600361+0000","last_change":"2024-09-13T18:45:22.036952+0000","last_active":"2024-09-13T18:45:26.600361+0000","last_peered":"2024-09-13T18:45:26.600361+0000","last_clean":"2024-09-13T18:45:26.600361+0000","last_became_active":"2024-09-13T18:45:22.035790+0000","last_became_peered":"2024-09-13T18:45:22.035790+0000","last_unstale":"2024-09-13T18:45:26.600361+0000","last_undegraded":"2024-09-13T18:45:26.600361+0000","last_fullsized":"2024-09-13T18:45:26.600361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410405+0000","last_change":"2024-09-13T18:45:26.052333+0000","last_active":"2024-09-13T18:45:26.410405+0000","last_peered":"2024-09-13T18:45:26.410405+0000","last_clean":"2024-09-13T18:45:26.410405+0000","last_became_active":"2024-09-13T18:45:26.051873+0000","last_became_peered":"2024-09-13T18:45:26.051873+0000","last_unstale":"2024-09-13T18:45:26.410405+0000","last_undegraded":"2024-09-13T18:45:26.410405+0000","last_fullsized":"2024-09-13T18:45:26.410405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:03.925946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.250039+0000","last_change":"2024-09-13T18:45:21.669914+0000","last_active":"2024-09-13T18:45:26.250039+0000","last_peered":"2024-09-13T18:45:26.250039+0000","last_clean":"2024-09-13T18:45:26.250039+0000","last_became_active":"2024-09-13T18:45:21.669622+0000","last_became_peered":"2024-09-13T18:45:21.669622+0000","last_unstale":"2024-09-13T18:45:26.250039+0000","last_undegraded":"2024-09-13T18:45:26.250039+0000","last_fullsized":"2024-09-13T18:45:26.250039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.765670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600397+0000","last_change":"2024-09-13T18:45:22.035675+0000","last_active":"2024-09-13T18:45:26.600397+0000","last_peered":"2024-09-13T18:45:26.600397+0000","last_clean":"2024-09-13T18:45:26.600397+0000","last_became_active":"2024-09-13T18:45:22.034431+0000","last_became_peered":"2024-09-13T18:45:22.034431+0000","last_unstale":"2024-09-13T18:45:26.600397+0000","last_undegraded":"2024-09-13T18:45:26.600397+0000","last_fullsized":"2024-09-13T18:45:26.600397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410278+0000","last_change":"2024-09-13T18:45:26.052892+0000","last_active":"2024-09-13T18:45:26.410278+0000","last_peered":"2024-09-13T18:45:26.410278+0000","last_clean":"2024-09-13T18:45:26.410278+0000","last_became_active":"2024-09-13T18:45:26.052441+0000","last_became_peered":"2024-09-13T18:45:26.052441+0000","last_unstale":"2024-09-13T18:45:26.410278+0000","last_undegraded":"2024-09-13T18:45:26.410278+0000","last_fullsized":"2024-09-13T18:45:26.410278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:26.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409959+0000","last_change":"2024-09-13T18:45:22.017741+0000","last_active":"2024-09-13T18:45:26.409959+0000","last_peered":"2024-09-13T18:45:26.409959+0000","last_clean":"2024-09-13T18:45:26.409959+0000","last_became_active":"2024-09-13T18:45:22.015758+0000","last_became_peered":"2024-09-13T18:45:22.015758+0000","last_unstale":"2024-09-13T18:45:26.409959+0000","last_undegraded":"2024-09-13T18:45:26.409959+0000","last_fullsized":"2024-09-13T18:45:26.409959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.250273+0000","last_change":"2024-09-13T18:45:21.672627+0000","last_active":"2024-09-13T18:45:26.250273+0000","last_peered":"2024-09-13T18:45:26.250273+0000","last_clean":"2024-09-13T18:45:26.250273+0000","last_became_active":"2024-09-13T18:45:21.672388+0000","last_became_peered":"2024-09-13T18:45:21.672388+0000","last_unstale":"2024-09-13T18:45:26.250273+0000","last_undegraded":"2024-09-13T18:45:26.250273+0000","last_fullsized":"2024-09-13T18:45:26.250273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410013+0000","last_change":"2024-09-13T18:45:26.052609+0000","last_active":"2024-09-13T18:45:26.410013+0000","last_peered":"2024-09-13T18:45:26.410013+0000","last_clean":"2024-09-13T18:45:26.410013+0000","last_became_active":"2024-09-13T18:45:26.052245+0000","last_became_peered":"2024-09-13T18:45:26.052245+0000","last_unstale":"2024-09-13T18:45:26.410013+0000","last_undegraded":"2024-09-13T18:45:26.410013+0000","last_fullsized":"2024-09-13T18:45:26.410013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:50.583636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601039+0000","last_change":"2024-09-13T18:45:22.028858+0000","last_active":"2024-09-13T18:45:26.601039+0000","last_peered":"2024-09-13T18:45:26.601039+0000","last_clean":"2024-09-13T18:45:26.601039+0000","last_became_active":"2024-09-13T18:45:22.028336+0000","last_became_peered":"2024-09-13T18:45:22.028336+0000","last_unstale":"2024-09-13T18:45:26.601039+0000","last_undegraded":"2024-09-13T18:45:26.601039+0000","last_fullsized":"2024-09-13T18:45:26.601039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.046785+0000","last_change":"2024-09-13T18:45:21.667983+0000","last_active":"2024-09-13T18:45:26.046785+0000","last_peered":"2024-09-13T18:45:26.046785+0000","last_clean":"2024-09-13T18:45:26.046785+0000","last_became_active":"2024-09-13T18:45:21.667625+0000","last_became_peered":"2024-09-13T18:45:21.667625+0000","last_unstale":"2024-09-13T18:45:26.046785+0000","last_undegraded":"2024-09-13T18:45:26.046785+0000","last_fullsized":"2024-09-13T18:45:26.046785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409827+0000","last_change":"2024-09-13T18:45:26.050576+0000","last_active":"2024-09-13T18:45:26.409827+0000","last_peered":"2024-09-13T18:45:26.409827+0000","last_clean":"2024-09-13T18:45:26.409827+0000","last_became_active":"2024-09-13T18:45:26.049129+0000","last_became_peered":"2024-09-13T18:45:26.049129+0000","last_unstale":"2024-09-13T18:45:26.409827+0000","last_undegraded":"2024-09-13T18:45:26.409827+0000","last_fullsized":"2024-09-13T18:45:26.409827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600972+0000","last_change":"2024-09-13T18:45:22.025900+0000","last_active":"2024-09-13T18:45:26.600972+0000","last_peered":"2024-09-13T18:45:26.600972+0000","last_clean":"2024-09-13T18:45:26.600972+0000","last_became_active":"2024-09-13T18:45:22.025624+0000","last_became_peered":"2024-09-13T18:45:22.025624+0000","last_unstale":"2024-09-13T18:45:26.600972+0000","last_undegraded":"2024-09-13T18:45:26.600972+0000","last_fullsized":"2024-09-13T18:45:26.600972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.045814+0000","last_change":"2024-09-13T18:45:21.668525+0000","last_active":"2024-09-13T18:45:26.045814+0000","last_peered":"2024-09-13T18:45:26.045814+0000","last_clean":"2024-09-13T18:45:26.045814+0000","last_became_active":"2024-09-13T18:45:21.668242+0000","last_became_peered":"2024-09-13T18:45:21.668242+0000","last_unstale":"2024-09-13T18:45:26.045814+0000","last_undegraded":"2024-09-13T18:45:26.045814+0000","last_fullsized":"2024-09-13T18:45:26.045814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605435+0000","last_change":"2024-09-13T18:45:26.255263+0000","last_active":"2024-09-13T18:45:26.605435+0000","last_peered":"2024-09-13T18:45:26.605435+0000","last_clean":"2024-09-13T18:45:26.605435+0000","last_became_active":"2024-09-13T18:45:26.254886+0000","last_became_peered":"2024-09-13T18:45:26.254886+0000","last_unstale":"2024-09-13T18:45:26.605435+0000","last_undegraded":"2024-09-13T18:45:26.605435+0000","last_fullsized":"2024-09-13T18:45:26.605435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410916+0000","last_change":"2024-09-13T18:45:22.029624+0000","last_active":"2024-09-13T18:45:26.410916+0000","last_peered":"2024-09-13T18:45:26.410916+0000","last_clean":"2024-09-13T18:45:26.410916+0000","last_became_active":"2024-09-13T18:45:22.027835+0000","last_became_peered":"2024-09-13T18:45:22.027835+0000","last_unstale":"2024-09-13T18:45:26.410916+0000","last_undegraded":"2024-09-13T18:45:26.410916+0000","last_fullsized":"2024-09-13T18:45:26.410916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:16.317986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.249681+0000","last_change":"2024-09-13T18:45:21.669073+0000","last_active":"2024-09-13T18:45:26.249681+0000","last_peered":"2024-09-13T18:45:26.249681+0000","last_clean":"2024-09-13T18:45:26.249681+0000","last_became_active":"2024-09-13T18:45:21.668765+0000","last_became_peered":"2024-09-13T18:45:21.668765+0000","last_unstale":"2024-09-13T18:45:26.249681+0000","last_undegraded":"2024-09-13T18:45:26.249681+0000","last_fullsized":"2024-09-13T18:45:26.249681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409880+0000","last_change":"2024-09-13T18:45:26.050623+0000","last_active":"2024-09-13T18:45:26.409880+0000","last_peered":"2024-09-13T18:45:26.409880+0000","last_clean":"2024-09-13T18:45:26.409880+0000","last_became_active":"2024-09-13T18:45:26.049408+0000","last_became_peered":"2024-09-13T18:45:26.049408+0000","last_unstale":"2024-09-13T18:45:26.409880+0000","last_undegraded":"2024-09-13T18:45:26.409880+0000","last_fullsized":"2024-09-13T18:45:26.409880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:14.574386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599890+0000","last_change":"2024-09-13T18:45:22.022220+0000","last_active":"2024-09-13T18:45:26.599890+0000","last_peered":"2024-09-13T18:45:26.599890+0000","last_clean":"2024-09-13T18:45:26.599890+0000","last_became_active":"2024-09-13T18:45:22.021976+0000","last_became_peered":"2024-09-13T18:45:22.021976+0000","last_unstale":"2024-09-13T18:45:26.599890+0000","last_undegraded":"2024-09-13T18:45:26.599890+0000","last_fullsized":"2024-09-13T18:45:26.599890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.037252+0000","last_change":"2024-09-13T18:45:21.667931+0000","last_active":"2024-09-13T18:45:26.037252+0000","last_peered":"2024-09-13T18:45:26.037252+0000","last_clean":"2024-09-13T18:45:26.037252+0000","last_became_active":"2024-09-13T18:45:21.667680+0000","last_became_peered":"2024-09-13T18:45:21.667680+0000","last_unstale":"2024-09-13T18:45:26.037252+0000","last_undegraded":"2024-09-13T18:45:26.037252+0000","last_fullsized":"2024-09-13T18:45:26.037252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410658+0000","last_change":"2024-09-13T18:45:26.255088+0000","last_active":"2024-09-13T18:45:26.410658+0000","last_peered":"2024-09-13T18:45:26.410658+0000","last_clean":"2024-09-13T18:45:26.410658+0000","last_became_active":"2024-09-13T18:45:26.254662+0000","last_became_peered":"2024-09-13T18:45:26.254662+0000","last_unstale":"2024-09-13T18:45:26.410658+0000","last_undegraded":"2024-09-13T18:45:26.410658+0000","last_fullsized":"2024-09-13T18:45:26.410658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601131+0000","last_change":"2024-09-13T18:45:22.026678+0000","last_active":"2024-09-13T18:45:26.601131+0000","last_peered":"2024-09-13T18:45:26.601131+0000","last_clean":"2024-09-13T18:45:26.601131+0000","last_became_active":"2024-09-13T18:45:22.026419+0000","last_became_peered":"2024-09-13T18:45:22.026419+0000","last_unstale":"2024-09-13T18:45:26.601131+0000","last_undegraded":"2024-09-13T18:45:26.601131+0000","last_fullsized":"2024-09-13T18:45:26.601131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.043788+0000","last_change":"2024-09-13T18:45:21.664622+0000","last_active":"2024-09-13T18:45:26.043788+0000","last_peered":"2024-09-13T18:45:26.043788+0000","last_clean":"2024-09-13T18:45:26.043788+0000","last_became_active":"2024-09-13T18:45:21.664066+0000","last_became_peered":"2024-09-13T18:45:21.664066+0000","last_unstale":"2024-09-13T18:45:26.043788+0000","last_undegraded":"2024-09-13T18:45:26.043788+0000","last_fullsized":"2024-09-13T18:45:26.043788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600919+0000","last_change":"2024-09-13T18:45:26.253888+0000","last_active":"2024-09-13T18:45:26.600919+0000","last_peered":"2024-09-13T18:45:26.600919+0000","last_clean":"2024-09-13T18:45:26.600919+0000","last_became_active":"2024-09-13T18:45:26.253488+0000","last_became_peered":"2024-09-13T18:45:26.253488+0000","last_unstale":"2024-09-13T18:45:26.600919+0000","last_undegraded":"2024-09-13T18:45:26.600919+0000","last_fullsized":"2024-09-13T18:45:26.600919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:44.826493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605373+0000","last_change":"2024-09-13T18:45:22.022940+0000","last_active":"2024-09-13T18:45:26.605373+0000","last_peered":"2024-09-13T18:45:26.605373+0000","last_clean":"2024-09-13T18:45:26.605373+0000","last_became_active":"2024-09-13T18:45:22.022628+0000","last_became_peered":"2024-09-13T18:45:22.022628+0000","last_unstale":"2024-09-13T18:45:26.605373+0000","last_undegraded":"2024-09-13T18:45:26.605373+0000","last_fullsized":"2024-09-13T18:45:26.605373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.251762+0000","last_change":"2024-09-13T18:45:21.668903+0000","last_active":"2024-09-13T18:45:26.251762+0000","last_peered":"2024-09-13T18:45:26.251762+0000","last_clean":"2024-09-13T18:45:26.251762+0000","last_became_active":"2024-09-13T18:45:21.668645+0000","last_became_peered":"2024-09-13T18:45:21.668645+0000","last_unstale":"2024-09-13T18:45:26.251762+0000","last_undegraded":"2024-09-13T18:45:26.251762+0000","last_fullsized":"2024-09-13T18:45:26.251762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599791+0000","last_change":"2024-09-13T18:45:26.250454+0000","last_active":"2024-09-13T18:45:26.599791+0000","last_peered":"2024-09-13T18:45:26.599791+0000","last_clean":"2024-09-13T18:45:26.599791+0000","last_became_active":"2024-09-13T18:45:26.250034+0000","last_became_peered":"2024-09-13T18:45:26.250034+0000","last_unstale":"2024-09-13T18:45:26.599791+0000","last_undegraded":"2024-09-13T18:45:26.599791+0000","last_fullsized":"2024-09-13T18:45:26.599791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.971516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600409+0000","last_change":"2024-09-13T18:45:22.032362+0000","last_active":"2024-09-13T18:45:26.600409+0000","last_peered":"2024-09-13T18:45:26.600409+0000","last_clean":"2024-09-13T18:45:26.600409+0000","last_became_active":"2024-09-13T18:45:22.032022+0000","last_became_peered":"2024-09-13T18:45:22.032022+0000","last_unstale":"2024-09-13T18:45:26.600409+0000","last_undegraded":"2024-09-13T18:45:26.600409+0000","last_fullsized":"2024-09-13T18:45:26.600409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.046217+0000","last_change":"2024-09-13T18:45:21.661117+0000","last_active":"2024-09-13T18:45:26.046217+0000","last_peered":"2024-09-13T18:45:26.046217+0000","last_clean":"2024-09-13T18:45:26.046217+0000","last_became_active":"2024-09-13T18:45:21.660577+0000","last_became_peered":"2024-09-13T18:45:21.660577+0000","last_unstale":"2024-09-13T18:45:26.046217+0000","last_undegraded":"2024-09-13T18:45:26.046217+0000","last_fullsized":"2024-09-13T18:45:26.046217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605338+0000","last_change":"2024-09-13T18:45:26.056021+0000","last_active":"2024-09-13T18:45:26.605338+0000","last_peered":"2024-09-13T18:45:26.605338+0000","last_clean":"2024-09-13T18:45:26.605338+0000","last_became_active":"2024-09-13T18:45:26.053877+0000","last_became_peered":"2024-09-13T18:45:26.053877+0000","last_unstale":"2024-09-13T18:45:26.605338+0000","last_undegraded":"2024-09-13T18:45:26.605338+0000","last_fullsized":"2024-09-13T18:45:26.605338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:51.489422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.411006+0000","last_change":"2024-09-13T18:45:22.029936+0000","last_active":"2024-09-13T18:45:26.411006+0000","last_peered":"2024-09-13T18:45:26.411006+0000","last_clean":"2024-09-13T18:45:26.411006+0000","last_became_active":"2024-09-13T18:45:22.028714+0000","last_became_peered":"2024-09-13T18:45:22.028714+0000","last_unstale":"2024-09-13T18:45:26.411006+0000","last_undegraded":"2024-09-13T18:45:26.411006+0000","last_fullsized":"2024-09-13T18:45:26.411006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:35.746368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044364+0000","last_change":"2024-09-13T18:45:21.667926+0000","last_active":"2024-09-13T18:45:26.044364+0000","last_peered":"2024-09-13T18:45:26.044364+0000","last_clean":"2024-09-13T18:45:26.044364+0000","last_became_active":"2024-09-13T18:45:21.667320+0000","last_became_peered":"2024-09-13T18:45:21.667320+0000","last_unstale":"2024-09-13T18:45:26.044364+0000","last_undegraded":"2024-09-13T18:45:26.044364+0000","last_fullsized":"2024-09-13T18:45:26.044364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605364+0000","last_change":"2024-09-13T18:45:26.055615+0000","last_active":"2024-09-13T18:45:26.605364+0000","last_peered":"2024-09-13T18:45:26.605364+0000","last_clean":"2024-09-13T18:45:26.605364+0000","last_became_active":"2024-09-13T18:45:26.053681+0000","last_became_peered":"2024-09-13T18:45:26.053681+0000","last_unstale":"2024-09-13T18:45:26.605364+0000","last_undegraded":"2024-09-13T18:45:26.605364+0000","last_fullsized":"2024-09-13T18:45:26.605364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605300+0000","last_change":"2024-09-13T18:45:22.023623+0000","last_active":"2024-09-13T18:45:26.605300+0000","last_peered":"2024-09-13T18:45:26.605300+0000","last_clean":"2024-09-13T18:45:26.605300+0000","last_became_active":"2024-09-13T18:45:22.023357+0000","last_became_peered":"2024-09-13T18:45:22.023357+0000","last_unstale":"2024-09-13T18:45:26.605300+0000","last_undegraded":"2024-09-13T18:45:26.605300+0000","last_fullsized":"2024-09-13T18:45:26.605300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.039394+0000","last_change":"2024-09-13T18:45:21.668065+0000","last_active":"2024-09-13T18:45:26.039394+0000","last_peered":"2024-09-13T18:45:26.039394+0000","last_clean":"2024-09-13T18:45:26.039394+0000","last_became_active":"2024-09-13T18:45:21.667768+0000","last_became_peered":"2024-09-13T18:45:21.667768+0000","last_unstale":"2024-09-13T18:45:26.039394+0000","last_undegraded":"2024-09-13T18:45:26.039394+0000","last_fullsized":"2024-09-13T18:45:26.039394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605444+0000","last_change":"2024-09-13T18:45:26.057274+0000","last_active":"2024-09-13T18:45:26.605444+0000","last_peered":"2024-09-13T18:45:26.605444+0000","last_clean":"2024-09-13T18:45:26.605444+0000","last_became_active":"2024-09-13T18:45:26.056850+0000","last_became_peered":"2024-09-13T18:45:26.056850+0000","last_unstale":"2024-09-13T18:45:26.605444+0000","last_undegraded":"2024-09-13T18:45:26.605444+0000","last_fullsized":"2024-09-13T18:45:26.605444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.971516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599753+0000","last_change":"2024-09-13T18:45:22.020577+0000","last_active":"2024-09-13T18:45:26.599753+0000","last_peered":"2024-09-13T18:45:26.599753+0000","last_clean":"2024-09-13T18:45:26.599753+0000","last_became_active":"2024-09-13T18:45:22.020317+0000","last_became_peered":"2024-09-13T18:45:22.020317+0000","last_unstale":"2024-09-13T18:45:26.599753+0000","last_undegraded":"2024-09-13T18:45:26.599753+0000","last_fullsized":"2024-09-13T18:45:26.599753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.249771+0000","last_change":"2024-09-13T18:45:21.667753+0000","last_active":"2024-09-13T18:45:26.249771+0000","last_peered":"2024-09-13T18:45:26.249771+0000","last_clean":"2024-09-13T18:45:26.249771+0000","last_became_active":"2024-09-13T18:45:21.667483+0000","last_became_peered":"2024-09-13T18:45:21.667483+0000","last_unstale":"2024-09-13T18:45:26.249771+0000","last_undegraded":"2024-09-13T18:45:26.249771+0000","last_fullsized":"2024-09-13T18:45:26.249771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:22.171336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599881+0000","last_change":"2024-09-13T18:45:26.254703+0000","last_active":"2024-09-13T18:45:26.599881+0000","last_peered":"2024-09-13T18:45:26.599881+0000","last_clean":"2024-09-13T18:45:26.599881+0000","last_became_active":"2024-09-13T18:45:26.253533+0000","last_became_peered":"2024-09-13T18:45:26.253533+0000","last_unstale":"2024-09-13T18:45:26.599881+0000","last_undegraded":"2024-09-13T18:45:26.599881+0000","last_fullsized":"2024-09-13T18:45:26.599881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601018+0000","last_change":"2024-09-13T18:45:22.032365+0000","last_active":"2024-09-13T18:45:26.601018+0000","last_peered":"2024-09-13T18:45:26.601018+0000","last_clean":"2024-09-13T18:45:26.601018+0000","last_became_active":"2024-09-13T18:45:22.032109+0000","last_became_peered":"2024-09-13T18:45:22.032109+0000","last_unstale":"2024-09-13T18:45:26.601018+0000","last_undegraded":"2024-09-13T18:45:26.601018+0000","last_fullsized":"2024-09-13T18:45:26.601018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044305+0000","last_change":"2024-09-13T18:45:21.662636+0000","last_active":"2024-09-13T18:45:26.044305+0000","last_peered":"2024-09-13T18:45:26.044305+0000","last_clean":"2024-09-13T18:45:26.044305+0000","last_became_active":"2024-09-13T18:45:21.662344+0000","last_became_peered":"2024-09-13T18:45:21.662344+0000","last_unstale":"2024-09-13T18:45:26.044305+0000","last_undegraded":"2024-09-13T18:45:26.044305+0000","last_fullsized":"2024-09-13T18:45:26.044305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.249885+0000","last_change":"2024-09-13T18:45:19.778048+0000","last_active":"2024-09-13T18:45:26.249885+0000","last_peered":"2024-09-13T18:45:26.249885+0000","last_clean":"2024-09-13T18:45:26.249885+0000","last_became_active":"2024-09-13T18:45:19.777172+0000","last_became_peered":"2024-09-13T18:45:19.777172+0000","last_unstale":"2024-09-13T18:45:26.249885+0000","last_undegraded":"2024-09-13T18:45:26.249885+0000","last_fullsized":"2024-09-13T18:45:26.249885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_clean_scrub_stamp":"2024-09-13T18:45:17.981407+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:51.905955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410145+0000","last_change":"2024-09-13T18:45:26.253260+0000","last_active":"2024-09-13T18:45:26.410145+0000","last_peered":"2024-09-13T18:45:26.410145+0000","last_clean":"2024-09-13T18:45:26.410145+0000","last_became_active":"2024-09-13T18:45:26.252890+0000","last_became_peered":"2024-09-13T18:45:26.252890+0000","last_unstale":"2024-09-13T18:45:26.410145+0000","last_undegraded":"2024-09-13T18:45:26.410145+0000","last_fullsized":"2024-09-13T18:45:26.410145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599981+0000","last_change":"2024-09-13T18:45:22.036446+0000","last_active":"2024-09-13T18:45:26.599981+0000","last_peered":"2024-09-13T18:45:26.599981+0000","last_clean":"2024-09-13T18:45:26.599981+0000","last_became_active":"2024-09-13T18:45:22.036153+0000","last_became_peered":"2024-09-13T18:45:22.036153+0000","last_unstale":"2024-09-13T18:45:26.599981+0000","last_undegraded":"2024-09-13T18:45:26.599981+0000","last_fullsized":"2024-09-13T18:45:26.599981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.041776+0000","last_change":"2024-09-13T18:45:21.665847+0000","last_active":"2024-09-13T18:45:26.041776+0000","last_peered":"2024-09-13T18:45:26.041776+0000","last_clean":"2024-09-13T18:45:26.041776+0000","last_became_active":"2024-09-13T18:45:21.665582+0000","last_became_peered":"2024-09-13T18:45:21.665582+0000","last_unstale":"2024-09-13T18:45:26.041776+0000","last_undegraded":"2024-09-13T18:45:26.041776+0000","last_fullsized":"2024-09-13T18:45:26.041776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409441+0000","last_change":"2024-09-13T18:45:26.250391+0000","last_active":"2024-09-13T18:45:26.409441+0000","last_peered":"2024-09-13T18:45:26.409441+0000","last_clean":"2024-09-13T18:45:26.409441+0000","last_became_active":"2024-09-13T18:45:26.249986+0000","last_became_peered":"2024-09-13T18:45:26.249986+0000","last_unstale":"2024-09-13T18:45:26.409441+0000","last_undegraded":"2024-09-13T18:45:26.409441+0000","last_fullsized":"2024-09-13T18:45:26.409441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600372+0000","last_change":"2024-09-13T18:45:22.037142+0000","last_active":"2024-09-13T18:45:26.600372+0000","last_peered":"2024-09-13T18:45:26.600372+0000","last_clean":"2024-09-13T18:45:26.600372+0000","last_became_active":"2024-09-13T18:45:22.036523+0000","last_became_peered":"2024-09-13T18:45:22.036523+0000","last_unstale":"2024-09-13T18:45:26.600372+0000","last_undegraded":"2024-09-13T18:45:26.600372+0000","last_fullsized":"2024-09-13T18:45:26.600372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.045297+0000","last_change":"2024-09-13T18:45:21.662924+0000","last_active":"2024-09-13T18:45:26.045297+0000","last_peered":"2024-09-13T18:45:26.045297+0000","last_clean":"2024-09-13T18:45:26.045297+0000","last_became_active":"2024-09-13T18:45:21.662405+0000","last_became_peered":"2024-09-13T18:45:21.662405+0000","last_unstale":"2024-09-13T18:45:26.045297+0000","last_undegraded":"2024-09-13T18:45:26.045297+0000","last_fullsized":"2024-09-13T18:45:26.045297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599813+0000","last_change":"2024-09-13T18:45:26.055309+0000","last_active":"2024-09-13T18:45:26.599813+0000","last_peered":"2024-09-13T18:45:26.599813+0000","last_clean":"2024-09-13T18:45:26.599813+0000","last_became_active":"2024-09-13T18:45:26.054449+0000","last_became_peered":"2024-09-13T18:45:26.054449+0000","last_unstale":"2024-09-13T18:45:26.599813+0000","last_undegraded":"2024-09-13T18:45:26.599813+0000","last_fullsized":"2024-09-13T18:45:26.599813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600056+0000","last_change":"2024-09-13T18:45:22.034277+0000","last_active":"2024-09-13T18:45:26.600056+0000","last_peered":"2024-09-13T18:45:26.600056+0000","last_clean":"2024-09-13T18:45:26.600056+0000","last_became_active":"2024-09-13T18:45:22.033562+0000","last_became_peered":"2024-09-13T18:45:22.033562+0000","last_unstale":"2024-09-13T18:45:26.600056+0000","last_undegraded":"2024-09-13T18:45:26.600056+0000","last_fullsized":"2024-09-13T18:45:26.600056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:07.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.041599+0000","last_change":"2024-09-13T18:45:21.667622+0000","last_active":"2024-09-13T18:45:26.041599+0000","last_peered":"2024-09-13T18:45:26.041599+0000","last_clean":"2024-09-13T18:45:26.041599+0000","last_became_active":"2024-09-13T18:45:21.667340+0000","last_became_peered":"2024-09-13T18:45:21.667340+0000","last_unstale":"2024-09-13T18:45:26.041599+0000","last_undegraded":"2024-09-13T18:45:26.041599+0000","last_fullsized":"2024-09-13T18:45:26.041599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600221+0000","last_change":"2024-09-13T18:45:26.250450+0000","last_active":"2024-09-13T18:45:26.600221+0000","last_peered":"2024-09-13T18:45:26.600221+0000","last_clean":"2024-09-13T18:45:26.600221+0000","last_became_active":"2024-09-13T18:45:26.250020+0000","last_became_peered":"2024-09-13T18:45:26.250020+0000","last_unstale":"2024-09-13T18:45:26.600221+0000","last_undegraded":"2024-09-13T18:45:26.600221+0000","last_fullsized":"2024-09-13T18:45:26.600221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:46.567482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600026+0000","last_change":"2024-09-13T18:45:22.030584+0000","last_active":"2024-09-13T18:45:26.600026+0000","last_peered":"2024-09-13T18:45:26.600026+0000","last_clean":"2024-09-13T18:45:26.600026+0000","last_became_active":"2024-09-13T18:45:22.030275+0000","last_became_peered":"2024-09-13T18:45:22.030275+0000","last_unstale":"2024-09-13T18:45:26.600026+0000","last_undegraded":"2024-09-13T18:45:26.600026+0000","last_fullsized":"2024-09-13T18:45:26.600026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.038135+0000","last_change":"2024-09-13T18:45:21.662490+0000","last_active":"2024-09-13T18:45:26.038135+0000","last_peered":"2024-09-13T18:45:26.038135+0000","last_clean":"2024-09-13T18:45:26.038135+0000","last_became_active":"2024-09-13T18:45:21.662210+0000","last_became_peered":"2024-09-13T18:45:21.662210+0000","last_unstale":"2024-09-13T18:45:26.038135+0000","last_undegraded":"2024-09-13T18:45:26.038135+0000","last_fullsized":"2024-09-13T18:45:26.038135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410593+0000","last_change":"2024-09-13T18:45:26.053575+0000","last_active":"2024-09-13T18:45:26.410593+0000","last_peered":"2024-09-13T18:45:26.410593+0000","last_clean":"2024-09-13T18:45:26.410593+0000","last_became_active":"2024-09-13T18:45:26.053195+0000","last_became_peered":"2024-09-13T18:45:26.053195+0000","last_unstale":"2024-09-13T18:45:26.410593+0000","last_undegraded":"2024-09-13T18:45:26.410593+0000","last_fullsized":"2024-09-13T18:45:26.410593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:28.745002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599910+0000","last_change":"2024-09-13T18:45:22.031817+0000","last_active":"2024-09-13T18:45:26.599910+0000","last_peered":"2024-09-13T18:45:26.599910+0000","last_clean":"2024-09-13T18:45:26.599910+0000","last_became_active":"2024-09-13T18:45:22.031312+0000","last_became_peered":"2024-09-13T18:45:22.031312+0000","last_unstale":"2024-09-13T18:45:26.599910+0000","last_undegraded":"2024-09-13T18:45:26.599910+0000","last_fullsized":"2024-09-13T18:45:26.599910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.039206+0000","last_change":"2024-09-13T18:45:21.655353+0000","last_active":"2024-09-13T18:45:26.039206+0000","last_peered":"2024-09-13T18:45:26.039206+0000","last_clean":"2024-09-13T18:45:26.039206+0000","last_became_active":"2024-09-13T18:45:21.654844+0000","last_became_peered":"2024-09-13T18:45:21.654844+0000","last_unstale":"2024-09-13T18:45:26.039206+0000","last_undegraded":"2024-09-13T18:45:26.039206+0000","last_fullsized":"2024-09-13T18:45:26.039206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599871+0000","last_change":"2024-09-13T18:45:26.056440+0000","last_active":"2024-09-13T18:45:26.599871+0000","last_peered":"2024-09-13T18:45:26.599871+0000","last_clean":"2024-09-13T18:45:26.599871+0000","last_became_active":"2024-09-13T18:45:26.055955+0000","last_became_peered":"2024-09-13T18:45:26.055955+0000","last_unstale":"2024-09-13T18:45:26.599871+0000","last_undegraded":"2024-09-13T18:45:26.599871+0000","last_fullsized":"2024-09-13T18:45:26.599871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:38.309349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409660+0000","last_change":"2024-09-13T18:45:22.027821+0000","last_active":"2024-09-13T18:45:26.409660+0000","last_peered":"2024-09-13T18:45:26.409660+0000","last_clean":"2024-09-13T18:45:26.409660+0000","last_became_active":"2024-09-13T18:45:22.027172+0000","last_became_peered":"2024-09-13T18:45:22.027172+0000","last_unstale":"2024-09-13T18:45:26.409660+0000","last_undegraded":"2024-09-13T18:45:26.409660+0000","last_fullsized":"2024-09-13T18:45:26.409660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.035641+0000","last_change":"2024-09-13T18:45:21.664084+0000","last_active":"2024-09-13T18:45:26.035641+0000","last_peered":"2024-09-13T18:45:26.035641+0000","last_clean":"2024-09-13T18:45:26.035641+0000","last_became_active":"2024-09-13T18:45:21.663746+0000","last_became_peered":"2024-09-13T18:45:21.663746+0000","last_unstale":"2024-09-13T18:45:26.035641+0000","last_undegraded":"2024-09-13T18:45:26.035641+0000","last_fullsized":"2024-09-13T18:45:26.035641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601109+0000","last_change":"2024-09-13T18:45:26.253221+0000","last_active":"2024-09-13T18:45:26.601109+0000","last_peered":"2024-09-13T18:45:26.601109+0000","last_clean":"2024-09-13T18:45:26.601109+0000","last_became_active":"2024-09-13T18:45:26.252841+0000","last_became_peered":"2024-09-13T18:45:26.252841+0000","last_unstale":"2024-09-13T18:45:26.601109+0000","last_undegraded":"2024-09-13T18:45:26.601109+0000","last_fullsized":"2024-09-13T18:45:26.601109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:26.396713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599947+0000","last_change":"2024-09-13T18:45:22.033554+0000","last_active":"2024-09-13T18:45:26.599947+0000","last_peered":"2024-09-13T18:45:26.599947+0000","last_clean":"2024-09-13T18:45:26.599947+0000","last_became_active":"2024-09-13T18:45:22.032862+0000","last_became_peered":"2024-09-13T18:45:22.032862+0000","last_unstale":"2024-09-13T18:45:26.599947+0000","last_undegraded":"2024-09-13T18:45:26.599947+0000","last_fullsized":"2024-09-13T18:45:26.599947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044282+0000","last_change":"2024-09-13T18:45:21.668025+0000","last_active":"2024-09-13T18:45:26.044282+0000","last_peered":"2024-09-13T18:45:26.044282+0000","last_clean":"2024-09-13T18:45:26.044282+0000","last_became_active":"2024-09-13T18:45:21.667457+0000","last_became_peered":"2024-09-13T18:45:21.667457+0000","last_unstale":"2024-09-13T18:45:26.044282+0000","last_undegraded":"2024-09-13T18:45:26.044282+0000","last_fullsized":"2024-09-13T18:45:26.044282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601060+0000","last_change":"2024-09-13T18:45:26.250464+0000","last_active":"2024-09-13T18:45:26.601060+0000","last_peered":"2024-09-13T18:45:26.601060+0000","last_clean":"2024-09-13T18:45:26.601060+0000","last_became_active":"2024-09-13T18:45:26.250041+0000","last_became_peered":"2024-09-13T18:45:26.250041+0000","last_unstale":"2024-09-13T18:45:26.601060+0000","last_undegraded":"2024-09-13T18:45:26.601060+0000","last_fullsized":"2024-09-13T18:45:26.601060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:20.013806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599781+0000","last_change":"2024-09-13T18:45:22.024133+0000","last_active":"2024-09-13T18:45:26.599781+0000","last_peered":"2024-09-13T18:45:26.599781+0000","last_clean":"2024-09-13T18:45:26.599781+0000","last_became_active":"2024-09-13T18:45:22.023882+0000","last_became_peered":"2024-09-13T18:45:22.023882+0000","last_unstale":"2024-09-13T18:45:26.599781+0000","last_undegraded":"2024-09-13T18:45:26.599781+0000","last_fullsized":"2024-09-13T18:45:26.599781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.053020+0000","last_change":"2024-09-13T18:45:21.663297+0000","last_active":"2024-09-13T18:45:26.053020+0000","last_peered":"2024-09-13T18:45:26.053020+0000","last_clean":"2024-09-13T18:45:26.053020+0000","last_became_active":"2024-09-13T18:45:21.662980+0000","last_became_peered":"2024-09-13T18:45:21.662980+0000","last_unstale":"2024-09-13T18:45:26.053020+0000","last_undegraded":"2024-09-13T18:45:26.053020+0000","last_fullsized":"2024-09-13T18:45:26.053020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600385+0000","last_change":"2024-09-13T18:45:26.253184+0000","last_active":"2024-09-13T18:45:26.600385+0000","last_peered":"2024-09-13T18:45:26.600385+0000","last_clean":"2024-09-13T18:45:26.600385+0000","last_became_active":"2024-09-13T18:45:26.252786+0000","last_became_peered":"2024-09-13T18:45:26.252786+0000","last_unstale":"2024-09-13T18:45:26.600385+0000","last_undegraded":"2024-09-13T18:45:26.600385+0000","last_fullsized":"2024-09-13T18:45:26.600385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599971+0000","last_change":"2024-09-13T18:45:22.035052+0000","last_active":"2024-09-13T18:45:26.599971+0000","last_peered":"2024-09-13T18:45:26.599971+0000","last_clean":"2024-09-13T18:45:26.599971+0000","last_became_active":"2024-09-13T18:45:22.034765+0000","last_became_peered":"2024-09-13T18:45:22.034765+0000","last_unstale":"2024-09-13T18:45:26.599971+0000","last_undegraded":"2024-09-13T18:45:26.599971+0000","last_fullsized":"2024-09-13T18:45:26.599971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:28.674827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:30.681690+0000","last_change":"2024-09-13T18:45:21.668054+0000","last_active":"2024-09-13T18:45:30.681690+0000","last_peered":"2024-09-13T18:45:30.681690+0000","last_clean":"2024-09-13T18:45:30.681690+0000","last_became_active":"2024-09-13T18:45:21.667587+0000","last_became_peered":"2024-09-13T18:45:21.667587+0000","last_unstale":"2024-09-13T18:45:30.681690+0000","last_undegraded":"2024-09-13T18:45:30.681690+0000","last_fullsized":"2024-09-13T18:45:30.681690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605348+0000","last_change":"2024-09-13T18:45:26.052997+0000","last_active":"2024-09-13T18:45:26.605348+0000","last_peered":"2024-09-13T18:45:26.605348+0000","last_clean":"2024-09-13T18:45:26.605348+0000","last_became_active":"2024-09-13T18:45:26.052614+0000","last_became_peered":"2024-09-13T18:45:26.052614+0000","last_unstale":"2024-09-13T18:45:26.605348+0000","last_undegraded":"2024-09-13T18:45:26.605348+0000","last_fullsized":"2024-09-13T18:45:26.605348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410522+0000","last_change":"2024-09-13T18:45:22.020754+0000","last_active":"2024-09-13T18:45:26.410522+0000","last_peered":"2024-09-13T18:45:26.410522+0000","last_clean":"2024-09-13T18:45:26.410522+0000","last_became_active":"2024-09-13T18:45:22.020461+0000","last_became_peered":"2024-09-13T18:45:22.020461+0000","last_unstale":"2024-09-13T18:45:26.410522+0000","last_undegraded":"2024-09-13T18:45:26.410522+0000","last_fullsized":"2024-09-13T18:45:26.410522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.045194+0000","last_change":"2024-09-13T18:45:21.664387+0000","last_active":"2024-09-13T18:45:26.045194+0000","last_peered":"2024-09-13T18:45:26.045194+0000","last_clean":"2024-09-13T18:45:26.045194+0000","last_became_active":"2024-09-13T18:45:21.663941+0000","last_became_peered":"2024-09-13T18:45:21.663941+0000","last_unstale":"2024-09-13T18:45:26.045194+0000","last_undegraded":"2024-09-13T18:45:26.045194+0000","last_fullsized":"2024-09-13T18:45:26.045194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410895+0000","last_change":"2024-09-13T18:45:26.051227+0000","last_active":"2024-09-13T18:45:26.410895+0000","last_peered":"2024-09-13T18:45:26.410895+0000","last_clean":"2024-09-13T18:45:26.410895+0000","last_became_active":"2024-09-13T18:45:26.050757+0000","last_became_peered":"2024-09-13T18:45:26.050757+0000","last_unstale":"2024-09-13T18:45:26.410895+0000","last_undegraded":"2024-09-13T18:45:26.410895+0000","last_fullsized":"2024-09-13T18:45:26.410895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:59.045390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599915+0000","last_change":"2024-09-13T18:45:22.025223+0000","last_active":"2024-09-13T18:45:26.599915+0000","last_peered":"2024-09-13T18:45:26.599915+0000","last_clean":"2024-09-13T18:45:26.599915+0000","last_became_active":"2024-09-13T18:45:22.024972+0000","last_became_peered":"2024-09-13T18:45:22.024972+0000","last_unstale":"2024-09-13T18:45:26.599915+0000","last_undegraded":"2024-09-13T18:45:26.599915+0000","last_fullsized":"2024-09-13T18:45:26.599915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.044352+0000","last_change":"2024-09-13T18:45:21.666814+0000","last_active":"2024-09-13T18:45:26.044352+0000","last_peered":"2024-09-13T18:45:26.044352+0000","last_clean":"2024-09-13T18:45:26.044352+0000","last_became_active":"2024-09-13T18:45:21.666516+0000","last_became_peered":"2024-09-13T18:45:21.666516+0000","last_unstale":"2024-09-13T18:45:26.044352+0000","last_undegraded":"2024-09-13T18:45:26.044352+0000","last_fullsized":"2024-09-13T18:45:26.044352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600944+0000","last_change":"2024-09-13T18:45:26.057746+0000","last_active":"2024-09-13T18:45:26.600944+0000","last_peered":"2024-09-13T18:45:26.600944+0000","last_clean":"2024-09-13T18:45:26.600944+0000","last_became_active":"2024-09-13T18:45:26.057285+0000","last_became_peered":"2024-09-13T18:45:26.057285+0000","last_unstale":"2024-09-13T18:45:26.600944+0000","last_undegraded":"2024-09-13T18:45:26.600944+0000","last_fullsized":"2024-09-13T18:45:26.600944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600419+0000","last_change":"2024-09-13T18:45:22.031653+0000","last_active":"2024-09-13T18:45:26.600419+0000","last_peered":"2024-09-13T18:45:26.600419+0000","last_clean":"2024-09-13T18:45:26.600419+0000","last_became_active":"2024-09-13T18:45:22.031341+0000","last_became_peered":"2024-09-13T18:45:22.031341+0000","last_unstale":"2024-09-13T18:45:26.600419+0000","last_undegraded":"2024-09-13T18:45:26.600419+0000","last_fullsized":"2024-09-13T18:45:26.600419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.037413+0000","last_change":"2024-09-13T18:45:21.664695+0000","last_active":"2024-09-13T18:45:26.037413+0000","last_peered":"2024-09-13T18:45:26.037413+0000","last_clean":"2024-09-13T18:45:26.037413+0000","last_became_active":"2024-09-13T18:45:21.664401+0000","last_became_peered":"2024-09-13T18:45:21.664401+0000","last_unstale":"2024-09-13T18:45:26.037413+0000","last_undegraded":"2024-09-13T18:45:26.037413+0000","last_fullsized":"2024-09-13T18:45:26.037413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600992+0000","last_change":"2024-09-13T18:45:26.254041+0000","last_active":"2024-09-13T18:45:26.600992+0000","last_peered":"2024-09-13T18:45:26.600992+0000","last_clean":"2024-09-13T18:45:26.600992+0000","last_became_active":"2024-09-13T18:45:26.253579+0000","last_became_peered":"2024-09-13T18:45:26.253579+0000","last_unstale":"2024-09-13T18:45:26.600992+0000","last_undegraded":"2024-09-13T18:45:26.600992+0000","last_fullsized":"2024-09-13T18:45:26.600992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:19.171737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599855+0000","last_change":"2024-09-13T18:45:26.253962+0000","last_active":"2024-09-13T18:45:26.599855+0000","last_peered":"2024-09-13T18:45:26.599855+0000","last_clean":"2024-09-13T18:45:26.599855+0000","last_became_active":"2024-09-13T18:45:26.252979+0000","last_became_peered":"2024-09-13T18:45:26.252979+0000","last_unstale":"2024-09-13T18:45:26.599855+0000","last_undegraded":"2024-09-13T18:45:26.599855+0000","last_fullsized":"2024-09-13T18:45:26.599855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605312+0000","last_change":"2024-09-13T18:45:22.030919+0000","last_active":"2024-09-13T18:45:26.605312+0000","last_peered":"2024-09-13T18:45:26.605312+0000","last_clean":"2024-09-13T18:45:26.605312+0000","last_became_active":"2024-09-13T18:45:22.030453+0000","last_became_peered":"2024-09-13T18:45:22.030453+0000","last_unstale":"2024-09-13T18:45:26.605312+0000","last_undegraded":"2024-09-13T18:45:26.605312+0000","last_fullsized":"2024-09-13T18:45:26.605312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.043671+0000","last_change":"2024-09-13T18:45:21.664824+0000","last_active":"2024-09-13T18:45:26.043671+0000","last_peered":"2024-09-13T18:45:26.043671+0000","last_clean":"2024-09-13T18:45:26.043671+0000","last_became_active":"2024-09-13T18:45:21.664571+0000","last_became_peered":"2024-09-13T18:45:21.664571+0000","last_unstale":"2024-09-13T18:45:26.043671+0000","last_undegraded":"2024-09-13T18:45:26.043671+0000","last_fullsized":"2024-09-13T18:45:26.043671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410703+0000","last_change":"2024-09-13T18:45:26.054920+0000","last_active":"2024-09-13T18:45:26.410703+0000","last_peered":"2024-09-13T18:45:26.410703+0000","last_clean":"2024-09-13T18:45:26.410703+0000","last_became_active":"2024-09-13T18:45:26.054510+0000","last_became_peered":"2024-09-13T18:45:26.054510+0000","last_unstale":"2024-09-13T18:45:26.410703+0000","last_undegraded":"2024-09-13T18:45:26.410703+0000","last_fullsized":"2024-09-13T18:45:26.410703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:32.061769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600953+0000","last_change":"2024-09-13T18:45:22.028321+0000","last_active":"2024-09-13T18:45:26.600953+0000","last_peered":"2024-09-13T18:45:26.600953+0000","last_clean":"2024-09-13T18:45:26.600953+0000","last_became_active":"2024-09-13T18:45:22.028062+0000","last_became_peered":"2024-09-13T18:45:22.028062+0000","last_unstale":"2024-09-13T18:45:26.600953+0000","last_undegraded":"2024-09-13T18:45:26.600953+0000","last_fullsized":"2024-09-13T18:45:26.600953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.036033+0000","last_change":"2024-09-13T18:45:21.672763+0000","last_active":"2024-09-13T18:45:26.036033+0000","last_peered":"2024-09-13T18:45:26.036033+0000","last_clean":"2024-09-13T18:45:26.036033+0000","last_became_active":"2024-09-13T18:45:21.672470+0000","last_became_peered":"2024-09-13T18:45:21.672470+0000","last_unstale":"2024-09-13T18:45:26.036033+0000","last_undegraded":"2024-09-13T18:45:26.036033+0000","last_fullsized":"2024-09-13T18:45:26.036033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.036402+0000","last_change":"2024-09-13T18:45:21.660195+0000","last_active":"2024-09-13T18:45:26.036402+0000","last_peered":"2024-09-13T18:45:26.036402+0000","last_clean":"2024-09-13T18:45:26.036402+0000","last_became_active":"2024-09-13T18:45:21.659912+0000","last_became_peered":"2024-09-13T18:45:21.659912+0000","last_unstale":"2024-09-13T18:45:26.036402+0000","last_undegraded":"2024-09-13T18:45:26.036402+0000","last_fullsized":"2024-09-13T18:45:26.036402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599830+0000","last_change":"2024-09-13T18:45:22.024571+0000","last_active":"2024-09-13T18:45:26.599830+0000","last_peered":"2024-09-13T18:45:26.599830+0000","last_clean":"2024-09-13T18:45:26.599830+0000","last_became_active":"2024-09-13T18:45:22.024305+0000","last_became_peered":"2024-09-13T18:45:22.024305+0000","last_unstale":"2024-09-13T18:45:26.599830+0000","last_undegraded":"2024-09-13T18:45:26.599830+0000","last_fullsized":"2024-09-13T18:45:26.599830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.408537+0000","last_change":"2024-09-13T18:45:26.056207+0000","last_active":"2024-09-13T18:45:26.408537+0000","last_peered":"2024-09-13T18:45:26.408537+0000","last_clean":"2024-09-13T18:45:26.408537+0000","last_became_active":"2024-09-13T18:45:26.055794+0000","last_became_peered":"2024-09-13T18:45:26.055794+0000","last_unstale":"2024-09-13T18:45:26.408537+0000","last_undegraded":"2024-09-13T18:45:26.408537+0000","last_fullsized":"2024-09-13T18:45:26.408537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:29.520825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.035461+0000","last_change":"2024-09-13T18:45:21.670376+0000","last_active":"2024-09-13T18:45:26.035461+0000","last_peered":"2024-09-13T18:45:26.035461+0000","last_clean":"2024-09-13T18:45:26.035461+0000","last_became_active":"2024-09-13T18:45:21.670083+0000","last_became_peered":"2024-09-13T18:45:21.670083+0000","last_unstale":"2024-09-13T18:45:26.035461+0000","last_undegraded":"2024-09-13T18:45:26.035461+0000","last_fullsized":"2024-09-13T18:45:26.035461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410560+0000","last_change":"2024-09-13T18:45:22.021774+0000","last_active":"2024-09-13T18:45:26.410560+0000","last_peered":"2024-09-13T18:45:26.410560+0000","last_clean":"2024-09-13T18:45:26.410560+0000","last_became_active":"2024-09-13T18:45:22.021496+0000","last_became_peered":"2024-09-13T18:45:22.021496+0000","last_unstale":"2024-09-13T18:45:26.410560+0000","last_undegraded":"2024-09-13T18:45:26.410560+0000","last_fullsized":"2024-09-13T18:45:26.410560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:44.234639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601081+0000","last_change":"2024-09-13T18:45:26.050478+0000","last_active":"2024-09-13T18:45:26.601081+0000","last_peered":"2024-09-13T18:45:26.601081+0000","last_clean":"2024-09-13T18:45:26.601081+0000","last_became_active":"2024-09-13T18:45:26.050095+0000","last_became_peered":"2024-09-13T18:45:26.050095+0000","last_unstale":"2024-09-13T18:45:26.601081+0000","last_undegraded":"2024-09-13T18:45:26.601081+0000","last_fullsized":"2024-09-13T18:45:26.601081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:28.276515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.409518+0000","last_change":"2024-09-13T18:45:22.028025+0000","last_active":"2024-09-13T18:45:26.409518+0000","last_peered":"2024-09-13T18:45:26.409518+0000","last_clean":"2024-09-13T18:45:26.409518+0000","last_became_active":"2024-09-13T18:45:22.027528+0000","last_became_peered":"2024-09-13T18:45:22.027528+0000","last_unstale":"2024-09-13T18:45:26.409518+0000","last_undegraded":"2024-09-13T18:45:26.409518+0000","last_fullsized":"2024-09-13T18:45:26.409518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.408408+0000","last_change":"2024-09-13T18:45:22.024615+0000","last_active":"2024-09-13T18:45:26.408408+0000","last_peered":"2024-09-13T18:45:26.408408+0000","last_clean":"2024-09-13T18:45:26.408408+0000","last_became_active":"2024-09-13T18:45:22.024369+0000","last_became_peered":"2024-09-13T18:45:22.024369+0000","last_unstale":"2024-09-13T18:45:26.408408+0000","last_undegraded":"2024-09-13T18:45:26.408408+0000","last_fullsized":"2024-09-13T18:45:26.408408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600313+0000","last_change":"2024-09-13T18:45:22.035861+0000","last_active":"2024-09-13T18:45:26.600313+0000","last_peered":"2024-09-13T18:45:26.600313+0000","last_clean":"2024-09-13T18:45:26.600313+0000","last_became_active":"2024-09-13T18:45:22.034318+0000","last_became_peered":"2024-09-13T18:45:22.034318+0000","last_unstale":"2024-09-13T18:45:26.600313+0000","last_undegraded":"2024-09-13T18:45:26.600313+0000","last_fullsized":"2024-09-13T18:45:26.600313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599822+0000","last_change":"2024-09-13T18:45:22.033266+0000","last_active":"2024-09-13T18:45:26.599822+0000","last_peered":"2024-09-13T18:45:26.599822+0000","last_clean":"2024-09-13T18:45:26.599822+0000","last_became_active":"2024-09-13T18:45:22.032851+0000","last_became_peered":"2024-09-13T18:45:22.032851+0000","last_unstale":"2024-09-13T18:45:26.599822+0000","last_undegraded":"2024-09-13T18:45:26.599822+0000","last_fullsized":"2024-09-13T18:45:26.599822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601071+0000","last_change":"2024-09-13T18:45:22.033500+0000","last_active":"2024-09-13T18:45:26.601071+0000","last_peered":"2024-09-13T18:45:26.601071+0000","last_clean":"2024-09-13T18:45:26.601071+0000","last_became_active":"2024-09-13T18:45:22.033156+0000","last_became_peered":"2024-09-13T18:45:22.033156+0000","last_unstale":"2024-09-13T18:45:26.601071+0000","last_undegraded":"2024-09-13T18:45:26.601071+0000","last_fullsized":"2024-09-13T18:45:26.601071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605389+0000","last_change":"2024-09-13T18:45:22.029906+0000","last_active":"2024-09-13T18:45:26.605389+0000","last_peered":"2024-09-13T18:45:26.605389+0000","last_clean":"2024-09-13T18:45:26.605389+0000","last_became_active":"2024-09-13T18:45:22.029654+0000","last_became_peered":"2024-09-13T18:45:22.029654+0000","last_unstale":"2024-09-13T18:45:26.605389+0000","last_undegraded":"2024-09-13T18:45:26.605389+0000","last_fullsized":"2024-09-13T18:45:26.605389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410838+0000","last_change":"2024-09-13T18:45:22.028396+0000","last_active":"2024-09-13T18:45:26.410838+0000","last_peered":"2024-09-13T18:45:26.410838+0000","last_clean":"2024-09-13T18:45:26.410838+0000","last_became_active":"2024-09-13T18:45:22.028031+0000","last_became_peered":"2024-09-13T18:45:22.028031+0000","last_unstale":"2024-09-13T18:45:26.410838+0000","last_undegraded":"2024-09-13T18:45:26.410838+0000","last_fullsized":"2024-09-13T18:45:26.410838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601118+0000","last_change":"2024-09-13T18:45:22.032816+0000","last_active":"2024-09-13T18:45:26.601118+0000","last_peered":"2024-09-13T18:45:26.601118+0000","last_clean":"2024-09-13T18:45:26.601118+0000","last_became_active":"2024-09-13T18:45:22.032561+0000","last_became_peered":"2024-09-13T18:45:22.032561+0000","last_unstale":"2024-09-13T18:45:26.601118+0000","last_undegraded":"2024-09-13T18:45:26.601118+0000","last_fullsized":"2024-09-13T18:45:26.601118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600256+0000","last_change":"2024-09-13T18:45:22.036615+0000","last_active":"2024-09-13T18:45:26.600256+0000","last_peered":"2024-09-13T18:45:26.600256+0000","last_clean":"2024-09-13T18:45:26.600256+0000","last_became_active":"2024-09-13T18:45:22.036380+0000","last_became_peered":"2024-09-13T18:45:22.036380+0000","last_unstale":"2024-09-13T18:45:26.600256+0000","last_undegraded":"2024-09-13T18:45:26.600256+0000","last_fullsized":"2024-09-13T18:45:26.600256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601002+0000","last_change":"2024-09-13T18:45:22.035082+0000","last_active":"2024-09-13T18:45:26.601002+0000","last_peered":"2024-09-13T18:45:26.601002+0000","last_clean":"2024-09-13T18:45:26.601002+0000","last_became_active":"2024-09-13T18:45:22.034646+0000","last_became_peered":"2024-09-13T18:45:22.034646+0000","last_unstale":"2024-09-13T18:45:26.601002+0000","last_undegraded":"2024-09-13T18:45:26.601002+0000","last_fullsized":"2024-09-13T18:45:26.601002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600302+0000","last_change":"2024-09-13T18:45:22.029195+0000","last_active":"2024-09-13T18:45:26.600302+0000","last_peered":"2024-09-13T18:45:26.600302+0000","last_clean":"2024-09-13T18:45:26.600302+0000","last_became_active":"2024-09-13T18:45:22.028430+0000","last_became_peered":"2024-09-13T18:45:22.028430+0000","last_unstale":"2024-09-13T18:45:26.600302+0000","last_undegraded":"2024-09-13T18:45:26.600302+0000","last_fullsized":"2024-09-13T18:45:26.600302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599802+0000","last_change":"2024-09-13T18:45:22.019974+0000","last_active":"2024-09-13T18:45:26.599802+0000","last_peered":"2024-09-13T18:45:26.599802+0000","last_clean":"2024-09-13T18:45:26.599802+0000","last_became_active":"2024-09-13T18:45:22.019733+0000","last_became_peered":"2024-09-13T18:45:22.019733+0000","last_unstale":"2024-09-13T18:45:26.599802+0000","last_undegraded":"2024-09-13T18:45:26.599802+0000","last_fullsized":"2024-09-13T18:45:26.599802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410236+0000","last_change":"2024-09-13T18:45:22.016110+0000","last_active":"2024-09-13T18:45:26.410236+0000","last_peered":"2024-09-13T18:45:26.410236+0000","last_clean":"2024-09-13T18:45:26.410236+0000","last_became_active":"2024-09-13T18:45:22.015868+0000","last_became_peered":"2024-09-13T18:45:22.015868+0000","last_unstale":"2024-09-13T18:45:26.410236+0000","last_undegraded":"2024-09-13T18:45:26.410236+0000","last_fullsized":"2024-09-13T18:45:26.410236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599998+0000","last_change":"2024-09-13T18:45:22.034477+0000","last_active":"2024-09-13T18:45:26.599998+0000","last_peered":"2024-09-13T18:45:26.599998+0000","last_clean":"2024-09-13T18:45:26.599998+0000","last_became_active":"2024-09-13T18:45:22.034019+0000","last_became_peered":"2024-09-13T18:45:22.034019+0000","last_unstale":"2024-09-13T18:45:26.599998+0000","last_undegraded":"2024-09-13T18:45:26.599998+0000","last_fullsized":"2024-09-13T18:45:26.599998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.408670+0000","last_change":"2024-09-13T18:45:22.021787+0000","last_active":"2024-09-13T18:45:26.408670+0000","last_peered":"2024-09-13T18:45:26.408670+0000","last_clean":"2024-09-13T18:45:26.408670+0000","last_became_active":"2024-09-13T18:45:22.020415+0000","last_became_peered":"2024-09-13T18:45:22.020415+0000","last_unstale":"2024-09-13T18:45:26.408670+0000","last_undegraded":"2024-09-13T18:45:26.408670+0000","last_fullsized":"2024-09-13T18:45:26.408670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600442+0000","last_change":"2024-09-13T18:45:22.035941+0000","last_active":"2024-09-13T18:45:26.600442+0000","last_peered":"2024-09-13T18:45:26.600442+0000","last_clean":"2024-09-13T18:45:26.600442+0000","last_became_active":"2024-09-13T18:45:22.035491+0000","last_became_peered":"2024-09-13T18:45:22.035491+0000","last_unstale":"2024-09-13T18:45:26.600442+0000","last_undegraded":"2024-09-13T18:45:26.600442+0000","last_fullsized":"2024-09-13T18:45:26.600442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600236+0000","last_change":"2024-09-13T18:45:22.027416+0000","last_active":"2024-09-13T18:45:26.600236+0000","last_peered":"2024-09-13T18:45:26.600236+0000","last_clean":"2024-09-13T18:45:26.600236+0000","last_became_active":"2024-09-13T18:45:22.027170+0000","last_became_peered":"2024-09-13T18:45:22.027170+0000","last_unstale":"2024-09-13T18:45:26.600236+0000","last_undegraded":"2024-09-13T18:45:26.600236+0000","last_fullsized":"2024-09-13T18:45:26.600236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605321+0000","last_change":"2024-09-13T18:45:22.021298+0000","last_active":"2024-09-13T18:45:26.605321+0000","last_peered":"2024-09-13T18:45:26.605321+0000","last_clean":"2024-09-13T18:45:26.605321+0000","last_became_active":"2024-09-13T18:45:22.021042+0000","last_became_peered":"2024-09-13T18:45:22.021042+0000","last_unstale":"2024-09-13T18:45:26.605321+0000","last_undegraded":"2024-09-13T18:45:26.605321+0000","last_fullsized":"2024-09-13T18:45:26.605321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599771+0000","last_change":"2024-09-13T18:45:22.021628+0000","last_active":"2024-09-13T18:45:26.599771+0000","last_peered":"2024-09-13T18:45:26.599771+0000","last_clean":"2024-09-13T18:45:26.599771+0000","last_became_active":"2024-09-13T18:45:22.021366+0000","last_became_peered":"2024-09-13T18:45:22.021366+0000","last_unstale":"2024-09-13T18:45:26.599771+0000","last_undegraded":"2024-09-13T18:45:26.599771+0000","last_fullsized":"2024-09-13T18:45:26.599771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.601029+0000","last_change":"2024-09-13T18:45:22.029051+0000","last_active":"2024-09-13T18:45:26.601029+0000","last_peered":"2024-09-13T18:45:26.601029+0000","last_clean":"2024-09-13T18:45:26.601029+0000","last_became_active":"2024-09-13T18:45:22.028594+0000","last_became_peered":"2024-09-13T18:45:22.028594+0000","last_unstale":"2024-09-13T18:45:26.601029+0000","last_undegraded":"2024-09-13T18:45:26.601029+0000","last_fullsized":"2024-09-13T18:45:26.601029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410403+0000","last_change":"2024-09-13T18:45:22.016996+0000","last_active":"2024-09-13T18:45:26.410403+0000","last_peered":"2024-09-13T18:45:26.410403+0000","last_clean":"2024-09-13T18:45:26.410403+0000","last_became_active":"2024-09-13T18:45:22.016731+0000","last_became_peered":"2024-09-13T18:45:22.016731+0000","last_unstale":"2024-09-13T18:45:26.410403+0000","last_undegraded":"2024-09-13T18:45:26.410403+0000","last_fullsized":"2024-09-13T18:45:26.410403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410341+0000","last_change":"2024-09-13T18:45:22.028649+0000","last_active":"2024-09-13T18:45:26.410341+0000","last_peered":"2024-09-13T18:45:26.410341+0000","last_clean":"2024-09-13T18:45:26.410341+0000","last_became_active":"2024-09-13T18:45:22.027899+0000","last_became_peered":"2024-09-13T18:45:22.027899+0000","last_unstale":"2024-09-13T18:45:26.410341+0000","last_undegraded":"2024-09-13T18:45:26.410341+0000","last_fullsized":"2024-09-13T18:45:26.410341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.410750+0000","last_change":"2024-09-13T18:45:22.024291+0000","last_active":"2024-09-13T18:45:26.410750+0000","last_peered":"2024-09-13T18:45:26.410750+0000","last_clean":"2024-09-13T18:45:26.410750+0000","last_became_active":"2024-09-13T18:45:22.024014+0000","last_became_peered":"2024-09-13T18:45:22.024014+0000","last_unstale":"2024-09-13T18:45:26.410750+0000","last_undegraded":"2024-09-13T18:45:26.410750+0000","last_fullsized":"2024-09-13T18:45:26.410750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600045+0000","last_change":"2024-09-13T18:45:22.036551+0000","last_active":"2024-09-13T18:45:26.600045+0000","last_peered":"2024-09-13T18:45:26.600045+0000","last_clean":"2024-09-13T18:45:26.600045+0000","last_became_active":"2024-09-13T18:45:22.036269+0000","last_became_peered":"2024-09-13T18:45:22.036269+0000","last_unstale":"2024-09-13T18:45:26.600045+0000","last_undegraded":"2024-09-13T18:45:26.600045+0000","last_fullsized":"2024-09-13T18:45:26.600045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600933+0000","last_change":"2024-09-13T18:45:22.032392+0000","last_active":"2024-09-13T18:45:26.600933+0000","last_peered":"2024-09-13T18:45:26.600933+0000","last_clean":"2024-09-13T18:45:26.600933+0000","last_became_active":"2024-09-13T18:45:22.027605+0000","last_became_peered":"2024-09-13T18:45:22.027605+0000","last_unstale":"2024-09-13T18:45:26.600933+0000","last_undegraded":"2024-09-13T18:45:26.600933+0000","last_fullsized":"2024-09-13T18:45:26.600933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599883+0000","last_change":"2024-09-13T18:45:22.029307+0000","last_active":"2024-09-13T18:45:26.599883+0000","last_peered":"2024-09-13T18:45:26.599883+0000","last_clean":"2024-09-13T18:45:26.599883+0000","last_became_active":"2024-09-13T18:45:22.029018+0000","last_became_peered":"2024-09-13T18:45:22.029018+0000","last_unstale":"2024-09-13T18:45:26.599883+0000","last_undegraded":"2024-09-13T18:45:26.599883+0000","last_fullsized":"2024-09-13T18:45:26.599883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600287+0000","last_change":"2024-09-13T18:45:22.029061+0000","last_active":"2024-09-13T18:45:26.600287+0000","last_peered":"2024-09-13T18:45:26.600287+0000","last_clean":"2024-09-13T18:45:26.600287+0000","last_became_active":"2024-09-13T18:45:22.028758+0000","last_became_peered":"2024-09-13T18:45:22.028758+0000","last_unstale":"2024-09-13T18:45:26.600287+0000","last_undegraded":"2024-09-13T18:45:26.600287+0000","last_fullsized":"2024-09-13T18:45:26.600287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599926+0000","last_change":"2024-09-13T18:45:22.029690+0000","last_active":"2024-09-13T18:45:26.599926+0000","last_peered":"2024-09-13T18:45:26.599926+0000","last_clean":"2024-09-13T18:45:26.599926+0000","last_became_active":"2024-09-13T18:45:22.029403+0000","last_became_peered":"2024-09-13T18:45:22.029403+0000","last_unstale":"2024-09-13T18:45:26.599926+0000","last_undegraded":"2024-09-13T18:45:26.599926+0000","last_fullsized":"2024-09-13T18:45:26.599926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600349+0000","last_change":"2024-09-13T18:45:22.038483+0000","last_active":"2024-09-13T18:45:26.600349+0000","last_peered":"2024-09-13T18:45:26.600349+0000","last_clean":"2024-09-13T18:45:26.600349+0000","last_became_active":"2024-09-13T18:45:22.036877+0000","last_became_peered":"2024-09-13T18:45:22.036877+0000","last_unstale":"2024-09-13T18:45:26.600349+0000","last_undegraded":"2024-09-13T18:45:26.600349+0000","last_fullsized":"2024-09-13T18:45:26.600349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.599845+0000","last_change":"2024-09-13T18:45:22.022846+0000","last_active":"2024-09-13T18:45:26.599845+0000","last_peered":"2024-09-13T18:45:26.599845+0000","last_clean":"2024-09-13T18:45:26.599845+0000","last_became_active":"2024-09-13T18:45:22.022618+0000","last_became_peered":"2024-09-13T18:45:22.022618+0000","last_unstale":"2024-09-13T18:45:26.599845+0000","last_undegraded":"2024-09-13T18:45:26.599845+0000","last_fullsized":"2024-09-13T18:45:26.599845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.605420+0000","last_change":"2024-09-13T18:45:22.028545+0000","last_active":"2024-09-13T18:45:26.605420+0000","last_peered":"2024-09-13T18:45:26.605420+0000","last_clean":"2024-09-13T18:45:26.605420+0000","last_became_active":"2024-09-13T18:45:22.028291+0000","last_became_peered":"2024-09-13T18:45:22.028291+0000","last_unstale":"2024-09-13T18:45:26.605420+0000","last_undegraded":"2024-09-13T18:45:26.605420+0000","last_fullsized":"2024-09-13T18:45:26.605420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:26.600036+0000","last_change":"2024-09-13T18:45:22.034460+0000","last_active":"2024-09-13T18:45:26.600036+0000","last_peered":"2024-09-13T18:45:26.600036+0000","last_clean":"2024-09-13T18:45:26.600036+0000","last_became_active":"2024-09-13T18:45:22.033974+0000","last_became_peered":"2024-09-13T18:45:22.033974+0000","last_unstale":"2024-09-13T18:45:26.600036+0000","last_undegraded":"2024-09-13T18:45:26.600036+0000","last_fullsized":"2024-09-13T18:45:26.600036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":690344,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":266240,"data_stored":103189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":253952,"data_stored":99394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":262144,"data_stored":99554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":331776,"data_stored":690400,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:45:50.358 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:45:50.358 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:45:50.358 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:45:50.358 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T18:45:50.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.491+0000 7f7dfc841640 1 Processor -- start 2024-09-13T18:45:50.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.491+0000 7f7dfc841640 1 -- start start 2024-09-13T18:45:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7dfc841640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7df809a560 0x7f7df8143a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7dfc841640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df80b2df0 con 0x7f7df8143fc0 2024-09-13T18:45:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7dfc841640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df80b34f0 con 0x7f7df80b2120 2024-09-13T18:45:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7dfc841640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df80b2500 con 0x7f7df809a560 2024-09-13T18:45:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df6d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7df8143fc0 0x7f7df814e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54454/0 (socket says 172.21.15.29:54454) 2024-09-13T18:45:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df6d9d640 1 -- 172.21.15.29:0/2841983395 learned_addr learned my addr 172.21.15.29:0/2841983395 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588856764 0 0) 0x7f7df80b2df0 con 0x7f7df8143fc0 2024-09-13T18:45:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7deffff640 1 --2- 172.21.15.29:0/2841983395 >> v2:172.21.15.96:3300/0 conn(0x7f7df809a560 0x7f7df8143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7de4003520 con 0x7f7df8143fc0 2024-09-13T18:45:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 902849950 0 0) 0x7f7de4003520 con 0x7f7df8143fc0 2024-09-13T18:45:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 >> v2:172.21.15.96:3300/0 conn(0x7f7df809a560 msgr2=0x7f7df8143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 --2- 172.21.15.29:0/2841983395 >> v2:172.21.15.96:3300/0 conn(0x7f7df809a560 0x7f7df8143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 >> v1:172.21.15.96:6789/0 conn(0x7f7df80b2120 legacy=0x7f7df809c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df80b3180 con 0x7f7df8143fc0 2024-09-13T18:45:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f7df00019f0 con 0x7f7df8143fc0 2024-09-13T18:45:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 >> v1:172.21.15.29:6789/0 conn(0x7f7df8143fc0 legacy=0x7f7df814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 --2- 172.21.15.29:0/2841983395 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7de4003970 0x7f7de4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 --2- 172.21.15.29:0/2841983395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de40047c0 0x7f7de4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 --2- 172.21.15.29:0/2841983395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40052a0 0x7f7de400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df80b2500 con 0x7f7de40047c0 2024-09-13T18:45:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de400c170 con 0x7f7de40052a0 2024-09-13T18:45:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de400c330 con 0x7f7de4003970 2024-09-13T18:45:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.492+0000 7f7deffff640 1 --2- 172.21.15.29:0/2841983395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de40047c0 0x7f7de4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.493+0000 7f7df6d9d640 1 --2- 172.21.15.29:0/2841983395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40052a0 0x7f7de400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.493+0000 7f7df659c640 1 --2- 172.21.15.29:0/2841983395 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7de4003970 0x7f7de4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.493+0000 7f7deffff640 1 -- 172.21.15.29:0/2841983395 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7de4003970 msgr2=0x7f7de4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.493+0000 7f7deffff640 1 --2- 172.21.15.29:0/2841983395 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7de4003970 0x7f7de4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.493+0000 7f7deffff640 1 -- 172.21.15.29:0/2841983395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40052a0 msgr2=0x7f7de400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.493+0000 7f7deffff640 1 --2- 172.21.15.29:0/2841983395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40052a0 0x7f7de400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.493+0000 7f7deffff640 1 -- 172.21.15.29:0/2841983395 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de4003520 con 0x7f7de40047c0 2024-09-13T18:45:50.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.493+0000 7f7df6d9d640 1 -- 172.21.15.29:0/2841983395 reap_dead start 2024-09-13T18:45:50.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.494+0000 7f7deffff640 1 --2- 172.21.15.29:0/2841983395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de40047c0 0x7f7de4004c40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009a90 tx=0x7f7de40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb7997d169e0546 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:50.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.494+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0031400 con 0x7f7de40047c0 2024-09-13T18:45:50.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.494+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de002d050 con 0x7f7de40047c0 2024-09-13T18:45:50.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.494+0000 7f7df5d9b640 1 -- 172.21.15.29:0/2841983395 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0031780 con 0x7f7de40047c0 2024-09-13T18:45:50.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.494+0000 7f7dfc841640 1 -- 172.21.15.29:0/2841983395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de40047c0 msgr2=0x7f7de4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.494+0000 7f7dfc841640 1 --2- 172.21.15.29:0/2841983395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de40047c0 0x7f7de4004c40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009a90 tx=0x7f7de40057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.494+0000 7f7dfc841640 1 -- 172.21.15.29:0/2841983395 shutdown_connections 2024-09-13T18:45:50.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.494+0000 7f7dfc841640 1 --2- 172.21.15.29:0/2841983395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de40047c0 0x7f7de4004c40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.494+0000 7f7dfc841640 1 -- 172.21.15.29:0/2841983395 >> 172.21.15.29:0/2841983395 conn(0x7f7df80b3fb0 msgr2=0x7f7df80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:50.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.494+0000 7f7dfc841640 1 -- 172.21.15.29:0/2841983395 shutdown_connections 2024-09-13T18:45:50.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.494+0000 7f7dfc841640 1 -- 172.21.15.29:0/2841983395 wait complete. 2024-09-13T18:45:50.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.495+0000 7f7dfc841640 1 Processor -- start 2024-09-13T18:45:50.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.496+0000 7f7dfc841640 1 -- start start 2024-09-13T18:45:50.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.496+0000 7f7dfc841640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7de40047c0 0x7f7df8146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.496+0000 7f7dfc841640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7df806ea50 0x7f7df806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.496+0000 7f7dfc841640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df813f650 0x7f7df813fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.496+0000 7f7dfc841640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df8070810 con 0x7f7df813f650 2024-09-13T18:45:50.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.496+0000 7f7dfc841640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df81cd220 con 0x7f7df806ea50 2024-09-13T18:45:50.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.496+0000 7f7dfc841640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df806f410 con 0x7f7de40047c0 2024-09-13T18:45:50.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.496+0000 7f7df6d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df813f650 0x7f7df813fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.496+0000 7f7df6d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df813f650 0x7f7df813fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41202/0 (socket says 172.21.15.29:41202) 2024-09-13T18:45:50.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.496+0000 7f7df6d9d640 1 -- 172.21.15.29:0/1112030504 learned_addr learned my addr 172.21.15.29:0/1112030504 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:50.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.496+0000 7f7deffff640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7df806ea50 0x7f7df806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.496+0000 7f7df659c640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7de40047c0 0x7f7df8146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.497+0000 7f7df6d9d640 1 -- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7de40047c0 msgr2=0x7f7df8146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.497+0000 7f7df6d9d640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7de40047c0 0x7f7df8146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.497+0000 7f7df6d9d640 1 -- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7df806ea50 msgr2=0x7f7df806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.497+0000 7f7df6d9d640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7df806ea50 0x7f7df806eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.497+0000 7f7df6d9d640 1 -- 172.21.15.29:0/1112030504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df81cd700 con 0x7f7df813f650 2024-09-13T18:45:50.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.497+0000 7f7df6d9d640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df813f650 0x7f7df813fab0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7df81443a0 tx=0x7f7df0007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:50.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.497+0000 7f7deeffd640 1 -- 172.21.15.29:0/1112030504 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df000aab0 con 0x7f7df813f650 2024-09-13T18:45:50.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.497+0000 7f7deeffd640 1 -- 172.21.15.29:0/1112030504 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df000ac10 con 0x7f7df813f650 2024-09-13T18:45:50.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.497+0000 7f7dfc841640 1 -- 172.21.15.29:0/1112030504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df81cd9e0 con 0x7f7df813f650 2024-09-13T18:45:50.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.497+0000 7f7deeffd640 1 -- 172.21.15.29:0/1112030504 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df00133f0 con 0x7f7df813f650 2024-09-13T18:45:50.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.497+0000 7f7dfc841640 1 -- 172.21.15.29:0/1112030504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df8070430 con 0x7f7df813f650 2024-09-13T18:45:50.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.498+0000 7f7dfc841640 1 -- 172.21.15.29:0/1112030504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df806ff80 con 0x7f7df813f650 2024-09-13T18:45:50.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.498+0000 7f7deeffd640 1 -- 172.21.15.29:0/1112030504 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7df0013550 con 0x7f7df813f650 2024-09-13T18:45:50.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.499+0000 7f7deeffd640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7dd806ac00 0x7f7dd806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.499+0000 7f7deeffd640 1 -- 172.21.15.29:0/1112030504 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7df0089ce0 con 0x7f7df813f650 2024-09-13T18:45:50.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.499+0000 7f7df659c640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7dd806ac00 0x7f7dd806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.500+0000 7f7df659c640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7dd806ac00 0x7f7dd806d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7df80b63c0 tx=0x7f7de8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:50.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.503+0000 7f7deeffd640 1 -- 172.21.15.29:0/1112030504 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7df0054d10 con 0x7f7df813f650 2024-09-13T18:45:50.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.709+0000 7f7dfc841640 1 -- 172.21.15.29:0/1112030504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7df8143a80 con 0x7f7df813f650 2024-09-13T18:45:50.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.709+0000 7f7deeffd640 1 -- 172.21.15.29:0/1112030504 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7df0017020 con 0x7f7df813f650 2024-09-13T18:45:50.712 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:50.713 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:45:50.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.711+0000 7f7dfc841640 1 -- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7dd806ac00 msgr2=0x7f7dd806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.711+0000 7f7dfc841640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7dd806ac00 0x7f7dd806d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7df80b63c0 tx=0x7f7de8009040 comp rx=0 tx=0).stop 2024-09-13T18:45:50.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.711+0000 7f7dfc841640 1 -- 172.21.15.29:0/1112030504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df813f650 msgr2=0x7f7df813fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.711+0000 7f7dfc841640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df813f650 0x7f7df813fab0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7df81443a0 tx=0x7f7df0007a90 comp rx=0 tx=0).stop 2024-09-13T18:45:50.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.711+0000 7f7dfc841640 1 -- 172.21.15.29:0/1112030504 shutdown_connections 2024-09-13T18:45:50.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.711+0000 7f7dfc841640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7dd806ac00 0x7f7dd806d0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.711+0000 7f7dfc841640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df813f650 0x7f7df813fab0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.711+0000 7f7dfc841640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7df806ea50 0x7f7df806eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.711+0000 7f7dfc841640 1 --2- 172.21.15.29:0/1112030504 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7de40047c0 0x7f7df8146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.711+0000 7f7dfc841640 1 -- 172.21.15.29:0/1112030504 >> 172.21.15.29:0/1112030504 conn(0x7f7df80b3fb0 msgr2=0x7f7df80b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.711+0000 7f7dfc841640 1 -- 172.21.15.29:0/1112030504 shutdown_connections 2024-09-13T18:45:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.711+0000 7f7dfc841640 1 -- 172.21.15.29:0/1112030504 wait complete. 2024-09-13T18:45:50.725 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:45:50.726 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:50.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.825+0000 7f230f2f0640 1 Processor -- start 2024-09-13T18:45:50.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.825+0000 7f230f2f0640 1 -- start start 2024-09-13T18:45:50.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230f2f0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f23080b31d0 0x7f23080b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230f2f0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23080b35b0 0x7f23081498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230f2f0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2308149410 con 0x7f230813f8e0 2024-09-13T18:45:50.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230f2f0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23080b4550 con 0x7f23080b35b0 2024-09-13T18:45:50.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230f2f0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23080b4810 con 0x7f23080b31d0 2024-09-13T18:45:50.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230c88b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23080b35b0 0x7f23081498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230d88d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f230813f8e0 0x7f230813fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54458/0 (socket says 172.21.15.29:54458) 2024-09-13T18:45:50.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230c88b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23080b35b0 0x7f23081498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41204/0 (socket says 172.21.15.29:41204) 2024-09-13T18:45:50.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230d88d640 1 -- 172.21.15.29:0/3014788227 learned_addr learned my addr 172.21.15.29:0/3014788227 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:50.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230d08c640 1 --2- 172.21.15.29:0/3014788227 >> v2:172.21.15.96:3300/0 conn(0x7f23080b31d0 0x7f23080b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230c88b640 1 -- 172.21.15.29:0/3014788227 >> v2:172.21.15.96:3300/0 conn(0x7f23080b31d0 msgr2=0x7f23080b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:50.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230c88b640 1 --2- 172.21.15.29:0/3014788227 >> v2:172.21.15.96:3300/0 conn(0x7f23080b31d0 0x7f23080b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230c88b640 1 -- 172.21.15.29:0/3014788227 >> v1:172.21.15.29:6789/0 conn(0x7f230813f8e0 legacy=0x7f230813fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f22fffff640 1 -- 172.21.15.29:0/3014788227 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86198847 0 0) 0x7f2308149410 con 0x7f230813f8e0 2024-09-13T18:45:50.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.826+0000 7f230c88b640 1 -- 172.21.15.29:0/3014788227 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23081490a0 con 0x7f23080b35b0 2024-09-13T18:45:50.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.827+0000 7f230c88b640 1 --2- 172.21.15.29:0/3014788227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23080b35b0 0x7f23081498a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f23080bb4a0 tx=0x7f22f802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c56696d88ee32ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.827+0000 7f22fffff640 1 -- 172.21.15.29:0/3014788227 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f802ae60 con 0x7f23080b35b0 2024-09-13T18:45:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.827+0000 7f22fffff640 1 -- 172.21.15.29:0/3014788227 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f8032440 con 0x7f23080b35b0 2024-09-13T18:45:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.827+0000 7f22fffff640 1 -- 172.21.15.29:0/3014788227 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f80327d0 con 0x7f23080b35b0 2024-09-13T18:45:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.828+0000 7f230f2f0640 1 -- 172.21.15.29:0/3014788227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23080b35b0 msgr2=0x7f23081498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.828+0000 7f230f2f0640 1 --2- 172.21.15.29:0/3014788227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23080b35b0 0x7f23081498a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f23080bb4a0 tx=0x7f22f802a110 comp rx=0 tx=0).stop 2024-09-13T18:45:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.828+0000 7f230f2f0640 1 -- 172.21.15.29:0/3014788227 shutdown_connections 2024-09-13T18:45:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.828+0000 7f230f2f0640 1 --2- 172.21.15.29:0/3014788227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23080b35b0 0x7f23081498a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.828+0000 7f230f2f0640 1 --2- 172.21.15.29:0/3014788227 >> v2:172.21.15.96:3300/0 conn(0x7f23080b31d0 0x7f23080b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.828+0000 7f230f2f0640 1 -- 172.21.15.29:0/3014788227 >> 172.21.15.29:0/3014788227 conn(0x7f23080bb590 msgr2=0x7f23080bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.828+0000 7f230f2f0640 1 -- 172.21.15.29:0/3014788227 shutdown_connections 2024-09-13T18:45:50.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.828+0000 7f230f2f0640 1 -- 172.21.15.29:0/3014788227 wait complete. 2024-09-13T18:45:50.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.829+0000 7f230f2f0640 1 Processor -- start 2024-09-13T18:45:50.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.829+0000 7f230f2f0640 1 -- start start 2024-09-13T18:45:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230f2f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23080b31d0 0x7f23081de250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230f2f0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23080b35b0 0x7f230813d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230f2f0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f230813f8e0 0x7f230813dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230f2f0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23080ab7d0 con 0x7f23080b31d0 2024-09-13T18:45:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230f2f0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2308141a70 con 0x7f23080b35b0 2024-09-13T18:45:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230f2f0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2308141d50 con 0x7f230813f8e0 2024-09-13T18:45:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230d08c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23080b31d0 0x7f23081de250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230d08c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23080b31d0 0x7f23081de250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41220/0 (socket says 172.21.15.29:41220) 2024-09-13T18:45:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230d08c640 1 -- 172.21.15.29:0/693402541 learned_addr learned my addr 172.21.15.29:0/693402541 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230c88b640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23080b35b0 0x7f230813d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230d88d640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f230813f8e0 0x7f230813dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230d08c640 1 -- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f230813f8e0 msgr2=0x7f230813dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230d08c640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f230813f8e0 0x7f230813dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230d08c640 1 -- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23080b35b0 msgr2=0x7f230813d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230d08c640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23080b35b0 0x7f230813d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230d08c640 1 -- 172.21.15.29:0/693402541 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f8009400 con 0x7f23080b31d0 2024-09-13T18:45:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230d88d640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f230813f8e0 0x7f230813dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230c88b640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23080b35b0 0x7f230813d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:50.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230d08c640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23080b31d0 0x7f23081de250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f230400e9b0 tx=0x7f230400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:50.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f22fdffb640 1 -- 172.21.15.29:0/693402541 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304009670 con 0x7f23080b31d0 2024-09-13T18:45:50.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f22fdffb640 1 -- 172.21.15.29:0/693402541 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230400c9a0 con 0x7f23080b31d0 2024-09-13T18:45:50.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f230f2f0640 1 -- 172.21.15.29:0/693402541 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2308142030 con 0x7f23080b31d0 2024-09-13T18:45:50.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.830+0000 7f22fdffb640 1 -- 172.21.15.29:0/693402541 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230400cd50 con 0x7f23080b31d0 2024-09-13T18:45:50.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.831+0000 7f230f2f0640 1 -- 172.21.15.29:0/693402541 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230813e140 con 0x7f23080b31d0 2024-09-13T18:45:50.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.832+0000 7f230f2f0640 1 -- 172.21.15.29:0/693402541 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23081421c0 con 0x7f23080b31d0 2024-09-13T18:45:50.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.832+0000 7f22fdffb640 1 -- 172.21.15.29:0/693402541 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2304013470 con 0x7f23080b31d0 2024-09-13T18:45:50.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.833+0000 7f22fdffb640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f22ec06ac30 0x7f22ec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:50.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.833+0000 7f22fdffb640 1 -- 172.21.15.29:0/693402541 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2304089800 con 0x7f23080b31d0 2024-09-13T18:45:50.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.833+0000 7f230c88b640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f22ec06ac30 0x7f22ec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:50.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.833+0000 7f230c88b640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f22ec06ac30 0x7f22ec06d0f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f22f8034000 tx=0x7f22f802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:50.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:50.837+0000 7f22fdffb640 1 -- 172.21.15.29:0/693402541 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2304054780 con 0x7f23080b31d0 2024-09-13T18:45:51.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.008+0000 7f230f2f0640 1 -- 172.21.15.29:0/693402541 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2308067300 con 0x7f23080b31d0 2024-09-13T18:45:51.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.009+0000 7f22fdffb640 1 -- 172.21.15.29:0/693402541 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7f2304087e60 con 0x7f23080b31d0 2024-09-13T18:45:51.012 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:51.012 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:51.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.011+0000 7f230f2f0640 1 -- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f22ec06ac30 msgr2=0x7f22ec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.011+0000 7f230f2f0640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f22ec06ac30 0x7f22ec06d0f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f22f8034000 tx=0x7f22f802e000 comp rx=0 tx=0).stop 2024-09-13T18:45:51.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.011+0000 7f230f2f0640 1 -- 172.21.15.29:0/693402541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23080b31d0 msgr2=0x7f23081de250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.011+0000 7f230f2f0640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23080b31d0 0x7f23081de250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f230400e9b0 tx=0x7f230400ee70 comp rx=0 tx=0).stop 2024-09-13T18:45:51.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.011+0000 7f230f2f0640 1 -- 172.21.15.29:0/693402541 shutdown_connections 2024-09-13T18:45:51.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.011+0000 7f230f2f0640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f22ec06ac30 0x7f22ec06d0f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.011+0000 7f230f2f0640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f230813f8e0 0x7f230813dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.011+0000 7f230f2f0640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23080b35b0 0x7f230813d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.011+0000 7f230f2f0640 1 --2- 172.21.15.29:0/693402541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23080b31d0 0x7f23081de250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.011+0000 7f230f2f0640 1 -- 172.21.15.29:0/693402541 >> 172.21.15.29:0/693402541 conn(0x7f23080bb590 msgr2=0x7f230813e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.011+0000 7f230f2f0640 1 -- 172.21.15.29:0/693402541 shutdown_connections 2024-09-13T18:45:51.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.011+0000 7f230f2f0640 1 -- 172.21.15.29:0/693402541 wait complete. 2024-09-13T18:45:51.025 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:45:17.630827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:45:20.113248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:20.978194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:24.059966+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:45:51.026 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:51.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.128+0000 7fbb1b87d640 1 Processor -- start 2024-09-13T18:45:51.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.128+0000 7fbb1b87d640 1 -- start start 2024-09-13T18:45:51.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.128+0000 7fbb1b87d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbb140b7b10 0x7fbb140b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.128+0000 7fbb1b87d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb14144720 0x7fbb1414e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.129+0000 7fbb1b87d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb140b3ce0 con 0x7fbb1406b5b0 2024-09-13T18:45:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.129+0000 7fbb1b87d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1406c4e0 con 0x7fbb14144720 2024-09-13T18:45:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.129+0000 7fbb1b87d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb140b6930 con 0x7fbb140b7b10 2024-09-13T18:45:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.129+0000 7fbb19e1a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb14144720 0x7fbb1414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.129+0000 7fbb19e1a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb14144720 0x7fbb1414e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41230/0 (socket says 172.21.15.29:41230) 2024-09-13T18:45:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.129+0000 7fbb19e1a640 1 -- 172.21.15.29:0/2165867283 learned_addr learned my addr 172.21.15.29:0/2165867283 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.129+0000 7fbb19619640 1 --2- 172.21.15.29:0/2165867283 >> v2:172.21.15.96:3300/0 conn(0x7fbb140b7b10 0x7fbb140b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.129+0000 7fbb19e1a640 1 -- 172.21.15.29:0/2165867283 >> v2:172.21.15.96:3300/0 conn(0x7fbb140b7b10 msgr2=0x7fbb140b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.129+0000 7fbb19e1a640 1 --2- 172.21.15.29:0/2165867283 >> v2:172.21.15.96:3300/0 conn(0x7fbb140b7b10 0x7fbb140b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.129+0000 7fbb19e1a640 1 -- 172.21.15.29:0/2165867283 >> v1:172.21.15.96:6789/0 conn(0x7fbb1406b5b0 legacy=0x7fbb14144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.129+0000 7fbb19e1a640 1 -- 172.21.15.29:0/2165867283 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb140b66c0 con 0x7fbb14144720 2024-09-13T18:45:51.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.130+0000 7fbb19e1a640 1 --2- 172.21.15.29:0/2165867283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb14144720 0x7fbb1414e170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbb1406d0a0 tx=0x7fbb0c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4355f1e571a166dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.130+0000 7fbb0bfff640 1 -- 172.21.15.29:0/2165867283 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c031600 con 0x7fbb14144720 2024-09-13T18:45:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.130+0000 7fbb0bfff640 1 -- 172.21.15.29:0/2165867283 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c02d050 con 0x7fbb14144720 2024-09-13T18:45:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.130+0000 7fbb0bfff640 1 -- 172.21.15.29:0/2165867283 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c031980 con 0x7fbb14144720 2024-09-13T18:45:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.130+0000 7fbb1b87d640 1 -- 172.21.15.29:0/2165867283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb14144720 msgr2=0x7fbb1414e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.130+0000 7fbb1b87d640 1 --2- 172.21.15.29:0/2165867283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb14144720 0x7fbb1414e170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbb1406d0a0 tx=0x7fbb0c02a610 comp rx=0 tx=0).stop 2024-09-13T18:45:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.130+0000 7fbb1b87d640 1 -- 172.21.15.29:0/2165867283 shutdown_connections 2024-09-13T18:45:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.130+0000 7fbb1b87d640 1 --2- 172.21.15.29:0/2165867283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb14144720 0x7fbb1414e170 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.130+0000 7fbb1b87d640 1 --2- 172.21.15.29:0/2165867283 >> v2:172.21.15.96:3300/0 conn(0x7fbb140b7b10 0x7fbb140b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.130+0000 7fbb1b87d640 1 -- 172.21.15.29:0/2165867283 >> 172.21.15.29:0/2165867283 conn(0x7fbb1406a2f0 msgr2=0x7fbb1406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.131+0000 7fbb1b87d640 1 -- 172.21.15.29:0/2165867283 shutdown_connections 2024-09-13T18:45:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.131+0000 7fbb1b87d640 1 -- 172.21.15.29:0/2165867283 wait complete. 2024-09-13T18:45:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb1b87d640 1 Processor -- start 2024-09-13T18:45:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb1b87d640 1 -- start start 2024-09-13T18:45:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb1b87d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb1406b5b0 0x7fbb141cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb1b87d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb140b7b10 0x7fbb141db4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb1b87d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb14144720 0x7fbb141db9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb1b87d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb140b0450 con 0x7fbb1406b5b0 2024-09-13T18:45:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb1b87d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb140aeea0 con 0x7fbb140b7b10 2024-09-13T18:45:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb1b87d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb140af180 con 0x7fbb14144720 2024-09-13T18:45:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb19619640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb1406b5b0 0x7fbb141cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb19619640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb1406b5b0 0x7fbb141cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41238/0 (socket says 172.21.15.29:41238) 2024-09-13T18:45:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb19619640 1 -- 172.21.15.29:0/3488419046 learned_addr learned my addr 172.21.15.29:0/3488419046 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb18e18640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb140b7b10 0x7fbb141db4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.132+0000 7fbb19e1a640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb14144720 0x7fbb141db9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.133+0000 7fbb19619640 1 -- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb14144720 msgr2=0x7fbb141db9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.133+0000 7fbb19619640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb14144720 0x7fbb141db9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.133+0000 7fbb19619640 1 -- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb140b7b10 msgr2=0x7fbb141db4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.133+0000 7fbb19619640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb140b7b10 0x7fbb141db4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.133+0000 7fbb19619640 1 -- 172.21.15.29:0/3488419046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c009b30 con 0x7fbb1406b5b0 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.133+0000 7fbb18e18640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb140b7b10 0x7fbb141db4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.133+0000 7fbb19619640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb1406b5b0 0x7fbb141cdec0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000e9b0 tx=0x7fbb1000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.133+0000 7fbb09ffb640 1 -- 172.21.15.29:0/3488419046 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10009670 con 0x7fbb1406b5b0 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.133+0000 7fbb09ffb640 1 -- 172.21.15.29:0/3488419046 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1000c9a0 con 0x7fbb1406b5b0 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.133+0000 7fbb1b87d640 1 -- 172.21.15.29:0/3488419046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb140af460 con 0x7fbb1406b5b0 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.133+0000 7fbb09ffb640 1 -- 172.21.15.29:0/3488419046 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1000cd50 con 0x7fbb1406b5b0 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.133+0000 7fbb1b87d640 1 -- 172.21.15.29:0/3488419046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb140b00b0 con 0x7fbb1406b5b0 2024-09-13T18:45:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.134+0000 7fbb1b87d640 1 -- 172.21.15.29:0/3488419046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb140af5f0 con 0x7fbb1406b5b0 2024-09-13T18:45:51.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.135+0000 7fbb09ffb640 1 -- 172.21.15.29:0/3488419046 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbb10013470 con 0x7fbb1406b5b0 2024-09-13T18:45:51.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.135+0000 7fbb09ffb640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbaf806ac30 0x7fbaf806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.135+0000 7fbb09ffb640 1 -- 172.21.15.29:0/3488419046 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbb10089840 con 0x7fbb1406b5b0 2024-09-13T18:45:51.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.135+0000 7fbb18e18640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbaf806ac30 0x7fbaf806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.136+0000 7fbb18e18640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbaf806ac30 0x7fbaf806d0f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbb04007fd0 tx=0x7fbb04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.139+0000 7fbb09ffb640 1 -- 172.21.15.29:0/3488419046 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbb100547c0 con 0x7fbb1406b5b0 2024-09-13T18:45:51.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.310+0000 7fbb1b87d640 1 -- 172.21.15.29:0/3488419046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb140ad420 con 0x7fbb1406b5b0 2024-09-13T18:45:51.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.310+0000 7fbb09ffb640 1 -- 172.21.15.29:0/3488419046 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb10057de0 con 0x7fbb1406b5b0 2024-09-13T18:45:51.313 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-09-13T18:45:51.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.312+0000 7fbb1b87d640 1 -- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbaf806ac30 msgr2=0x7fbaf806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.312+0000 7fbb1b87d640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbaf806ac30 0x7fbaf806d0f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbb04007fd0 tx=0x7fbb04009040 comp rx=0 tx=0).stop 2024-09-13T18:45:51.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.312+0000 7fbb1b87d640 1 -- 172.21.15.29:0/3488419046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb1406b5b0 msgr2=0x7fbb141cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.312+0000 7fbb1b87d640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb1406b5b0 0x7fbb141cdec0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000e9b0 tx=0x7fbb1000ee70 comp rx=0 tx=0).stop 2024-09-13T18:45:51.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.312+0000 7fbb1b87d640 1 -- 172.21.15.29:0/3488419046 shutdown_connections 2024-09-13T18:45:51.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.312+0000 7fbb1b87d640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbaf806ac30 0x7fbaf806d0f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.312+0000 7fbb1b87d640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb14144720 0x7fbb141db9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.312+0000 7fbb1b87d640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb140b7b10 0x7fbb141db4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.312+0000 7fbb1b87d640 1 --2- 172.21.15.29:0/3488419046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb1406b5b0 0x7fbb141cdec0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.312+0000 7fbb1b87d640 1 -- 172.21.15.29:0/3488419046 >> 172.21.15.29:0/3488419046 conn(0x7fbb1406a2f0 msgr2=0x7fbb140acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.312+0000 7fbb1b87d640 1 -- 172.21.15.29:0/3488419046 shutdown_connections 2024-09-13T18:45:51.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.312+0000 7fbb1b87d640 1 -- 172.21.15.29:0/3488419046 wait complete. 2024-09-13T18:45:51.327 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:45:51.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.429+0000 7f87b3472640 1 Processor -- start 2024-09-13T18:45:51.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.429+0000 7f87b3472640 1 -- start start 2024-09-13T18:45:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b3472640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f87ac13f9f0 0x7f87ac06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b3472640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f87ac13fdd0 0x7f87ac071210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b3472640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac071bb0 con 0x7f87ac145920 2024-09-13T18:45:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b3472640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac070b10 con 0x7f87ac13fdd0 2024-09-13T18:45:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b3472640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac06f390 con 0x7f87ac13f9f0 2024-09-13T18:45:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b0a0d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f87ac13fdd0 0x7f87ac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b1a0f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f87ac145920 0x7f87ac148ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54466/0 (socket says 172.21.15.29:54466) 2024-09-13T18:45:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b1a0f640 1 -- 172.21.15.29:0/2528108544 learned_addr learned my addr 172.21.15.29:0/2528108544 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:51.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b120e640 1 --2- 172.21.15.29:0/2528108544 >> v2:172.21.15.96:3300/0 conn(0x7f87ac13f9f0 0x7f87ac06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b0a0d640 1 -- 172.21.15.29:0/2528108544 >> v2:172.21.15.96:3300/0 conn(0x7f87ac13f9f0 msgr2=0x7f87ac06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:51.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b0a0d640 1 --2- 172.21.15.29:0/2528108544 >> v2:172.21.15.96:3300/0 conn(0x7f87ac13f9f0 0x7f87ac06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b0a0d640 1 -- 172.21.15.29:0/2528108544 >> v1:172.21.15.29:6789/0 conn(0x7f87ac145920 legacy=0x7f87ac148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.430+0000 7f87b0a0d640 1 -- 172.21.15.29:0/2528108544 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac06f670 con 0x7f87ac13fdd0 2024-09-13T18:45:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.431+0000 7f87b0a0d640 1 --2- 172.21.15.29:0/2528108544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87ac13fdd0 0x7f87ac071210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0b5690 tx=0x7f879c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c498b7cefbbd33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.431+0000 7f87a3fff640 1 -- 172.21.15.29:0/2528108544 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c02ae60 con 0x7f87ac13fdd0 2024-09-13T18:45:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.431+0000 7f87a3fff640 1 -- 172.21.15.29:0/2528108544 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c032440 con 0x7f87ac13fdd0 2024-09-13T18:45:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.431+0000 7f87a3fff640 1 -- 172.21.15.29:0/2528108544 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0327d0 con 0x7f87ac13fdd0 2024-09-13T18:45:51.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.432+0000 7f87b3472640 1 -- 172.21.15.29:0/2528108544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87ac13fdd0 msgr2=0x7f87ac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.432+0000 7f87b3472640 1 --2- 172.21.15.29:0/2528108544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87ac13fdd0 0x7f87ac071210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0b5690 tx=0x7f879c02a110 comp rx=0 tx=0).stop 2024-09-13T18:45:51.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.432+0000 7f87b3472640 1 -- 172.21.15.29:0/2528108544 shutdown_connections 2024-09-13T18:45:51.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.432+0000 7f87b3472640 1 --2- 172.21.15.29:0/2528108544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87ac13fdd0 0x7f87ac071210 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.432+0000 7f87b3472640 1 --2- 172.21.15.29:0/2528108544 >> v2:172.21.15.96:3300/0 conn(0x7f87ac13f9f0 0x7f87ac06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.432+0000 7f87b3472640 1 -- 172.21.15.29:0/2528108544 >> 172.21.15.29:0/2528108544 conn(0x7f87ac0b4710 msgr2=0x7f87ac0b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.432+0000 7f87b3472640 1 -- 172.21.15.29:0/2528108544 shutdown_connections 2024-09-13T18:45:51.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.432+0000 7f87b3472640 1 -- 172.21.15.29:0/2528108544 wait complete. 2024-09-13T18:45:51.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.433+0000 7f87b3472640 1 Processor -- start 2024-09-13T18:45:51.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.433+0000 7f87b3472640 1 -- start start 2024-09-13T18:45:51.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b3472640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87ac13f9f0 0x7f87ac0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b3472640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f87ac13fdd0 0x7f87ac0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b3472640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87ac145920 0x7f87ac1cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b3472640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0b1590 con 0x7f87ac145920 2024-09-13T18:45:51.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b3472640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac1cc200 con 0x7f87ac13f9f0 2024-09-13T18:45:51.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b3472640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0b17d0 con 0x7f87ac13fdd0 2024-09-13T18:45:51.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b1a0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87ac145920 0x7f87ac1cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b1a0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87ac145920 0x7f87ac1cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41256/0 (socket says 172.21.15.29:41256) 2024-09-13T18:45:51.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b1a0f640 1 -- 172.21.15.29:0/1286464058 learned_addr learned my addr 172.21.15.29:0/1286464058 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:51.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b120e640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87ac13f9f0 0x7f87ac0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b0a0d640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f87ac13fdd0 0x7f87ac0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b1a0f640 1 -- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f87ac13fdd0 msgr2=0x7f87ac0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b1a0f640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f87ac13fdd0 0x7f87ac0b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b1a0f640 1 -- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87ac13f9f0 msgr2=0x7f87ac0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b1a0f640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87ac13f9f0 0x7f87ac0afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b1a0f640 1 -- 172.21.15.29:0/1286464058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c009400 con 0x7f87ac145920 2024-09-13T18:45:51.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b1a0f640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87ac145920 0x7f87ac1cc690 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f87a400cbc0 tx=0x7f87a400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87a1ffb640 1 -- 172.21.15.29:0/1286464058 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400ad40 con 0x7f87ac145920 2024-09-13T18:45:51.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87a1ffb640 1 -- 172.21.15.29:0/1286464058 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4012400 con 0x7f87ac145920 2024-09-13T18:45:51.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87b3472640 1 -- 172.21.15.29:0/1286464058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac0b1ab0 con 0x7f87ac145920 2024-09-13T18:45:51.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.434+0000 7f87a1ffb640 1 -- 172.21.15.29:0/1286464058 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400aea0 con 0x7f87ac145920 2024-09-13T18:45:51.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.435+0000 7f87b3472640 1 -- 172.21.15.29:0/1286464058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac1cbbb0 con 0x7f87ac145920 2024-09-13T18:45:51.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.435+0000 7f87b3472640 1 -- 172.21.15.29:0/1286464058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac0702b0 con 0x7f87ac145920 2024-09-13T18:45:51.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.436+0000 7f87a1ffb640 1 -- 172.21.15.29:0/1286464058 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f87a4007070 con 0x7f87ac145920 2024-09-13T18:45:51.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.436+0000 7f87a1ffb640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f879006ac30 0x7f879006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.436+0000 7f87a1ffb640 1 -- 172.21.15.29:0/1286464058 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f87a4089450 con 0x7f87ac145920 2024-09-13T18:45:51.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.437+0000 7f87b120e640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f879006ac30 0x7f879006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.437+0000 7f87b120e640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f879006ac30 0x7f879006d0f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f87a8006fd0 tx=0x7f87a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.441+0000 7f87a1ffb640 1 -- 172.21.15.29:0/1286464058 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f87a4054480 con 0x7f87ac145920 2024-09-13T18:45:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.610+0000 7f87b3472640 1 -- 172.21.15.29:0/1286464058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87ac145d70 con 0x7f87ac145920 2024-09-13T18:45:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.610+0000 7f87a1ffb640 1 -- 172.21.15.29:0/1286464058 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87a4057aa0 con 0x7f87ac145920 2024-09-13T18:45:51.613 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-13T18:45:51.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.612+0000 7f87b3472640 1 -- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f879006ac30 msgr2=0x7f879006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.612+0000 7f87b3472640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f879006ac30 0x7f879006d0f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f87a8006fd0 tx=0x7f87a8008040 comp rx=0 tx=0).stop 2024-09-13T18:45:51.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.612+0000 7f87b3472640 1 -- 172.21.15.29:0/1286464058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87ac145920 msgr2=0x7f87ac1cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.612+0000 7f87b3472640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87ac145920 0x7f87ac1cc690 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f87a400cbc0 tx=0x7f87a400a430 comp rx=0 tx=0).stop 2024-09-13T18:45:51.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.612+0000 7f87b3472640 1 -- 172.21.15.29:0/1286464058 shutdown_connections 2024-09-13T18:45:51.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.612+0000 7f87b3472640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f879006ac30 0x7f879006d0f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.612+0000 7f87b3472640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87ac145920 0x7f87ac1cc690 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.612+0000 7f87b3472640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f87ac13fdd0 0x7f87ac0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.612+0000 7f87b3472640 1 --2- 172.21.15.29:0/1286464058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87ac13f9f0 0x7f87ac0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.612+0000 7f87b3472640 1 -- 172.21.15.29:0/1286464058 >> 172.21.15.29:0/1286464058 conn(0x7f87ac0b4710 msgr2=0x7f87ac0711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.612+0000 7f87b3472640 1 -- 172.21.15.29:0/1286464058 shutdown_connections 2024-09-13T18:45:51.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.612+0000 7f87b3472640 1 -- 172.21.15.29:0/1286464058 wait complete. 2024-09-13T18:45:51.625 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:45:51.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.728+0000 7fbd1699d640 1 Processor -- start 2024-09-13T18:45:51.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.728+0000 7fbd1699d640 1 -- start start 2024-09-13T18:45:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.728+0000 7fbd1699d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd100b1e80 0x7fbd100b7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd1699d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbd100b42c0 0x7fbd101503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd1699d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd10140270 con 0x7fbd100b3ea0 2024-09-13T18:45:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd1699d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd100b32a0 con 0x7fbd100b42c0 2024-09-13T18:45:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd1699d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd100b4870 con 0x7fbd100b1e80 2024-09-13T18:45:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd1599b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd100b1e80 0x7fbd100b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd1519a640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbd100b3ea0 0x7fbd10149060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:53344/0 (socket says 172.21.15.29:53344) 2024-09-13T18:45:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd1519a640 1 -- 172.21.15.29:0/2144231808 learned_addr learned my addr 172.21.15.29:0/2144231808 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd1619c640 1 --2- 172.21.15.29:0/2144231808 >> v2:172.21.15.96:3300/0 conn(0x7fbd100b42c0 0x7fbd101503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd14999640 1 -- 172.21.15.29:0/2144231808 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249728621 0 0) 0x7fbd10140270 con 0x7fbd100b3ea0 2024-09-13T18:45:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd14999640 1 -- 172.21.15.29:0/2144231808 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcfc003520 con 0x7fbd100b3ea0 2024-09-13T18:45:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd1599b640 1 -- 172.21.15.29:0/2144231808 >> v2:172.21.15.96:3300/0 conn(0x7fbd100b42c0 msgr2=0x7fbd101503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd1599b640 1 --2- 172.21.15.29:0/2144231808 >> v2:172.21.15.96:3300/0 conn(0x7fbd100b42c0 0x7fbd101503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd1599b640 1 -- 172.21.15.29:0/2144231808 >> v1:172.21.15.96:6789/0 conn(0x7fbd100b3ea0 legacy=0x7fbd10149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.729+0000 7fbd1599b640 1 -- 172.21.15.29:0/2144231808 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd100b2260 con 0x7fbd100b1e80 2024-09-13T18:45:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.730+0000 7fbd1599b640 1 --2- 172.21.15.29:0/2144231808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd100b1e80 0x7fbd100b7040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0097a0 tx=0x7fbd0c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=968b9e3876550bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.730+0000 7fbd14999640 1 -- 172.21.15.29:0/2144231808 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c02ae50 con 0x7fbd100b1e80 2024-09-13T18:45:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.730+0000 7fbd14999640 1 -- 172.21.15.29:0/2144231808 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c032440 con 0x7fbd100b1e80 2024-09-13T18:45:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.730+0000 7fbd14999640 1 -- 172.21.15.29:0/2144231808 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0327d0 con 0x7fbd100b1e80 2024-09-13T18:45:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.731+0000 7fbd1699d640 1 -- 172.21.15.29:0/2144231808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd100b1e80 msgr2=0x7fbd100b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.731+0000 7fbd1699d640 1 --2- 172.21.15.29:0/2144231808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd100b1e80 0x7fbd100b7040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0097a0 tx=0x7fbd0c02a100 comp rx=0 tx=0).stop 2024-09-13T18:45:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.731+0000 7fbd1699d640 1 -- 172.21.15.29:0/2144231808 shutdown_connections 2024-09-13T18:45:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.731+0000 7fbd1699d640 1 --2- 172.21.15.29:0/2144231808 >> v2:172.21.15.96:3300/0 conn(0x7fbd100b42c0 0x7fbd101503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.731+0000 7fbd1699d640 1 --2- 172.21.15.29:0/2144231808 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd100b1e80 0x7fbd100b7040 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.731+0000 7fbd1699d640 1 -- 172.21.15.29:0/2144231808 >> 172.21.15.29:0/2144231808 conn(0x7fbd100b7d70 msgr2=0x7fbd100b8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.731+0000 7fbd1699d640 1 -- 172.21.15.29:0/2144231808 shutdown_connections 2024-09-13T18:45:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.731+0000 7fbd1699d640 1 -- 172.21.15.29:0/2144231808 wait complete. 2024-09-13T18:45:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.732+0000 7fbd1699d640 1 Processor -- start 2024-09-13T18:45:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.732+0000 7fbd1699d640 1 -- start start 2024-09-13T18:45:51.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1699d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100b1e80 0x7fbd10143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1699d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd100b3ea0 0x7fbd101de840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1699d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd100b42c0 0x7fbd101df070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1699d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd101d06a0 con 0x7fbd100b1e80 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1699d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd101cf040 con 0x7fbd100b3ea0 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1699d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd101d1390 con 0x7fbd100b42c0 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1599b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100b1e80 0x7fbd10143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1599b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100b1e80 0x7fbd10143940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41268/0 (socket says 172.21.15.29:41268) 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1599b640 1 -- 172.21.15.29:0/1312212794 learned_addr learned my addr 172.21.15.29:0/1312212794 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1519a640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd100b3ea0 0x7fbd101de840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1619c640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd100b42c0 0x7fbd101df070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1599b640 1 -- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd100b42c0 msgr2=0x7fbd101df070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1599b640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd100b42c0 0x7fbd101df070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1599b640 1 -- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd100b3ea0 msgr2=0x7fbd101de840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1599b640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd100b3ea0 0x7fbd101de840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1599b640 1 -- 172.21.15.29:0/1312212794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c009400 con 0x7fbd100b1e80 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1599b640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100b1e80 0x7fbd10143940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0098c0 tx=0x7fbd0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd027fc640 1 -- 172.21.15.29:0/1312212794 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c03d710 con 0x7fbd100b1e80 2024-09-13T18:45:51.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd027fc640 1 -- 172.21.15.29:0/1312212794 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c03d890 con 0x7fbd100b1e80 2024-09-13T18:45:51.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.733+0000 7fbd1699d640 1 -- 172.21.15.29:0/1312212794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd101d03c0 con 0x7fbd100b1e80 2024-09-13T18:45:51.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.734+0000 7fbd027fc640 1 -- 172.21.15.29:0/1312212794 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c03dc40 con 0x7fbd100b1e80 2024-09-13T18:45:51.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.734+0000 7fbd1699d640 1 -- 172.21.15.29:0/1312212794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd101d0eb0 con 0x7fbd100b1e80 2024-09-13T18:45:51.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.735+0000 7fbd1699d640 1 -- 172.21.15.29:0/1312212794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd101d1160 con 0x7fbd100b1e80 2024-09-13T18:45:51.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.735+0000 7fbd027fc640 1 -- 172.21.15.29:0/1312212794 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbd0c039040 con 0x7fbd100b1e80 2024-09-13T18:45:51.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.736+0000 7fbd027fc640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbcf406ac30 0x7fbcf406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.736+0000 7fbd027fc640 1 -- 172.21.15.29:0/1312212794 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd0c0a9e10 con 0x7fbd100b1e80 2024-09-13T18:45:51.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.736+0000 7fbd1519a640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbcf406ac30 0x7fbcf406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.736+0000 7fbd1519a640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbcf406ac30 0x7fbcf406d0f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbd10139b60 tx=0x7fbd04007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.740+0000 7fbd027fc640 1 -- 172.21.15.29:0/1312212794 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbd0c074ee0 con 0x7fbd100b1e80 2024-09-13T18:45:51.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.910+0000 7fbd1699d640 1 -- 172.21.15.29:0/1312212794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd101cee80 con 0x7fbd100b1e80 2024-09-13T18:45:51.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.911+0000 7fbd027fc640 1 -- 172.21.15.29:0/1312212794 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd0c037020 con 0x7fbd100b1e80 2024-09-13T18:45:51.914 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-09-13T18:45:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.913+0000 7fbd1699d640 1 -- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbcf406ac30 msgr2=0x7fbcf406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.913+0000 7fbd1699d640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbcf406ac30 0x7fbcf406d0f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbd10139b60 tx=0x7fbd04007d30 comp rx=0 tx=0).stop 2024-09-13T18:45:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.913+0000 7fbd1699d640 1 -- 172.21.15.29:0/1312212794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100b1e80 msgr2=0x7fbd10143940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.913+0000 7fbd1699d640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100b1e80 0x7fbd10143940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0098c0 tx=0x7fbd0c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.913+0000 7fbd1699d640 1 -- 172.21.15.29:0/1312212794 shutdown_connections 2024-09-13T18:45:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.913+0000 7fbd1699d640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbcf406ac30 0x7fbcf406d0f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.913+0000 7fbd1699d640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd100b42c0 0x7fbd101df070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.913+0000 7fbd1699d640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd100b3ea0 0x7fbd101de840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.913+0000 7fbd1699d640 1 --2- 172.21.15.29:0/1312212794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100b1e80 0x7fbd10143940 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.913+0000 7fbd1699d640 1 -- 172.21.15.29:0/1312212794 >> 172.21.15.29:0/1312212794 conn(0x7fbd100b7d70 msgr2=0x7fbd100bb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.913+0000 7fbd1699d640 1 -- 172.21.15.29:0/1312212794 shutdown_connections 2024-09-13T18:45:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:51.913+0000 7fbd1699d640 1 -- 172.21.15.29:0/1312212794 wait complete. 2024-09-13T18:45:51.926 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:45:52.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.028+0000 7f06ece19640 1 Processor -- start 2024-09-13T18:45:52.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.028+0000 7f06ece19640 1 -- start start 2024-09-13T18:45:52.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.029+0000 7f06ece19640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06e80b44b0 0x7f06e81462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.029+0000 7f06ece19640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f06e80b3320 0x7f06e813fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.029+0000 7f06ece19640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e80b3880 con 0x7f06e80b5f50 2024-09-13T18:45:52.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.029+0000 7f06ece19640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e80b5580 con 0x7f06e80b3320 2024-09-13T18:45:52.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.029+0000 7f06ece19640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e80b4890 con 0x7f06e80b44b0 2024-09-13T18:45:52.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.029+0000 7f06e6d9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f06e80b3320 0x7f06e813fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.029+0000 7f06e6d9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f06e80b3320 0x7f06e813fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41270/0 (socket says 172.21.15.29:41270) 2024-09-13T18:45:52.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.029+0000 7f06e6d9d640 1 -- 172.21.15.29:0/3779702794 learned_addr learned my addr 172.21.15.29:0/3779702794 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:52.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.029+0000 7f06e659c640 1 --2- 172.21.15.29:0/3779702794 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06e80b44b0 0x7f06e81462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.029+0000 7f06e6d9d640 1 -- 172.21.15.29:0/3779702794 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06e80b44b0 msgr2=0x7f06e81462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:52.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.029+0000 7f06e6d9d640 1 --2- 172.21.15.29:0/3779702794 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06e80b44b0 0x7f06e81462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.030+0000 7f06e6d9d640 1 -- 172.21.15.29:0/3779702794 >> v1:172.21.15.96:6789/0 conn(0x7f06e80b5f50 legacy=0x7f06e813f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.030+0000 7f06e6d9d640 1 -- 172.21.15.29:0/3779702794 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e80b57f0 con 0x7f06e80b3320 2024-09-13T18:45:52.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.030+0000 7f06e6d9d640 1 --2- 172.21.15.29:0/3779702794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06e80b3320 0x7f06e813fd00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009e50 tx=0x7f06e002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0647ee72a004a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.030+0000 7f06e559a640 1 -- 172.21.15.29:0/3779702794 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0031600 con 0x7f06e80b3320 2024-09-13T18:45:52.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.030+0000 7f06e559a640 1 -- 172.21.15.29:0/3779702794 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e002d050 con 0x7f06e80b3320 2024-09-13T18:45:52.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.030+0000 7f06e559a640 1 -- 172.21.15.29:0/3779702794 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0031980 con 0x7f06e80b3320 2024-09-13T18:45:52.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.031+0000 7f06ece19640 1 -- 172.21.15.29:0/3779702794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06e80b3320 msgr2=0x7f06e813fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.031+0000 7f06ece19640 1 --2- 172.21.15.29:0/3779702794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06e80b3320 0x7f06e813fd00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009e50 tx=0x7f06e002a710 comp rx=0 tx=0).stop 2024-09-13T18:45:52.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.031+0000 7f06ece19640 1 -- 172.21.15.29:0/3779702794 shutdown_connections 2024-09-13T18:45:52.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.031+0000 7f06ece19640 1 --2- 172.21.15.29:0/3779702794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06e80b3320 0x7f06e813fd00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.031+0000 7f06ece19640 1 --2- 172.21.15.29:0/3779702794 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06e80b44b0 0x7f06e81462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.031+0000 7f06ece19640 1 -- 172.21.15.29:0/3779702794 >> 172.21.15.29:0/3779702794 conn(0x7f06e80b8050 msgr2=0x7f06e80b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:52.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.031+0000 7f06ece19640 1 -- 172.21.15.29:0/3779702794 shutdown_connections 2024-09-13T18:45:52.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.031+0000 7f06ece19640 1 -- 172.21.15.29:0/3779702794 wait complete. 2024-09-13T18:45:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.032+0000 7f06ece19640 1 Processor -- start 2024-09-13T18:45:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.033+0000 7f06ece19640 1 -- start start 2024-09-13T18:45:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.033+0000 7f06ece19640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06e80b3320 0x7f06e8137130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.033+0000 7f06ece19640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06e80b44b0 0x7f06e8132600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.033+0000 7f06ece19640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06e80b5f50 0x7f06e81defd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.033+0000 7f06ece19640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e81de860 con 0x7f06e80b3320 2024-09-13T18:45:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.033+0000 7f06ece19640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e81dc290 con 0x7f06e80b5f50 2024-09-13T18:45:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.033+0000 7f06ece19640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e8132f80 con 0x7f06e80b44b0 2024-09-13T18:45:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.033+0000 7f06e659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06e80b3320 0x7f06e8137130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.033+0000 7f06e659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06e80b3320 0x7f06e8137130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41278/0 (socket says 172.21.15.29:41278) 2024-09-13T18:45:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.033+0000 7f06e659c640 1 -- 172.21.15.29:0/1885715596 learned_addr learned my addr 172.21.15.29:0/1885715596 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.033+0000 7f06e659c640 1 -- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06e80b44b0 msgr2=0x7f06e8132600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.034+0000 7f06e659c640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06e80b44b0 0x7f06e8132600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.034+0000 7f06e659c640 1 -- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06e80b5f50 msgr2=0x7f06e81defd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.034+0000 7f06e6d9d640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06e80b5f50 0x7f06e81defd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.034+0000 7f06e659c640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06e80b5f50 0x7f06e81defd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.034+0000 7f06e659c640 1 -- 172.21.15.29:0/1885715596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e0009b30 con 0x7f06e80b3320 2024-09-13T18:45:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.034+0000 7f06e6d9d640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06e80b5f50 0x7f06e81defd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.034+0000 7f06e659c640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06e80b3320 0x7f06e8137130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f06d800e9b0 tx=0x7f06d800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.034+0000 7f06d6ffd640 1 -- 172.21.15.29:0/1885715596 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d800c9a0 con 0x7f06e80b3320 2024-09-13T18:45:52.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.034+0000 7f06d6ffd640 1 -- 172.21.15.29:0/1885715596 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d800cb00 con 0x7f06e80b3320 2024-09-13T18:45:52.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.034+0000 7f06d6ffd640 1 -- 172.21.15.29:0/1885715596 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8013470 con 0x7f06e80b3320 2024-09-13T18:45:52.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.034+0000 7f06ece19640 1 -- 172.21.15.29:0/1885715596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e81deab0 con 0x7f06e80b3320 2024-09-13T18:45:52.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.034+0000 7f06ece19640 1 -- 172.21.15.29:0/1885715596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e81ccac0 con 0x7f06e80b3320 2024-09-13T18:45:52.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.035+0000 7f06ece19640 1 -- 172.21.15.29:0/1885715596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e81331a0 con 0x7f06e80b3320 2024-09-13T18:45:52.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.035+0000 7f06d6ffd640 1 -- 172.21.15.29:0/1885715596 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f06d80135d0 con 0x7f06e80b3320 2024-09-13T18:45:52.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.036+0000 7f06d6ffd640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f06c806ac00 0x7f06c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.036+0000 7f06d6ffd640 1 -- 172.21.15.29:0/1885715596 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f06d80898a0 con 0x7f06e80b3320 2024-09-13T18:45:52.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.036+0000 7f06e5d9b640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f06c806ac00 0x7f06c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.037+0000 7f06e5d9b640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f06c806ac00 0x7f06c806d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f06e8134100 tx=0x7f06dc007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.040+0000 7f06d6ffd640 1 -- 172.21.15.29:0/1885715596 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f06d8054790 con 0x7f06e80b3320 2024-09-13T18:45:52.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.210+0000 7f06ece19640 1 -- 172.21.15.29:0/1885715596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f06e81462e0 con 0x7f06e80b3320 2024-09-13T18:45:52.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.210+0000 7f06d6ffd640 1 -- 172.21.15.29:0/1885715596 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f06d8057db0 con 0x7f06e80b3320 2024-09-13T18:45:52.213 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-13T18:45:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.212+0000 7f06ece19640 1 -- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f06c806ac00 msgr2=0x7f06c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.212+0000 7f06ece19640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f06c806ac00 0x7f06c806d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f06e8134100 tx=0x7f06dc007990 comp rx=0 tx=0).stop 2024-09-13T18:45:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.212+0000 7f06ece19640 1 -- 172.21.15.29:0/1885715596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06e80b3320 msgr2=0x7f06e8137130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.212+0000 7f06ece19640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06e80b3320 0x7f06e8137130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f06d800e9b0 tx=0x7f06d800ee70 comp rx=0 tx=0).stop 2024-09-13T18:45:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.212+0000 7f06ece19640 1 -- 172.21.15.29:0/1885715596 shutdown_connections 2024-09-13T18:45:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.212+0000 7f06ece19640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f06c806ac00 0x7f06c806d0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.212+0000 7f06ece19640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06e80b5f50 0x7f06e81defd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.212+0000 7f06ece19640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06e80b44b0 0x7f06e8132600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.212+0000 7f06ece19640 1 --2- 172.21.15.29:0/1885715596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06e80b3320 0x7f06e8137130 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.212+0000 7f06ece19640 1 -- 172.21.15.29:0/1885715596 >> 172.21.15.29:0/1885715596 conn(0x7f06e80b8050 msgr2=0x7f06e813f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:52.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.212+0000 7f06ece19640 1 -- 172.21.15.29:0/1885715596 shutdown_connections 2024-09-13T18:45:52.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.212+0000 7f06ece19640 1 -- 172.21.15.29:0/1885715596 wait complete. 2024-09-13T18:45:52.226 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:52.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.324+0000 7fe985f83640 1 Processor -- start 2024-09-13T18:45:52.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.325+0000 7fe985f83640 1 -- start start 2024-09-13T18:45:52.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.325+0000 7fe985f83640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe9800b9e20 0x7fe98013f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.325+0000 7fe985f83640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9800b4fa0 0x7fe98013fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.325+0000 7fe985f83640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9800b45a0 con 0x7fe9800b5930 2024-09-13T18:45:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.325+0000 7fe985f83640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98006b500 con 0x7fe9800b9e20 2024-09-13T18:45:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.325+0000 7fe985f83640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98006c1d0 con 0x7fe9800b4fa0 2024-09-13T18:45:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.325+0000 7fe97f7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe9800b9e20 0x7fe98013f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.325+0000 7fe97ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe9800b5930 0x7fe98006c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54474/0 (socket says 172.21.15.29:54474) 2024-09-13T18:45:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.325+0000 7fe97ffff640 1 -- 172.21.15.29:0/2130605224 learned_addr learned my addr 172.21.15.29:0/2130605224 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.326+0000 7fe97effd640 1 --2- 172.21.15.29:0/2130605224 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9800b4fa0 0x7fe98013fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.326+0000 7fe97f7fe640 1 -- 172.21.15.29:0/2130605224 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9800b4fa0 msgr2=0x7fe98013fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.326+0000 7fe97f7fe640 1 --2- 172.21.15.29:0/2130605224 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9800b4fa0 0x7fe98013fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.326+0000 7fe97f7fe640 1 -- 172.21.15.29:0/2130605224 >> v1:172.21.15.29:6789/0 conn(0x7fe9800b5930 legacy=0x7fe98006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.326+0000 7fe97f7fe640 1 -- 172.21.15.29:0/2130605224 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9800ba200 con 0x7fe9800b9e20 2024-09-13T18:45:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.326+0000 7fe97e7fc640 1 -- 172.21.15.29:0/2130605224 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769944635 0 0) 0x7fe9800b45a0 con 0x7fe9800b5930 2024-09-13T18:45:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.326+0000 7fe97f7fe640 1 --2- 172.21.15.29:0/2130605224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9800b9e20 0x7fe98013f9b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe9700097a0 tx=0x7fe97002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5a4ee22879762e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.327+0000 7fe97e7fc640 1 -- 172.21.15.29:0/2130605224 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97002ae50 con 0x7fe9800b9e20 2024-09-13T18:45:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.327+0000 7fe97e7fc640 1 -- 172.21.15.29:0/2130605224 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe970032440 con 0x7fe9800b9e20 2024-09-13T18:45:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.327+0000 7fe97e7fc640 1 -- 172.21.15.29:0/2130605224 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9700327d0 con 0x7fe9800b9e20 2024-09-13T18:45:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.327+0000 7fe985f83640 1 -- 172.21.15.29:0/2130605224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9800b9e20 msgr2=0x7fe98013f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.327+0000 7fe985f83640 1 --2- 172.21.15.29:0/2130605224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9800b9e20 0x7fe98013f9b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe9700097a0 tx=0x7fe97002a100 comp rx=0 tx=0).stop 2024-09-13T18:45:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.327+0000 7fe985f83640 1 -- 172.21.15.29:0/2130605224 shutdown_connections 2024-09-13T18:45:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.327+0000 7fe985f83640 1 --2- 172.21.15.29:0/2130605224 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9800b4fa0 0x7fe98013fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.327+0000 7fe985f83640 1 --2- 172.21.15.29:0/2130605224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9800b9e20 0x7fe98013f9b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.327+0000 7fe985f83640 1 -- 172.21.15.29:0/2130605224 >> 172.21.15.29:0/2130605224 conn(0x7fe98006a5c0 msgr2=0x7fe9800b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.327+0000 7fe985f83640 1 -- 172.21.15.29:0/2130605224 shutdown_connections 2024-09-13T18:45:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.327+0000 7fe985f83640 1 -- 172.21.15.29:0/2130605224 wait complete. 2024-09-13T18:45:52.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.328+0000 7fe985f83640 1 Processor -- start 2024-09-13T18:45:52.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.329+0000 7fe985f83640 1 -- start start 2024-09-13T18:45:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.329+0000 7fe985f83640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9800b4fa0 0x7fe980142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.329+0000 7fe985f83640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9800b5930 0x7fe9801db220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.329+0000 7fe985f83640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9800b9e20 0x7fe9801db760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.329+0000 7fe985f83640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9800abdd0 con 0x7fe9800b9e20 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.329+0000 7fe985f83640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9801dad60 con 0x7fe9800b5930 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.329+0000 7fe985f83640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9800ac020 con 0x7fe9800b4fa0 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.329+0000 7fe97ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9800b9e20 0x7fe9801db760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.329+0000 7fe97ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9800b9e20 0x7fe9801db760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41300/0 (socket says 172.21.15.29:41300) 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.329+0000 7fe97ffff640 1 -- 172.21.15.29:0/895202422 learned_addr learned my addr 172.21.15.29:0/895202422 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.329+0000 7fe97effd640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9800b5930 0x7fe9801db220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.329+0000 7fe97f7fe640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9800b4fa0 0x7fe980142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe97ffff640 1 -- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9800b4fa0 msgr2=0x7fe980142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe97ffff640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9800b4fa0 0x7fe980142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe97ffff640 1 -- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9800b5930 msgr2=0x7fe9801db220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe97ffff640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9800b5930 0x7fe9801db220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe97ffff640 1 -- 172.21.15.29:0/895202422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe970009400 con 0x7fe9800b9e20 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe97effd640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9800b5930 0x7fe9801db220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe97f7fe640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9800b4fa0 0x7fe980142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe97ffff640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9800b9e20 0x7fe9801db760 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe97800c7e0 tx=0x7fe97800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe967fff640 1 -- 172.21.15.29:0/895202422 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97800a640 con 0x7fe9800b9e20 2024-09-13T18:45:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe967fff640 1 -- 172.21.15.29:0/895202422 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97800a7a0 con 0x7fe9800b9e20 2024-09-13T18:45:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe985f83640 1 -- 172.21.15.29:0/895202422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9800ac300 con 0x7fe9800b9e20 2024-09-13T18:45:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe967fff640 1 -- 172.21.15.29:0/895202422 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97800ab30 con 0x7fe9800b9e20 2024-09-13T18:45:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.330+0000 7fe985f83640 1 -- 172.21.15.29:0/895202422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98013d0d0 con 0x7fe9800b9e20 2024-09-13T18:45:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.331+0000 7fe985f83640 1 -- 172.21.15.29:0/895202422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98006c5f0 con 0x7fe9800b9e20 2024-09-13T18:45:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.331+0000 7fe967fff640 1 -- 172.21.15.29:0/895202422 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe97800ac90 con 0x7fe9800b9e20 2024-09-13T18:45:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.332+0000 7fe967fff640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe96c06ac00 0x7fe96c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.332+0000 7fe967fff640 1 -- 172.21.15.29:0/895202422 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe978088a40 con 0x7fe9800b9e20 2024-09-13T18:45:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.332+0000 7fe97f7fe640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe96c06ac00 0x7fe96c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.332+0000 7fe97f7fe640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe96c06ac00 0x7fe96c06d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe970034000 tx=0x7fe97002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.336+0000 7fe967fff640 1 -- 172.21.15.29:0/895202422 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe97808ae60 con 0x7fe9800b9e20 2024-09-13T18:45:52.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.543+0000 7fe985f83640 1 -- 172.21.15.29:0/895202422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe980144eb0 con 0x7fe9800b9e20 2024-09-13T18:45:52.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.544+0000 7fe967fff640 1 -- 172.21.15.29:0/895202422 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3215 (secure 0 0 0) 0x7fe978018020 con 0x7fe9800b9e20 2024-09-13T18:45:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:52.547 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/3867151553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3867151553},{"type":"v1","addr":"172.21.15.96:6835","nonce":3867151553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:22.006847+0000","modified":"2024-09-13T18:45:43.067420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6833/175129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":175129703},{"type":"v1","addr":"172.21.15.29:6833","nonce":175129703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:45:52.547 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-09-13T18:45:52.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.546+0000 7fe985f83640 1 -- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe96c06ac00 msgr2=0x7fe96c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.546+0000 7fe985f83640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe96c06ac00 0x7fe96c06d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe970034000 tx=0x7fe97002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:52.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.546+0000 7fe985f83640 1 -- 172.21.15.29:0/895202422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9800b9e20 msgr2=0x7fe9801db760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.546+0000 7fe985f83640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9800b9e20 0x7fe9801db760 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe97800c7e0 tx=0x7fe97800cca0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.546+0000 7fe985f83640 1 -- 172.21.15.29:0/895202422 shutdown_connections 2024-09-13T18:45:52.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.546+0000 7fe985f83640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe96c06ac00 0x7fe96c06d0c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.546+0000 7fe985f83640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9800b9e20 0x7fe9801db760 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.546+0000 7fe985f83640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9800b5930 0x7fe9801db220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.546+0000 7fe985f83640 1 --2- 172.21.15.29:0/895202422 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9800b4fa0 0x7fe980142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.546+0000 7fe985f83640 1 -- 172.21.15.29:0/895202422 >> 172.21.15.29:0/895202422 conn(0x7fe98006a5c0 msgr2=0x7fe980144540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:52.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.546+0000 7fe985f83640 1 -- 172.21.15.29:0/895202422 shutdown_connections 2024-09-13T18:45:52.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.546+0000 7fe985f83640 1 -- 172.21.15.29:0/895202422 wait complete. 2024-09-13T18:45:52.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:52.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.659+0000 7f64c6701640 1 Processor -- start 2024-09-13T18:45:52.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.659+0000 7f64c6701640 1 -- start start 2024-09-13T18:45:52.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64c6701640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64c00b35b0 0x7f64c01498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64c6701640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c013f8e0 0x7f64c013fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64c6701640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c0149410 con 0x7f64c00b31d0 2024-09-13T18:45:52.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64c6701640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c0140290 con 0x7f64c00b35b0 2024-09-13T18:45:52.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64c6701640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00b4810 con 0x7f64c013f8e0 2024-09-13T18:45:52.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64bf7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64c00b35b0 0x7f64c01498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64bf7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64c00b35b0 0x7f64c01498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41308/0 (socket says 172.21.15.29:41308) 2024-09-13T18:45:52.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64bf7fe640 1 -- 172.21.15.29:0/3594322991 learned_addr learned my addr 172.21.15.29:0/3594322991 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:52.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64c4c9e640 1 --2- 172.21.15.29:0/3594322991 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c013f8e0 0x7f64c013fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64bf7fe640 1 -- 172.21.15.29:0/3594322991 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c013f8e0 msgr2=0x7f64c013fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:52.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64bf7fe640 1 --2- 172.21.15.29:0/3594322991 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c013f8e0 0x7f64c013fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64bf7fe640 1 -- 172.21.15.29:0/3594322991 >> v1:172.21.15.96:6789/0 conn(0x7f64c00b31d0 legacy=0x7f64c00b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.660+0000 7f64bf7fe640 1 -- 172.21.15.29:0/3594322991 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c01490a0 con 0x7f64c00b35b0 2024-09-13T18:45:52.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.661+0000 7f64bf7fe640 1 --2- 172.21.15.29:0/3594322991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c00b35b0 0x7f64c01498a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009870 tx=0x7f64b402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7a2a3414e97eed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.661+0000 7f64beffd640 1 -- 172.21.15.29:0/3594322991 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4032440 con 0x7f64c00b35b0 2024-09-13T18:45:52.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.661+0000 7f64beffd640 1 -- 172.21.15.29:0/3594322991 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b40325a0 con 0x7f64c00b35b0 2024-09-13T18:45:52.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.661+0000 7f64beffd640 1 -- 172.21.15.29:0/3594322991 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4032930 con 0x7f64c00b35b0 2024-09-13T18:45:52.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.662+0000 7f64c6701640 1 -- 172.21.15.29:0/3594322991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c00b35b0 msgr2=0x7f64c01498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.662+0000 7f64c6701640 1 --2- 172.21.15.29:0/3594322991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c00b35b0 0x7f64c01498a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009870 tx=0x7f64b402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.662+0000 7f64c6701640 1 -- 172.21.15.29:0/3594322991 shutdown_connections 2024-09-13T18:45:52.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.662+0000 7f64c6701640 1 --2- 172.21.15.29:0/3594322991 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c013f8e0 0x7f64c013fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.662+0000 7f64c6701640 1 --2- 172.21.15.29:0/3594322991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c00b35b0 0x7f64c01498a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.662+0000 7f64c6701640 1 -- 172.21.15.29:0/3594322991 >> 172.21.15.29:0/3594322991 conn(0x7f64c00bb590 msgr2=0x7f64c00bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:52.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.662+0000 7f64c6701640 1 -- 172.21.15.29:0/3594322991 shutdown_connections 2024-09-13T18:45:52.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.662+0000 7f64c6701640 1 -- 172.21.15.29:0/3594322991 wait complete. 2024-09-13T18:45:52.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.663+0000 7f64c6701640 1 Processor -- start 2024-09-13T18:45:52.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.663+0000 7f64c6701640 1 -- start start 2024-09-13T18:45:52.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.663+0000 7f64c6701640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c00b31d0 0x7f64c0143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.663+0000 7f64c6701640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c00b35b0 0x7f64c00b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.663+0000 7f64c6701640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64c013f8e0 0x7f64c00b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.663+0000 7f64c6701640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00a8a00 con 0x7f64c00b31d0 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.663+0000 7f64c6701640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00b1c20 con 0x7f64c013f8e0 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.663+0000 7f64c6701640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c0143890 con 0x7f64c00b35b0 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c00b31d0 0x7f64c0143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c00b31d0 0x7f64c0143350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41320/0 (socket says 172.21.15.29:41320) 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bffff640 1 -- 172.21.15.29:0/2906599113 learned_addr learned my addr 172.21.15.29:0/2906599113 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64c4c9e640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64c013f8e0 0x7f64c00b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bf7fe640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c00b35b0 0x7f64c00b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bffff640 1 -- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c00b35b0 msgr2=0x7f64c00b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bffff640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c00b35b0 0x7f64c00b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bffff640 1 -- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64c013f8e0 msgr2=0x7f64c00b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bffff640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64c013f8e0 0x7f64c00b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bffff640 1 -- 172.21.15.29:0/2906599113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40094d0 con 0x7f64c00b31d0 2024-09-13T18:45:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bffff640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c00b31d0 0x7f64c0143350 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f64b000c450 tx=0x7f64b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bcff9640 1 -- 172.21.15.29:0/2906599113 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b00052d0 con 0x7f64c00b31d0 2024-09-13T18:45:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bcff9640 1 -- 172.21.15.29:0/2906599113 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b0005430 con 0x7f64c00b31d0 2024-09-13T18:45:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64c6701640 1 -- 172.21.15.29:0/2906599113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c00a9c10 con 0x7f64c00b31d0 2024-09-13T18:45:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64bcff9640 1 -- 172.21.15.29:0/2906599113 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0012870 con 0x7f64c00b31d0 2024-09-13T18:45:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.664+0000 7f64c6701640 1 -- 172.21.15.29:0/2906599113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c00a82d0 con 0x7f64c00b31d0 2024-09-13T18:45:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.665+0000 7f64c6701640 1 -- 172.21.15.29:0/2906599113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c0067300 con 0x7f64c00b31d0 2024-09-13T18:45:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.666+0000 7f64bcff9640 1 -- 172.21.15.29:0/2906599113 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f64b00129d0 con 0x7f64c00b31d0 2024-09-13T18:45:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.666+0000 7f64bcff9640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f64ac06ac00 0x7f64ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.666+0000 7f64bcff9640 1 -- 172.21.15.29:0/2906599113 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64b0088fd0 con 0x7f64c00b31d0 2024-09-13T18:45:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.666+0000 7f64bf7fe640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f64ac06ac00 0x7f64ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.667+0000 7f64bf7fe640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f64ac06ac00 0x7f64ac06d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f64b4034000 tx=0x7f64b402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.670+0000 7f64bcff9640 1 -- 172.21.15.29:0/2906599113 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f64b0054000 con 0x7f64c00b31d0 2024-09-13T18:45:52.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.844+0000 7f64c6701640 1 -- 172.21.15.29:0/2906599113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64c00a8730 con 0x7f64c00b31d0 2024-09-13T18:45:52.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.845+0000 7f64bcff9640 1 -- 172.21.15.29:0/2906599113 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7f64b0057620 con 0x7f64c00b31d0 2024-09-13T18:45:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:52.848 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:52.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.847+0000 7f64c6701640 1 -- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f64ac06ac00 msgr2=0x7f64ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.847+0000 7f64c6701640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f64ac06ac00 0x7f64ac06d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f64b4034000 tx=0x7f64b402e000 comp rx=0 tx=0).stop 2024-09-13T18:45:52.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.847+0000 7f64c6701640 1 -- 172.21.15.29:0/2906599113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c00b31d0 msgr2=0x7f64c0143350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.847+0000 7f64c6701640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c00b31d0 0x7f64c0143350 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f64b000c450 tx=0x7f64b000c910 comp rx=0 tx=0).stop 2024-09-13T18:45:52.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.847+0000 7f64c6701640 1 -- 172.21.15.29:0/2906599113 shutdown_connections 2024-09-13T18:45:52.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.847+0000 7f64c6701640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f64ac06ac00 0x7f64ac06d0c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.847+0000 7f64c6701640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64c013f8e0 0x7f64c00b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.847+0000 7f64c6701640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c00b35b0 0x7f64c00b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.847+0000 7f64c6701640 1 --2- 172.21.15.29:0/2906599113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c00b31d0 0x7f64c0143350 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.847+0000 7f64c6701640 1 -- 172.21.15.29:0/2906599113 >> 172.21.15.29:0/2906599113 conn(0x7f64c00bb590 msgr2=0x7f64c013eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:52.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.847+0000 7f64c6701640 1 -- 172.21.15.29:0/2906599113 shutdown_connections 2024-09-13T18:45:52.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.847+0000 7f64c6701640 1 -- 172.21.15.29:0/2906599113 wait complete. 2024-09-13T18:45:52.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:45:17.630827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:45:20.113248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:20.978194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:24.059966+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:45:52.861 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.963+0000 7efe54853640 1 Processor -- start 2024-09-13T18:45:52.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.963+0000 7efe54853640 1 -- start start 2024-09-13T18:45:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe54853640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe500b7b10 0x7efe500b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe54853640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efe50144720 0x7efe5014e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe54853640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe500b3ce0 con 0x7efe5006b5b0 2024-09-13T18:45:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe54853640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5006c4e0 con 0x7efe50144720 2024-09-13T18:45:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe54853640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe500b6930 con 0x7efe500b7b10 2024-09-13T18:45:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe4e59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe500b7b10 0x7efe500b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe4ed9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efe50144720 0x7efe5014e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe4e59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe500b7b10 0x7efe500b55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:44636/0 (socket says 172.21.15.29:44636) 2024-09-13T18:45:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe4e59c640 1 -- 172.21.15.29:0/2307149897 learned_addr learned my addr 172.21.15.29:0/2307149897 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:52.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe4e59c640 1 -- 172.21.15.29:0/2307149897 >> v2:172.21.15.96:3300/0 conn(0x7efe50144720 msgr2=0x7efe5014e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:52.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe4e59c640 1 --2- 172.21.15.29:0/2307149897 >> v2:172.21.15.96:3300/0 conn(0x7efe50144720 0x7efe5014e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe4e59c640 1 -- 172.21.15.29:0/2307149897 >> v1:172.21.15.96:6789/0 conn(0x7efe5006b5b0 legacy=0x7efe50144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.964+0000 7efe4e59c640 1 -- 172.21.15.29:0/2307149897 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe500b66c0 con 0x7efe500b7b10 2024-09-13T18:45:52.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.965+0000 7efe4e59c640 1 --2- 172.21.15.29:0/2307149897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe500b7b10 0x7efe500b55f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe40009870 tx=0x7efe4002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b8435a93badadc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.965+0000 7efe4dd9b640 1 -- 172.21.15.29:0/2307149897 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4002ae80 con 0x7efe500b7b10 2024-09-13T18:45:52.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.965+0000 7efe4dd9b640 1 -- 172.21.15.29:0/2307149897 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe40032440 con 0x7efe500b7b10 2024-09-13T18:45:52.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.965+0000 7efe4dd9b640 1 -- 172.21.15.29:0/2307149897 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe400327b0 con 0x7efe500b7b10 2024-09-13T18:45:52.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.966+0000 7efe54853640 1 -- 172.21.15.29:0/2307149897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe500b7b10 msgr2=0x7efe500b55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.966+0000 7efe54853640 1 --2- 172.21.15.29:0/2307149897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe500b7b10 0x7efe500b55f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe40009870 tx=0x7efe4002a130 comp rx=0 tx=0).stop 2024-09-13T18:45:52.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.966+0000 7efe54853640 1 -- 172.21.15.29:0/2307149897 shutdown_connections 2024-09-13T18:45:52.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.966+0000 7efe54853640 1 --2- 172.21.15.29:0/2307149897 >> v2:172.21.15.96:3300/0 conn(0x7efe50144720 0x7efe5014e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.966+0000 7efe54853640 1 --2- 172.21.15.29:0/2307149897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe500b7b10 0x7efe500b55f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.966+0000 7efe54853640 1 -- 172.21.15.29:0/2307149897 >> 172.21.15.29:0/2307149897 conn(0x7efe5006a2f0 msgr2=0x7efe5006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:52.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.966+0000 7efe54853640 1 -- 172.21.15.29:0/2307149897 shutdown_connections 2024-09-13T18:45:52.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.966+0000 7efe54853640 1 -- 172.21.15.29:0/2307149897 wait complete. 2024-09-13T18:45:52.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.967+0000 7efe54853640 1 Processor -- start 2024-09-13T18:45:52.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.967+0000 7efe54853640 1 -- start start 2024-09-13T18:45:52.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe54853640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5006b5b0 0x7efe50070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe54853640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe500b7b10 0x7efe50070050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe54853640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe50144720 0x7efe5013e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe54853640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe500ae310 con 0x7efe5006b5b0 2024-09-13T18:45:52.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe54853640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5006f600 con 0x7efe500b7b10 2024-09-13T18:45:52.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe54853640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5006fbc0 con 0x7efe50144720 2024-09-13T18:45:52.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe4e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5006b5b0 0x7efe50070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe4e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5006b5b0 0x7efe50070a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41322/0 (socket says 172.21.15.29:41322) 2024-09-13T18:45:52.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe4e59c640 1 -- 172.21.15.29:0/2068594081 learned_addr learned my addr 172.21.15.29:0/2068594081 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe47fff640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe500b7b10 0x7efe50070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe4ed9d640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe50144720 0x7efe5013e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe4e59c640 1 -- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe50144720 msgr2=0x7efe5013e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe4e59c640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe50144720 0x7efe5013e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe4e59c640 1 -- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe500b7b10 msgr2=0x7efe50070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe4e59c640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe500b7b10 0x7efe50070050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe4e59c640 1 -- 172.21.15.29:0/2068594081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe400094d0 con 0x7efe5006b5b0 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe47fff640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe500b7b10 0x7efe50070050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe4ed9d640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe50144720 0x7efe5013e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe4e59c640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5006b5b0 0x7efe50070a40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efe40000c00 tx=0x7efe400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.968+0000 7efe46ffd640 1 -- 172.21.15.29:0/2068594081 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40030850 con 0x7efe5006b5b0 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.969+0000 7efe46ffd640 1 -- 172.21.15.29:0/2068594081 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe400309d0 con 0x7efe5006b5b0 2024-09-13T18:45:52.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.969+0000 7efe46ffd640 1 -- 172.21.15.29:0/2068594081 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40030d80 con 0x7efe5006b5b0 2024-09-13T18:45:52.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.969+0000 7efe54853640 1 -- 172.21.15.29:0/2068594081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5013f690 con 0x7efe5006b5b0 2024-09-13T18:45:52.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.969+0000 7efe54853640 1 -- 172.21.15.29:0/2068594081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe50147c80 con 0x7efe5006b5b0 2024-09-13T18:45:52.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.970+0000 7efe54853640 1 -- 172.21.15.29:0/2068594081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe500672b0 con 0x7efe5006b5b0 2024-09-13T18:45:52.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.970+0000 7efe46ffd640 1 -- 172.21.15.29:0/2068594081 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efe40039040 con 0x7efe5006b5b0 2024-09-13T18:45:52.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.971+0000 7efe46ffd640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efe3006ac00 0x7efe3006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.971+0000 7efe46ffd640 1 -- 172.21.15.29:0/2068594081 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efe400a9aa0 con 0x7efe5006b5b0 2024-09-13T18:45:52.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.971+0000 7efe47fff640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efe3006ac00 0x7efe3006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.971+0000 7efe47fff640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efe3006ac00 0x7efe3006d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe50140060 tx=0x7efe38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:52.975+0000 7efe46ffd640 1 -- 172.21.15.29:0/2068594081 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efe40074a20 con 0x7efe5006b5b0 2024-09-13T18:45:53.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.145+0000 7efe54853640 1 -- 172.21.15.29:0/2068594081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe500b13c0 con 0x7efe5006b5b0 2024-09-13T18:45:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.145+0000 7efe46ffd640 1 -- 172.21.15.29:0/2068594081 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe40078040 con 0x7efe5006b5b0 2024-09-13T18:45:53.148 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-09-13T18:45:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.147+0000 7efe54853640 1 -- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efe3006ac00 msgr2=0x7efe3006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.147+0000 7efe54853640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efe3006ac00 0x7efe3006d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe50140060 tx=0x7efe38009040 comp rx=0 tx=0).stop 2024-09-13T18:45:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.147+0000 7efe54853640 1 -- 172.21.15.29:0/2068594081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5006b5b0 msgr2=0x7efe50070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.147+0000 7efe54853640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5006b5b0 0x7efe50070a40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efe40000c00 tx=0x7efe400046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.147+0000 7efe54853640 1 -- 172.21.15.29:0/2068594081 shutdown_connections 2024-09-13T18:45:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.147+0000 7efe54853640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efe3006ac00 0x7efe3006d0c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.147+0000 7efe54853640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe50144720 0x7efe5013e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.147+0000 7efe54853640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe500b7b10 0x7efe50070050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.147+0000 7efe54853640 1 --2- 172.21.15.29:0/2068594081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5006b5b0 0x7efe50070a40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.147+0000 7efe54853640 1 -- 172.21.15.29:0/2068594081 >> 172.21.15.29:0/2068594081 conn(0x7efe5006a2f0 msgr2=0x7efe50099a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.147+0000 7efe54853640 1 -- 172.21.15.29:0/2068594081 shutdown_connections 2024-09-13T18:45:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.147+0000 7efe54853640 1 -- 172.21.15.29:0/2068594081 wait complete. 2024-09-13T18:45:53.160 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:45:53.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.262+0000 7f9ca1c90640 1 Processor -- start 2024-09-13T18:45:53.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.262+0000 7f9ca1c90640 1 -- start start 2024-09-13T18:45:53.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.262+0000 7f9ca1c90640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c9c13f7b0 0x7f9c9c13fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.262+0000 7f9ca1c90640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c9c14e270 0x7f9c9c150660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.262+0000 7f9ca1c90640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9c06bf50 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.262+0000 7f9ca1c90640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0b4400 con 0x7f9c9c13f7b0 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.262+0000 7f9ca1c90640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0ba0d0 con 0x7f9c9c14e270 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.263+0000 7f9c9affd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c9c13f7b0 0x7f9c9c13fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.263+0000 7f9c9affd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c9c13f7b0 0x7f9c9c13fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41328/0 (socket says 172.21.15.29:41328) 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.263+0000 7f9c9affd640 1 -- 172.21.15.29:0/2228696163 learned_addr learned my addr 172.21.15.29:0/2228696163 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.263+0000 7f9c9b7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9c9c0b9cf0 0x7f9c9c06c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54480/0 (socket says 172.21.15.29:54480) 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.263+0000 7f9c9bfff640 1 --2- 172.21.15.29:0/2228696163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c9c14e270 0x7f9c9c150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.263+0000 7f9c9affd640 1 -- 172.21.15.29:0/2228696163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c9c14e270 msgr2=0x7f9c9c150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.263+0000 7f9c9affd640 1 --2- 172.21.15.29:0/2228696163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c9c14e270 0x7f9c9c150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.263+0000 7f9c9affd640 1 -- 172.21.15.29:0/2228696163 >> v1:172.21.15.29:6789/0 conn(0x7f9c9c0b9cf0 legacy=0x7f9c9c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.263+0000 7f9c9affd640 1 -- 172.21.15.29:0/2228696163 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c0b5c00 con 0x7f9c9c13f7b0 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.263+0000 7f9c9bfff640 1 --2- 172.21.15.29:0/2228696163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c9c14e270 0x7f9c9c150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.264+0000 7f9c9affd640 1 --2- 172.21.15.29:0/2228696163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9c13f7b0 0x7f9c9c13fbd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009870 tx=0x7f9c9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0bc7cbcea8f797 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.264+0000 7f9c9a7fc640 1 -- 172.21.15.29:0/2228696163 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90032440 con 0x7f9c9c13f7b0 2024-09-13T18:45:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.264+0000 7f9c9a7fc640 1 -- 172.21.15.29:0/2228696163 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c900325a0 con 0x7f9c9c13f7b0 2024-09-13T18:45:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.264+0000 7f9c9a7fc640 1 -- 172.21.15.29:0/2228696163 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90032930 con 0x7f9c9c13f7b0 2024-09-13T18:45:53.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.264+0000 7f9ca1c90640 1 -- 172.21.15.29:0/2228696163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9c13f7b0 msgr2=0x7f9c9c13fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.264+0000 7f9ca1c90640 1 --2- 172.21.15.29:0/2228696163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9c13f7b0 0x7f9c9c13fbd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009870 tx=0x7f9c9002a270 comp rx=0 tx=0).stop 2024-09-13T18:45:53.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.264+0000 7f9ca1c90640 1 -- 172.21.15.29:0/2228696163 shutdown_connections 2024-09-13T18:45:53.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.264+0000 7f9ca1c90640 1 --2- 172.21.15.29:0/2228696163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c9c14e270 0x7f9c9c150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.264+0000 7f9ca1c90640 1 --2- 172.21.15.29:0/2228696163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9c13f7b0 0x7f9c9c13fbd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.264+0000 7f9ca1c90640 1 -- 172.21.15.29:0/2228696163 >> 172.21.15.29:0/2228696163 conn(0x7f9c9c06a560 msgr2=0x7f9c9c0b9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:53.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.264+0000 7f9ca1c90640 1 -- 172.21.15.29:0/2228696163 shutdown_connections 2024-09-13T18:45:53.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.264+0000 7f9ca1c90640 1 -- 172.21.15.29:0/2228696163 wait complete. 2024-09-13T18:45:53.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.265+0000 7f9ca1c90640 1 Processor -- start 2024-09-13T18:45:53.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.266+0000 7f9ca1c90640 1 -- start start 2024-09-13T18:45:53.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.266+0000 7f9ca1c90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9c0b9cf0 0x7f9c9c0acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.266+0000 7f9ca1c90640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c9c13f7b0 0x7f9c9c0ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.266+0000 7f9ca1c90640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c9c14e270 0x7f9c9c0ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.266+0000 7f9ca1c90640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c141d30 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.266+0000 7f9ca1c90640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c141820 con 0x7f9c9c14e270 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.266+0000 7f9ca1c90640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0ad460 con 0x7f9c9c13f7b0 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.266+0000 7f9c9b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9c0b9cf0 0x7f9c9c0acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.266+0000 7f9c9b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9c0b9cf0 0x7f9c9c0acf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41338/0 (socket says 172.21.15.29:41338) 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.266+0000 7f9c9b7fe640 1 -- 172.21.15.29:0/539416606 learned_addr learned my addr 172.21.15.29:0/539416606 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.266+0000 7f9c9affd640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c9c13f7b0 0x7f9c9c0ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.266+0000 7f9c9bfff640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c9c14e270 0x7f9c9c0ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.267+0000 7f9c9b7fe640 1 -- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c9c13f7b0 msgr2=0x7f9c9c0ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.267+0000 7f9c9b7fe640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c9c13f7b0 0x7f9c9c0ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.267+0000 7f9c9b7fe640 1 -- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c9c14e270 msgr2=0x7f9c9c0ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.267+0000 7f9c9b7fe640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c9c14e270 0x7f9c9c0ae3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.267+0000 7f9c9b7fe640 1 -- 172.21.15.29:0/539416606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c900094d0 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.267+0000 7f9c9b7fe640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9c0b9cf0 0x7f9c9c0acf20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00c4d0 tx=0x7f9c8c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.267+0000 7f9c83fff640 1 -- 172.21.15.29:0/539416606 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c007480 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.267+0000 7f9c83fff640 1 -- 172.21.15.29:0/539416606 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c0075e0 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.267+0000 7f9c83fff640 1 -- 172.21.15.29:0/539416606 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0049e0 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.267+0000 7f9ca1c90640 1 -- 172.21.15.29:0/539416606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9c0ad710 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.267+0000 7f9ca1c90640 1 -- 172.21.15.29:0/539416606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c142960 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.268+0000 7f9ca1c90640 1 -- 172.21.15.29:0/539416606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9c06b9b0 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.268+0000 7f9c83fff640 1 -- 172.21.15.29:0/539416606 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9c8c004b40 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.269+0000 7f9c83fff640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9c8806ac00 0x7f9c8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.269+0000 7f9c83fff640 1 -- 172.21.15.29:0/539416606 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c8c088740 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.269+0000 7f9c9affd640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9c8806ac00 0x7f9c8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.270+0000 7f9c9affd640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9c8806ac00 0x7f9c8806d0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9c90034000 tx=0x7f9c9002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.273+0000 7f9c83fff640 1 -- 172.21.15.29:0/539416606 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9c8c0536d0 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.444+0000 7f9ca1c90640 1 -- 172.21.15.29:0/539416606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c9c141e70 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.444+0000 7f9c83fff640 1 -- 172.21.15.29:0/539416606 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c8c056cf0 con 0x7f9c9c0b9cf0 2024-09-13T18:45:53.447 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-13T18:45:53.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.446+0000 7f9ca1c90640 1 -- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9c8806ac00 msgr2=0x7f9c8806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.446+0000 7f9ca1c90640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9c8806ac00 0x7f9c8806d0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9c90034000 tx=0x7f9c9002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:53.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.446+0000 7f9ca1c90640 1 -- 172.21.15.29:0/539416606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9c0b9cf0 msgr2=0x7f9c9c0acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.446+0000 7f9ca1c90640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9c0b9cf0 0x7f9c9c0acf20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00c4d0 tx=0x7f9c8c00c990 comp rx=0 tx=0).stop 2024-09-13T18:45:53.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.446+0000 7f9ca1c90640 1 -- 172.21.15.29:0/539416606 shutdown_connections 2024-09-13T18:45:53.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.446+0000 7f9ca1c90640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9c8806ac00 0x7f9c8806d0c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.446+0000 7f9ca1c90640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c9c14e270 0x7f9c9c0ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.446+0000 7f9ca1c90640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c9c13f7b0 0x7f9c9c0ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.446+0000 7f9ca1c90640 1 --2- 172.21.15.29:0/539416606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9c0b9cf0 0x7f9c9c0acf20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.446+0000 7f9ca1c90640 1 -- 172.21.15.29:0/539416606 >> 172.21.15.29:0/539416606 conn(0x7f9c9c06a560 msgr2=0x7f9c9c1443d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:53.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.446+0000 7f9ca1c90640 1 -- 172.21.15.29:0/539416606 shutdown_connections 2024-09-13T18:45:53.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.447+0000 7f9ca1c90640 1 -- 172.21.15.29:0/539416606 wait complete. 2024-09-13T18:45:53.460 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:45:53.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.561+0000 7f5f42a0d640 1 Processor -- start 2024-09-13T18:45:53.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.561+0000 7f5f42a0d640 1 -- start start 2024-09-13T18:45:53.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.562+0000 7f5f42a0d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5f3c0b5f50 0x7f5f3c13f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.562+0000 7f5f42a0d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f3c0b3320 0x7f5f3c13fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.562+0000 7f5f42a0d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c0b3880 con 0x7f5f3c0b44b0 2024-09-13T18:45:53.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.562+0000 7f5f42a0d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c0b5580 con 0x7f5f3c0b3320 2024-09-13T18:45:53.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.562+0000 7f5f42a0d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c0b4890 con 0x7f5f3c0b5f50 2024-09-13T18:45:53.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.562+0000 7f5f40faa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f3c0b3320 0x7f5f3c13fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.562+0000 7f5f40faa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f3c0b3320 0x7f5f3c13fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41344/0 (socket says 172.21.15.29:41344) 2024-09-13T18:45:53.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.562+0000 7f5f40faa640 1 -- 172.21.15.29:0/391828207 learned_addr learned my addr 172.21.15.29:0/391828207 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:53.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.562+0000 7f5f3b7fe640 1 --2- 172.21.15.29:0/391828207 >> v2:172.21.15.96:3300/0 conn(0x7f5f3c0b5f50 0x7f5f3c13f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.563+0000 7f5f40faa640 1 -- 172.21.15.29:0/391828207 >> v2:172.21.15.96:3300/0 conn(0x7f5f3c0b5f50 msgr2=0x7f5f3c13f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:53.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.563+0000 7f5f40faa640 1 --2- 172.21.15.29:0/391828207 >> v2:172.21.15.96:3300/0 conn(0x7f5f3c0b5f50 0x7f5f3c13f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.563+0000 7f5f40faa640 1 -- 172.21.15.29:0/391828207 >> v1:172.21.15.96:6789/0 conn(0x7f5f3c0b44b0 legacy=0x7f5f3c1462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.563+0000 7f5f40faa640 1 -- 172.21.15.29:0/391828207 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c0b57f0 con 0x7f5f3c0b3320 2024-09-13T18:45:53.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.563+0000 7f5f40faa640 1 --2- 172.21.15.29:0/391828207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0b3320 0x7f5f3c13fb30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c143570 tx=0x7f5f3402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0e96a0e94da399 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.563+0000 7f5f3affd640 1 -- 172.21.15.29:0/391828207 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34031600 con 0x7f5f3c0b3320 2024-09-13T18:45:53.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.563+0000 7f5f3affd640 1 -- 172.21.15.29:0/391828207 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3402d050 con 0x7f5f3c0b3320 2024-09-13T18:45:53.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.564+0000 7f5f3affd640 1 -- 172.21.15.29:0/391828207 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34031980 con 0x7f5f3c0b3320 2024-09-13T18:45:53.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.564+0000 7f5f42a0d640 1 -- 172.21.15.29:0/391828207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0b3320 msgr2=0x7f5f3c13fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.564+0000 7f5f42a0d640 1 --2- 172.21.15.29:0/391828207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0b3320 0x7f5f3c13fb30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c143570 tx=0x7f5f3402a730 comp rx=0 tx=0).stop 2024-09-13T18:45:53.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.564+0000 7f5f42a0d640 1 -- 172.21.15.29:0/391828207 shutdown_connections 2024-09-13T18:45:53.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.564+0000 7f5f42a0d640 1 --2- 172.21.15.29:0/391828207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0b3320 0x7f5f3c13fb30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.564+0000 7f5f42a0d640 1 --2- 172.21.15.29:0/391828207 >> v2:172.21.15.96:3300/0 conn(0x7f5f3c0b5f50 0x7f5f3c13f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.564+0000 7f5f42a0d640 1 -- 172.21.15.29:0/391828207 >> 172.21.15.29:0/391828207 conn(0x7f5f3c0b8050 msgr2=0x7f5f3c0b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:53.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.564+0000 7f5f42a0d640 1 -- 172.21.15.29:0/391828207 shutdown_connections 2024-09-13T18:45:53.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.564+0000 7f5f42a0d640 1 -- 172.21.15.29:0/391828207 wait complete. 2024-09-13T18:45:53.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.565+0000 7f5f42a0d640 1 Processor -- start 2024-09-13T18:45:53.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.565+0000 7f5f42a0d640 1 -- start start 2024-09-13T18:45:53.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f42a0d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0b3320 0x7f5f3c1dc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f42a0d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0b44b0 0x7f5f3c0bbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f42a0d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f3c0b5f50 0x7f5f3c1dec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f42a0d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c133fe0 con 0x7f5f3c0b3320 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f42a0d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c134e20 con 0x7f5f3c0b44b0 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f42a0d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c1db810 con 0x7f5f3c0b5f50 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f3bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0b3320 0x7f5f3c1dc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f3bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0b3320 0x7f5f3c1dc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41346/0 (socket says 172.21.15.29:41346) 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f3bfff640 1 -- 172.21.15.29:0/3902644718 learned_addr learned my addr 172.21.15.29:0/3902644718 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f3b7fe640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0b44b0 0x7f5f3c0bbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f40faa640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f3c0b5f50 0x7f5f3c1dec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f3bfff640 1 -- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f3c0b5f50 msgr2=0x7f5f3c1dec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f3bfff640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f3c0b5f50 0x7f5f3c1dec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f3bfff640 1 -- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0b44b0 msgr2=0x7f5f3c0bbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f3bfff640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0b44b0 0x7f5f3c0bbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f3bfff640 1 -- 172.21.15.29:0/3902644718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f34009b30 con 0x7f5f3c0b3320 2024-09-13T18:45:53.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.566+0000 7f5f3bfff640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0b3320 0x7f5f3c1dc010 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00c450 tx=0x7f5f2c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.567+0000 7f5f38ff9640 1 -- 172.21.15.29:0/3902644718 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0052d0 con 0x7f5f3c0b3320 2024-09-13T18:45:53.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.567+0000 7f5f38ff9640 1 -- 172.21.15.29:0/3902644718 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c005430 con 0x7f5f3c0b3320 2024-09-13T18:45:53.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.567+0000 7f5f38ff9640 1 -- 172.21.15.29:0/3902644718 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c012870 con 0x7f5f3c0b3320 2024-09-13T18:45:53.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.567+0000 7f5f42a0d640 1 -- 172.21.15.29:0/3902644718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c1dbaf0 con 0x7f5f3c0b3320 2024-09-13T18:45:53.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.567+0000 7f5f42a0d640 1 -- 172.21.15.29:0/3902644718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c0bb160 con 0x7f5f3c0b3320 2024-09-13T18:45:53.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.568+0000 7f5f42a0d640 1 -- 172.21.15.29:0/3902644718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c0b2b50 con 0x7f5f3c0b3320 2024-09-13T18:45:53.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.568+0000 7f5f38ff9640 1 -- 172.21.15.29:0/3902644718 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f2c0129d0 con 0x7f5f3c0b3320 2024-09-13T18:45:53.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.569+0000 7f5f38ff9640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f2806ac00 0x7f5f2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.569+0000 7f5f38ff9640 1 -- 172.21.15.29:0/3902644718 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f2c088fb0 con 0x7f5f3c0b3320 2024-09-13T18:45:53.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.569+0000 7f5f3b7fe640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f2806ac00 0x7f5f2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.569+0000 7f5f3b7fe640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f2806ac00 0x7f5f2806d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c1d1b30 tx=0x7f5f30009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.573+0000 7f5f38ff9640 1 -- 172.21.15.29:0/3902644718 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5f2c0bc9c0 con 0x7f5f3c0b3320 2024-09-13T18:45:53.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.743+0000 7f5f42a0d640 1 -- 172.21.15.29:0/3902644718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f3c1462e0 con 0x7f5f3c0b3320 2024-09-13T18:45:53.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.744+0000 7f5f38ff9640 1 -- 172.21.15.29:0/3902644718 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f2c053fe0 con 0x7f5f3c0b3320 2024-09-13T18:45:53.746 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-09-13T18:45:53.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.746+0000 7f5f42a0d640 1 -- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f2806ac00 msgr2=0x7f5f2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.746+0000 7f5f42a0d640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f2806ac00 0x7f5f2806d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c1d1b30 tx=0x7f5f30009190 comp rx=0 tx=0).stop 2024-09-13T18:45:53.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.746+0000 7f5f42a0d640 1 -- 172.21.15.29:0/3902644718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0b3320 msgr2=0x7f5f3c1dc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.746+0000 7f5f42a0d640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0b3320 0x7f5f3c1dc010 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00c450 tx=0x7f5f2c00c910 comp rx=0 tx=0).stop 2024-09-13T18:45:53.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.746+0000 7f5f42a0d640 1 -- 172.21.15.29:0/3902644718 shutdown_connections 2024-09-13T18:45:53.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.746+0000 7f5f42a0d640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f2806ac00 0x7f5f2806d0c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.746+0000 7f5f42a0d640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f3c0b5f50 0x7f5f3c1dec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.746+0000 7f5f42a0d640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f3c0b44b0 0x7f5f3c0bbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.746+0000 7f5f42a0d640 1 --2- 172.21.15.29:0/3902644718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0b3320 0x7f5f3c1dc010 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.746+0000 7f5f42a0d640 1 -- 172.21.15.29:0/3902644718 >> 172.21.15.29:0/3902644718 conn(0x7f5f3c0b8050 msgr2=0x7f5f3c140880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:53.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.746+0000 7f5f42a0d640 1 -- 172.21.15.29:0/3902644718 shutdown_connections 2024-09-13T18:45:53.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.746+0000 7f5f42a0d640 1 -- 172.21.15.29:0/3902644718 wait complete. 2024-09-13T18:45:53.759 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:45:53.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.860+0000 7fc34871f640 1 Processor -- start 2024-09-13T18:45:53.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.860+0000 7fc34871f640 1 -- start start 2024-09-13T18:45:53.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.861+0000 7fc34871f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc3400b44b0 0x7fc3401462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.861+0000 7fc34871f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc3400b3320 0x7fc34013fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.861+0000 7fc34871f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3400b3880 con 0x7fc3400b5f50 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.861+0000 7fc34871f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3400b5580 con 0x7fc3400b3320 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.861+0000 7fc34871f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3400b4890 con 0x7fc3400b44b0 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.861+0000 7fc346cbc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc3400b3320 0x7fc34013fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.861+0000 7fc345cba640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc3400b5f50 0x7fc34013f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54496/0 (socket says 172.21.15.29:54496) 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.861+0000 7fc345cba640 1 -- 172.21.15.29:0/3674064566 learned_addr learned my addr 172.21.15.29:0/3674064566 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.862+0000 7fc3464bb640 1 --2- 172.21.15.29:0/3674064566 >> v2:172.21.15.96:3300/0 conn(0x7fc3400b44b0 0x7fc3401462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.862+0000 7fc3454b9640 1 -- 172.21.15.29:0/3674064566 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113195859 0 0) 0x7fc3400b3880 con 0x7fc3400b5f50 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.862+0000 7fc3454b9640 1 -- 172.21.15.29:0/3674064566 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc32c003520 con 0x7fc3400b5f50 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.862+0000 7fc346cbc640 1 -- 172.21.15.29:0/3674064566 >> v2:172.21.15.96:3300/0 conn(0x7fc3400b44b0 msgr2=0x7fc3401462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.862+0000 7fc346cbc640 1 --2- 172.21.15.29:0/3674064566 >> v2:172.21.15.96:3300/0 conn(0x7fc3400b44b0 0x7fc3401462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.862+0000 7fc346cbc640 1 -- 172.21.15.29:0/3674064566 >> v1:172.21.15.29:6789/0 conn(0x7fc3400b5f50 legacy=0x7fc34013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.862+0000 7fc346cbc640 1 -- 172.21.15.29:0/3674064566 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400b57f0 con 0x7fc3400b3320 2024-09-13T18:45:53.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.862+0000 7fc346cbc640 1 --2- 172.21.15.29:0/3674064566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3400b3320 0x7fc34013fd00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc34006b270 tx=0x7fc33802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cb6a10c6141351 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.863+0000 7fc3454b9640 1 -- 172.21.15.29:0/3674064566 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33802aea0 con 0x7fc3400b3320 2024-09-13T18:45:53.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.863+0000 7fc3454b9640 1 -- 172.21.15.29:0/3674064566 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33802d050 con 0x7fc3400b3320 2024-09-13T18:45:53.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.863+0000 7fc3454b9640 1 -- 172.21.15.29:0/3674064566 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338007960 con 0x7fc3400b3320 2024-09-13T18:45:53.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.863+0000 7fc34871f640 1 -- 172.21.15.29:0/3674064566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3400b3320 msgr2=0x7fc34013fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.863+0000 7fc34871f640 1 --2- 172.21.15.29:0/3674064566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3400b3320 0x7fc34013fd00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc34006b270 tx=0x7fc33802a680 comp rx=0 tx=0).stop 2024-09-13T18:45:53.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.863+0000 7fc34871f640 1 -- 172.21.15.29:0/3674064566 shutdown_connections 2024-09-13T18:45:53.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.863+0000 7fc34871f640 1 --2- 172.21.15.29:0/3674064566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3400b3320 0x7fc34013fd00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.863+0000 7fc34871f640 1 --2- 172.21.15.29:0/3674064566 >> v2:172.21.15.96:3300/0 conn(0x7fc3400b44b0 0x7fc3401462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.863+0000 7fc34871f640 1 -- 172.21.15.29:0/3674064566 >> 172.21.15.29:0/3674064566 conn(0x7fc3400b8050 msgr2=0x7fc3400b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:53.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.863+0000 7fc34871f640 1 -- 172.21.15.29:0/3674064566 shutdown_connections 2024-09-13T18:45:53.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.863+0000 7fc34871f640 1 -- 172.21.15.29:0/3674064566 wait complete. 2024-09-13T18:45:53.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.864+0000 7fc34871f640 1 Processor -- start 2024-09-13T18:45:53.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.864+0000 7fc34871f640 1 -- start start 2024-09-13T18:45:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc34871f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3400b3320 0x7fc3400bbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc34871f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc3400b44b0 0x7fc3401de260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc34871f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3400b5f50 0x7fc3401d4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc34871f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401353e0 con 0x7fc3400b5f50 2024-09-13T18:45:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc34871f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401df0d0 con 0x7fc3400b3320 2024-09-13T18:45:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc34871f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc340136e90 con 0x7fc3400b44b0 2024-09-13T18:45:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc346cbc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3400b5f50 0x7fc3401d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc346cbc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3400b5f50 0x7fc3401d4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41374/0 (socket says 172.21.15.29:41374) 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc346cbc640 1 -- 172.21.15.29:0/1913341270 learned_addr learned my addr 172.21.15.29:0/1913341270 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc3464bb640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3400b3320 0x7fc3400bbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc345cba640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc3400b44b0 0x7fc3401de260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc346cbc640 1 -- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc3400b44b0 msgr2=0x7fc3401de260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc346cbc640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc3400b44b0 0x7fc3401de260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc346cbc640 1 -- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3400b3320 msgr2=0x7fc3400bbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc346cbc640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3400b3320 0x7fc3400bbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.865+0000 7fc346cbc640 1 -- 172.21.15.29:0/1913341270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338009a70 con 0x7fc3400b5f50 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.866+0000 7fc346cbc640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3400b5f50 0x7fc3401d4ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc33802ac70 tx=0x7fc338004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.866+0000 7fc336ffd640 1 -- 172.21.15.29:0/1913341270 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33803c830 con 0x7fc3400b5f50 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.866+0000 7fc336ffd640 1 -- 172.21.15.29:0/1913341270 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33803c990 con 0x7fc3400b5f50 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.866+0000 7fc336ffd640 1 -- 172.21.15.29:0/1913341270 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33803cd00 con 0x7fc3400b5f50 2024-09-13T18:45:53.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.866+0000 7fc34871f640 1 -- 172.21.15.29:0/1913341270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3401dea80 con 0x7fc3400b5f50 2024-09-13T18:45:53.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.866+0000 7fc34871f640 1 -- 172.21.15.29:0/1913341270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc340136bb0 con 0x7fc3400b5f50 2024-09-13T18:45:53.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.867+0000 7fc34871f640 1 -- 172.21.15.29:0/1913341270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3401462e0 con 0x7fc3400b5f50 2024-09-13T18:45:53.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.867+0000 7fc336ffd640 1 -- 172.21.15.29:0/1913341270 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc338031400 con 0x7fc3400b5f50 2024-09-13T18:45:53.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.868+0000 7fc336ffd640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc32406ac00 0x7fc32406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.868+0000 7fc336ffd640 1 -- 172.21.15.29:0/1913341270 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc3380aafd0 con 0x7fc3400b5f50 2024-09-13T18:45:53.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.868+0000 7fc3464bb640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc32406ac00 0x7fc32406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.868+0000 7fc3464bb640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc32406ac00 0x7fc32406d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc33c006fd0 tx=0x7fc33c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:53.872+0000 7fc336ffd640 1 -- 172.21.15.29:0/1913341270 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc338075f80 con 0x7fc3400b5f50 2024-09-13T18:45:54.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.045+0000 7fc34871f640 1 -- 172.21.15.29:0/1913341270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc34013f770 con 0x7fc3400b5f50 2024-09-13T18:45:54.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.046+0000 7fc336ffd640 1 -- 172.21.15.29:0/1913341270 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc33803ce60 con 0x7fc3400b5f50 2024-09-13T18:45:54.049 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-13T18:45:54.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.048+0000 7fc34871f640 1 -- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc32406ac00 msgr2=0x7fc32406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.048+0000 7fc34871f640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc32406ac00 0x7fc32406d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc33c006fd0 tx=0x7fc33c008040 comp rx=0 tx=0).stop 2024-09-13T18:45:54.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.048+0000 7fc34871f640 1 -- 172.21.15.29:0/1913341270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3400b5f50 msgr2=0x7fc3401d4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.048+0000 7fc34871f640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3400b5f50 0x7fc3401d4ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc33802ac70 tx=0x7fc338004a40 comp rx=0 tx=0).stop 2024-09-13T18:45:54.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.048+0000 7fc34871f640 1 -- 172.21.15.29:0/1913341270 shutdown_connections 2024-09-13T18:45:54.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.048+0000 7fc34871f640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fc32406ac00 0x7fc32406d0c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.048+0000 7fc34871f640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3400b5f50 0x7fc3401d4ab0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.048+0000 7fc34871f640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc3400b44b0 0x7fc3401de260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.048+0000 7fc34871f640 1 --2- 172.21.15.29:0/1913341270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3400b3320 0x7fc3400bbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.048+0000 7fc34871f640 1 -- 172.21.15.29:0/1913341270 >> 172.21.15.29:0/1913341270 conn(0x7fc3400b8050 msgr2=0x7fc340144650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:54.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.048+0000 7fc34871f640 1 -- 172.21.15.29:0/1913341270 shutdown_connections 2024-09-13T18:45:54.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.048+0000 7fc34871f640 1 -- 172.21.15.29:0/1913341270 wait complete. 2024-09-13T18:45:54.061 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:54.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.160+0000 7f4b2c74c640 1 Processor -- start 2024-09-13T18:45:54.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.160+0000 7f4b2c74c640 1 -- start start 2024-09-13T18:45:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.161+0000 7f4b2c74c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4b240b0330 0x7f4b24145720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.161+0000 7f4b2c74c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b240b0e10 con 0x7f4b24145c60 2024-09-13T18:45:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.161+0000 7f4b2c74c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2406e920 con 0x7f4b240b2850 2024-09-13T18:45:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.161+0000 7f4b2c74c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b240b2c30 con 0x7f4b240b0330 2024-09-13T18:45:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.161+0000 7f4b2ace9640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4b24145c60 0x7f4b2414c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44452/0 (socket says 172.21.15.29:44452) 2024-09-13T18:45:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.161+0000 7f4b2ace9640 1 -- 172.21.15.29:0/2756007984 learned_addr learned my addr 172.21.15.29:0/2756007984 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755181986 0 0) 0x7f4b240b0e10 con 0x7f4b24145c60 2024-09-13T18:45:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b29ce7640 1 --2- 172.21.15.29:0/2756007984 >> v2:172.21.15.96:3300/0 conn(0x7f4b240b0330 0x7f4b24145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b10003440 con 0x7f4b24145c60 2024-09-13T18:45:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1396716614 0 0) 0x7f4b10003440 con 0x7f4b24145c60 2024-09-13T18:45:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 >> v2:172.21.15.96:3300/0 conn(0x7f4b240b0330 msgr2=0x7f4b24145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 --2- 172.21.15.29:0/2756007984 >> v2:172.21.15.96:3300/0 conn(0x7f4b240b0330 0x7f4b24145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 >> v1:172.21.15.96:6789/0 conn(0x7f4b240b2850 legacy=0x7f4b2413be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2413c560 con 0x7f4b24145c60 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f4b1c0019f0 con 0x7f4b24145c60 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 >> v1:172.21.15.29:6789/0 conn(0x7f4b24145c60 legacy=0x7f4b2414c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 --2- 172.21.15.29:0/2756007984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b10003a60 0x7f4b10003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 --2- 172.21.15.29:0/2756007984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b100088a0 0x7f4b1000ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 --2- 172.21.15.29:0/2756007984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b1000b5d0 0x7f4b1000da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240b2c30 con 0x7f4b10003a60 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1000e370 con 0x7f4b1000b5d0 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1000e530 con 0x7f4b100088a0 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b2a4e8640 1 --2- 172.21.15.29:0/2756007984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b10003a60 0x7f4b10003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b2ace9640 1 --2- 172.21.15.29:0/2756007984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b1000b5d0 0x7f4b1000da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b29ce7640 1 --2- 172.21.15.29:0/2756007984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b100088a0 0x7f4b1000ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b2a4e8640 1 -- 172.21.15.29:0/2756007984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b100088a0 msgr2=0x7f4b1000ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b2a4e8640 1 --2- 172.21.15.29:0/2756007984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b100088a0 0x7f4b1000ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b2a4e8640 1 -- 172.21.15.29:0/2756007984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b1000b5d0 msgr2=0x7f4b1000da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b2a4e8640 1 --2- 172.21.15.29:0/2756007984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b1000b5d0 0x7f4b1000da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b2a4e8640 1 -- 172.21.15.29:0/2756007984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10003440 con 0x7f4b10003a60 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b2ace9640 1 --2- 172.21.15.29:0/2756007984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b1000b5d0 0x7f4b1000da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.162+0000 7f4b2ace9640 1 -- 172.21.15.29:0/2756007984 reap_dead start 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.163+0000 7f4b2a4e8640 1 --2- 172.21.15.29:0/2756007984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b10003a60 0x7f4b10003e80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4b20001720 tx=0x7f4b100036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97e0328ba0e0260 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.163+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200052d0 con 0x7f4b10003a60 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.163+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20005430 con 0x7f4b10003a60 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.163+0000 7f4b294e6640 1 -- 172.21.15.29:0/2756007984 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2002ab90 con 0x7f4b10003a60 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.164+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2756007984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b10003a60 msgr2=0x7f4b10003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.164+0000 7f4b2c74c640 1 --2- 172.21.15.29:0/2756007984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b10003a60 0x7f4b10003e80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4b20001720 tx=0x7f4b100036f0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.164+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2756007984 shutdown_connections 2024-09-13T18:45:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.164+0000 7f4b2c74c640 1 --2- 172.21.15.29:0/2756007984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b10003a60 0x7f4b10003e80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.164+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2756007984 >> 172.21.15.29:0/2756007984 conn(0x7f4b2406a890 msgr2=0x7f4b240b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.164+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2756007984 shutdown_connections 2024-09-13T18:45:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.164+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2756007984 wait complete. 2024-09-13T18:45:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.165+0000 7f4b2c74c640 1 Processor -- start 2024-09-13T18:45:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.165+0000 7f4b2c74c640 1 -- start start 2024-09-13T18:45:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.165+0000 7f4b2c74c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10003a60 0x7f4b241d7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.165+0000 7f4b2c74c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b241da630 0x7f4b24144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2c74c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b2413b070 0x7f4b2413b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2c74c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b241daab0 con 0x7f4b2413b070 2024-09-13T18:45:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2c74c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2413a670 con 0x7f4b241da630 2024-09-13T18:45:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2c74c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b241d7410 con 0x7f4b10003a60 2024-09-13T18:45:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2ace9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b2413b070 0x7f4b2413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2ace9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b2413b070 0x7f4b2413b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59482/0 (socket says 172.21.15.29:59482) 2024-09-13T18:45:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2ace9640 1 -- 172.21.15.29:0/2601017892 learned_addr learned my addr 172.21.15.29:0/2601017892 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b29ce7640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b241da630 0x7f4b24144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2a4e8640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10003a60 0x7f4b241d7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2ace9640 1 -- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10003a60 msgr2=0x7f4b241d7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2ace9640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10003a60 0x7f4b241d7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2ace9640 1 -- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b241da630 msgr2=0x7f4b24144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2ace9640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b241da630 0x7f4b24144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2ace9640 1 -- 172.21.15.29:0/2601017892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b241d76f0 con 0x7f4b2413b070 2024-09-13T18:45:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2ace9640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b2413b070 0x7f4b2413b520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b240b3170 tx=0x7f4b1c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b1affd640 1 -- 172.21.15.29:0/2601017892 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c00ea20 con 0x7f4b2413b070 2024-09-13T18:45:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b1affd640 1 -- 172.21.15.29:0/2601017892 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c00eb80 con 0x7f4b2413b070 2024-09-13T18:45:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2601017892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b241d70c0 con 0x7f4b2413b070 2024-09-13T18:45:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b1affd640 1 -- 172.21.15.29:0/2601017892 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c014430 con 0x7f4b2413b070 2024-09-13T18:45:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.166+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2601017892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b24143a50 con 0x7f4b2413b070 2024-09-13T18:45:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.167+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2601017892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b24144e90 con 0x7f4b2413b070 2024-09-13T18:45:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.168+0000 7f4b1affd640 1 -- 172.21.15.29:0/2601017892 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4b1c014590 con 0x7f4b2413b070 2024-09-13T18:45:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.168+0000 7f4b1affd640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f4b0806ac30 0x7f4b0806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.168+0000 7f4b1affd640 1 -- 172.21.15.29:0/2601017892 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b1c089110 con 0x7f4b2413b070 2024-09-13T18:45:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.168+0000 7f4b2a4e8640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f4b0806ac30 0x7f4b0806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.169+0000 7f4b2a4e8640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f4b0806ac30 0x7f4b0806d0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4b20032000 tx=0x7f4b2002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.172+0000 7f4b1affd640 1 -- 172.21.15.29:0/2601017892 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4b1c054140 con 0x7f4b2413b070 2024-09-13T18:45:54.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.379+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2601017892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b241d78e0 con 0x7f4b2413b070 2024-09-13T18:45:54.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.379+0000 7f4b1affd640 1 -- 172.21.15.29:0/2601017892 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3215 (secure 0 0 0) 0x7f4b1c057760 con 0x7f4b2413b070 2024-09-13T18:45:54.382 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:54.382 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/3867151553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3867151553},{"type":"v1","addr":"172.21.15.96:6835","nonce":3867151553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:22.006847+0000","modified":"2024-09-13T18:45:43.067420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6833/175129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":175129703},{"type":"v1","addr":"172.21.15.29:6833","nonce":175129703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:45:54.383 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-09-13T18:45:54.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.381+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f4b0806ac30 msgr2=0x7f4b0806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.381+0000 7f4b2c74c640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f4b0806ac30 0x7f4b0806d0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4b20032000 tx=0x7f4b2002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:54.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.382+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2601017892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b2413b070 msgr2=0x7f4b2413b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.382+0000 7f4b2c74c640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b2413b070 0x7f4b2413b520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b240b3170 tx=0x7f4b1c007bc0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.382+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2601017892 shutdown_connections 2024-09-13T18:45:54.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.382+0000 7f4b2c74c640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f4b0806ac30 0x7f4b0806d0f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.382+0000 7f4b2c74c640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b2413b070 0x7f4b2413b520 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.382+0000 7f4b2c74c640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b241da630 0x7f4b24144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.382+0000 7f4b2c74c640 1 --2- 172.21.15.29:0/2601017892 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10003a60 0x7f4b241d7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.382+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2601017892 >> 172.21.15.29:0/2601017892 conn(0x7f4b2406a890 msgr2=0x7f4b24131cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:54.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.382+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2601017892 shutdown_connections 2024-09-13T18:45:54.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.382+0000 7f4b2c74c640 1 -- 172.21.15.29:0/2601017892 wait complete. 2024-09-13T18:45:54.395 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:54.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.493+0000 7fed408e9640 1 Processor -- start 2024-09-13T18:45:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.493+0000 7fed408e9640 1 -- start start 2024-09-13T18:45:54.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed408e9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed3c0b1fc0 0x7fed3c0b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed408e9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3c06f230 con 0x7fed3c13c550 2024-09-13T18:45:54.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed408e9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3c0b23a0 con 0x7fed3c146300 2024-09-13T18:45:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed408e9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0b0d70 con 0x7fed3c0b1fc0 2024-09-13T18:45:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed39d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fed3c13c550 0x7fed3c145bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44458/0 (socket says 172.21.15.29:44458) 2024-09-13T18:45:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed39d9b640 1 -- 172.21.15.29:0/44697613 learned_addr learned my addr 172.21.15.29:0/44697613 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed3a59c640 1 --2- 172.21.15.29:0/44697613 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed3c0b1fc0 0x7fed3c0b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed3959a640 1 -- 172.21.15.29:0/44697613 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385557664 0 0) 0x7fed3c06f230 con 0x7fed3c13c550 2024-09-13T18:45:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed3959a640 1 -- 172.21.15.29:0/44697613 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed24003520 con 0x7fed3c13c550 2024-09-13T18:45:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed3959a640 1 -- 172.21.15.29:0/44697613 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033148602 0 0) 0x7fed3c0b23a0 con 0x7fed3c146300 2024-09-13T18:45:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed3959a640 1 -- 172.21.15.29:0/44697613 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed3c06f230 con 0x7fed3c146300 2024-09-13T18:45:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed3a59c640 1 -- 172.21.15.29:0/44697613 >> v1:172.21.15.96:6789/0 conn(0x7fed3c146300 legacy=0x7fed3c14cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed3a59c640 1 -- 172.21.15.29:0/44697613 >> v1:172.21.15.29:6789/0 conn(0x7fed3c13c550 legacy=0x7fed3c145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.494+0000 7fed3a59c640 1 -- 172.21.15.29:0/44697613 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c0b1050 con 0x7fed3c0b1fc0 2024-09-13T18:45:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.495+0000 7fed3a59c640 1 --2- 172.21.15.29:0/44697613 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed3c0b1fc0 0x7fed3c0b04a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0097d0 tx=0x7fed2c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf98fd1b2bc10e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.495+0000 7fed3959a640 1 -- 172.21.15.29:0/44697613 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c032440 con 0x7fed3c0b1fc0 2024-09-13T18:45:54.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.495+0000 7fed3959a640 1 -- 172.21.15.29:0/44697613 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c0325a0 con 0x7fed3c0b1fc0 2024-09-13T18:45:54.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.495+0000 7fed3959a640 1 -- 172.21.15.29:0/44697613 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c032930 con 0x7fed3c0b1fc0 2024-09-13T18:45:54.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.496+0000 7fed408e9640 1 -- 172.21.15.29:0/44697613 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed3c0b1fc0 msgr2=0x7fed3c0b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.496+0000 7fed408e9640 1 --2- 172.21.15.29:0/44697613 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed3c0b1fc0 0x7fed3c0b04a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0097d0 tx=0x7fed2c02a210 comp rx=0 tx=0).stop 2024-09-13T18:45:54.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.496+0000 7fed408e9640 1 -- 172.21.15.29:0/44697613 shutdown_connections 2024-09-13T18:45:54.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.496+0000 7fed408e9640 1 --2- 172.21.15.29:0/44697613 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed3c0b1fc0 0x7fed3c0b04a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.496+0000 7fed408e9640 1 -- 172.21.15.29:0/44697613 >> 172.21.15.29:0/44697613 conn(0x7fed3c06a890 msgr2=0x7fed3c0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:54.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.496+0000 7fed408e9640 1 -- 172.21.15.29:0/44697613 shutdown_connections 2024-09-13T18:45:54.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.496+0000 7fed408e9640 1 -- 172.21.15.29:0/44697613 wait complete. 2024-09-13T18:45:54.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.497+0000 7fed408e9640 1 Processor -- start 2024-09-13T18:45:54.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.497+0000 7fed408e9640 1 -- start start 2024-09-13T18:45:54.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed408e9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed3c0b1fc0 0x7fed3c138bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed408e9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed3c13c550 0x7fed3c13f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed408e9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed3c146300 0x7fed3c1354e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed408e9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c13e130 con 0x7fed3c146300 2024-09-13T18:45:54.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed408e9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c13e7b0 con 0x7fed3c13c550 2024-09-13T18:45:54.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed408e9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c13d1e0 con 0x7fed3c0b1fc0 2024-09-13T18:45:54.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed3ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed3c146300 0x7fed3c1354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed3ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed3c146300 0x7fed3c1354e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59484/0 (socket says 172.21.15.29:59484) 2024-09-13T18:45:54.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed3ad9d640 1 -- 172.21.15.29:0/1634242065 learned_addr learned my addr 172.21.15.29:0/1634242065 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:54.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed39d9b640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed3c13c550 0x7fed3c13f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed3a59c640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed3c0b1fc0 0x7fed3c138bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed3ad9d640 1 -- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed3c0b1fc0 msgr2=0x7fed3c138bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed3ad9d640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed3c0b1fc0 0x7fed3c138bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed3ad9d640 1 -- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed3c13c550 msgr2=0x7fed3c13f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed3ad9d640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed3c13c550 0x7fed3c13f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.498+0000 7fed3ad9d640 1 -- 172.21.15.29:0/1634242065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c009400 con 0x7fed3c146300 2024-09-13T18:45:54.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.499+0000 7fed3ad9d640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed3c146300 0x7fed3c1354e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fed3400c710 tx=0x7fed3400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.499+0000 7fed2affd640 1 -- 172.21.15.29:0/1634242065 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34003b70 con 0x7fed3c146300 2024-09-13T18:45:54.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.499+0000 7fed2affd640 1 -- 172.21.15.29:0/1634242065 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed34003cd0 con 0x7fed3c146300 2024-09-13T18:45:54.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.499+0000 7fed408e9640 1 -- 172.21.15.29:0/1634242065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3c13dbb0 con 0x7fed3c146300 2024-09-13T18:45:54.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.499+0000 7fed2affd640 1 -- 172.21.15.29:0/1634242065 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3400aa50 con 0x7fed3c146300 2024-09-13T18:45:54.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.499+0000 7fed408e9640 1 -- 172.21.15.29:0/1634242065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3c13de50 con 0x7fed3c146300 2024-09-13T18:45:54.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.500+0000 7fed408e9640 1 -- 172.21.15.29:0/1634242065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c13d390 con 0x7fed3c146300 2024-09-13T18:45:54.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.500+0000 7fed2affd640 1 -- 172.21.15.29:0/1634242065 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fed3400abb0 con 0x7fed3c146300 2024-09-13T18:45:54.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.501+0000 7fed2affd640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fed1c06ac00 0x7fed1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.501+0000 7fed2affd640 1 -- 172.21.15.29:0/1634242065 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed340892f0 con 0x7fed3c146300 2024-09-13T18:45:54.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.501+0000 7fed3a59c640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fed1c06ac00 0x7fed1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.501+0000 7fed3a59c640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fed1c06ac00 0x7fed1c06d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fed2c034000 tx=0x7fed2c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.505+0000 7fed2affd640 1 -- 172.21.15.29:0/1634242065 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fed3c13d390 con 0x7fed3c146300 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.678+0000 7fed408e9640 1 -- 172.21.15.29:0/1634242065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed3c13d350 con 0x7fed3c146300 2024-09-13T18:45:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.679+0000 7fed2affd640 1 -- 172.21.15.29:0/1634242065 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18298 (secure 0 0 0) 0x7fed340542a0 con 0x7fed3c146300 2024-09-13T18:45:54.682 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:54.682 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:45:26.405188+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.681+0000 7fed408e9640 1 -- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fed1c06ac00 msgr2=0x7fed1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.681+0000 7fed408e9640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fed1c06ac00 0x7fed1c06d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fed2c034000 tx=0x7fed2c02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.681+0000 7fed408e9640 1 -- 172.21.15.29:0/1634242065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed3c146300 msgr2=0x7fed3c1354e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.681+0000 7fed408e9640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed3c146300 0x7fed3c1354e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fed3400c710 tx=0x7fed3400cbd0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.681+0000 7fed408e9640 1 -- 172.21.15.29:0/1634242065 shutdown_connections 2024-09-13T18:45:54.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.681+0000 7fed408e9640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fed1c06ac00 0x7fed1c06d0c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.681+0000 7fed408e9640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed3c146300 0x7fed3c1354e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.681+0000 7fed408e9640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed3c13c550 0x7fed3c13f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.681+0000 7fed408e9640 1 --2- 172.21.15.29:0/1634242065 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fed3c0b1fc0 0x7fed3c138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.681+0000 7fed408e9640 1 -- 172.21.15.29:0/1634242065 >> 172.21.15.29:0/1634242065 conn(0x7fed3c06a890 msgr2=0x7fed3c071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:54.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.682+0000 7fed408e9640 1 -- 172.21.15.29:0/1634242065 shutdown_connections 2024-09-13T18:45:54.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.682+0000 7fed408e9640 1 -- 172.21.15.29:0/1634242065 wait complete. 2024-09-13T18:45:54.695 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:54.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.793+0000 7f2d1d9b5640 1 Processor -- start 2024-09-13T18:45:54.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.794+0000 7f2d1d9b5640 1 -- start start 2024-09-13T18:45:54.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.794+0000 7f2d1d9b5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d180b0cd0 0x7f2d18070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.794+0000 7f2d1d9b5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2d18071900 0x7f2d180710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.794+0000 7f2d1d9b5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1806eab0 con 0x7f2d1813d4f0 2024-09-13T18:45:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.794+0000 7f2d1d9b5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1806f3c0 con 0x7f2d18071900 2024-09-13T18:45:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.794+0000 7f2d1d9b5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180b10b0 con 0x7f2d180b0cd0 2024-09-13T18:45:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.795+0000 7f2d16ffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d180b0cd0 0x7f2d18070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.795+0000 7f2d167fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2d18071900 0x7f2d180710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.795+0000 7f2d177fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2d1813d4f0 0x7f2d1813d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:36768/0 (socket says 172.21.15.29:36768) 2024-09-13T18:45:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.795+0000 7f2d177fe640 1 -- 172.21.15.29:0/1396041984 learned_addr learned my addr 172.21.15.29:0/1396041984 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.795+0000 7f2d16ffd640 1 -- 172.21.15.29:0/1396041984 >> v2:172.21.15.96:3300/0 conn(0x7f2d18071900 msgr2=0x7f2d180710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.795+0000 7f2d16ffd640 1 --2- 172.21.15.29:0/1396041984 >> v2:172.21.15.96:3300/0 conn(0x7f2d18071900 0x7f2d180710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.795+0000 7f2d16ffd640 1 -- 172.21.15.29:0/1396041984 >> v1:172.21.15.96:6789/0 conn(0x7f2d1813d4f0 legacy=0x7f2d1813d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.795+0000 7f2d16ffd640 1 -- 172.21.15.29:0/1396041984 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180702d0 con 0x7f2d180b0cd0 2024-09-13T18:45:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.795+0000 7f2d167fc640 1 --2- 172.21.15.29:0/1396041984 >> v2:172.21.15.96:3300/0 conn(0x7f2d18071900 0x7f2d180710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:54.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.796+0000 7f2d16ffd640 1 --2- 172.21.15.29:0/1396041984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d180b0cd0 0x7f2d18070bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2d080097a0 tx=0x7f2d0802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=200f69ffa7b3068a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.796+0000 7f2d15ffb640 1 -- 172.21.15.29:0/1396041984 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0802ae50 con 0x7f2d180b0cd0 2024-09-13T18:45:54.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.796+0000 7f2d15ffb640 1 -- 172.21.15.29:0/1396041984 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d08032440 con 0x7f2d180b0cd0 2024-09-13T18:45:54.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.796+0000 7f2d15ffb640 1 -- 172.21.15.29:0/1396041984 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d080327d0 con 0x7f2d180b0cd0 2024-09-13T18:45:54.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.796+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/1396041984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d180b0cd0 msgr2=0x7f2d18070bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.796+0000 7f2d1d9b5640 1 --2- 172.21.15.29:0/1396041984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d180b0cd0 0x7f2d18070bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2d080097a0 tx=0x7f2d0802a100 comp rx=0 tx=0).stop 2024-09-13T18:45:54.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.796+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/1396041984 shutdown_connections 2024-09-13T18:45:54.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.796+0000 7f2d1d9b5640 1 --2- 172.21.15.29:0/1396041984 >> v2:172.21.15.96:3300/0 conn(0x7f2d18071900 0x7f2d180710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.796+0000 7f2d1d9b5640 1 --2- 172.21.15.29:0/1396041984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d180b0cd0 0x7f2d18070bb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.796+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/1396041984 >> 172.21.15.29:0/1396041984 conn(0x7f2d1806a890 msgr2=0x7f2d180b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:54.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.796+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/1396041984 shutdown_connections 2024-09-13T18:45:54.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.796+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/1396041984 wait complete. 2024-09-13T18:45:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.798+0000 7f2d1d9b5640 1 Processor -- start 2024-09-13T18:45:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.798+0000 7f2d1d9b5640 1 -- start start 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.798+0000 7f2d1d9b5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d18071900 0x7f2d180b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.798+0000 7f2d1d9b5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d180b0cd0 0x7f2d180af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.798+0000 7f2d1d9b5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d1813d4f0 0x7f2d180afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.798+0000 7f2d1d9b5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180ac200 con 0x7f2d18071900 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.798+0000 7f2d1d9b5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180af330 con 0x7f2d180b0cd0 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.798+0000 7f2d1d9b5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180aece0 con 0x7f2d1813d4f0 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.798+0000 7f2d16ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d18071900 0x7f2d180b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d16ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d18071900 0x7f2d180b6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59488/0 (socket says 172.21.15.29:59488) 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d16ffd640 1 -- 172.21.15.29:0/3001565991 learned_addr learned my addr 172.21.15.29:0/3001565991 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d167fc640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d180b0cd0 0x7f2d180af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d177fe640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d1813d4f0 0x7f2d180afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d16ffd640 1 -- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d1813d4f0 msgr2=0x7f2d180afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d16ffd640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d1813d4f0 0x7f2d180afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d16ffd640 1 -- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d180b0cd0 msgr2=0x7f2d180af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d16ffd640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d180b0cd0 0x7f2d180af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d16ffd640 1 -- 172.21.15.29:0/3001565991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c009400 con 0x7f2d18071900 2024-09-13T18:45:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d167fc640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d180b0cd0 0x7f2d180af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d16ffd640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d18071900 0x7f2d180b6480 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2d08035040 tx=0x7f2d080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2cfffff640 1 -- 172.21.15.29:0/3001565991 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0803d710 con 0x7f2d18071900 2024-09-13T18:45:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/3001565991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d08009400 con 0x7f2d18071900 2024-09-13T18:45:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2cfffff640 1 -- 172.21.15.29:0/3001565991 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0803d890 con 0x7f2d18071900 2024-09-13T18:45:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2cfffff640 1 -- 172.21.15.29:0/3001565991 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0803dc40 con 0x7f2d18071900 2024-09-13T18:45:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.799+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/3001565991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d181cba80 con 0x7f2d18071900 2024-09-13T18:45:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.800+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/3001565991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1813d940 con 0x7f2d18071900 2024-09-13T18:45:54.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.801+0000 7f2cfffff640 1 -- 172.21.15.29:0/3001565991 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2d08039040 con 0x7f2d18071900 2024-09-13T18:45:54.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.801+0000 7f2cfffff640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2d0406ac30 0x7f2d0406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.801+0000 7f2cfffff640 1 -- 172.21.15.29:0/3001565991 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2d080a9cc0 con 0x7f2d18071900 2024-09-13T18:45:54.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.801+0000 7f2d167fc640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2d0406ac30 0x7f2d0406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.802+0000 7f2d167fc640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2d0406ac30 0x7f2d0406d0f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2d18140570 tx=0x7f2d0c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:54.805+0000 7f2cfffff640 1 -- 172.21.15.29:0/3001565991 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2d08074d90 con 0x7f2d18071900 2024-09-13T18:45:55.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.011+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/3001565991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d1806fa30 con 0x7f2d18071900 2024-09-13T18:45:55.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.012+0000 7f2cfffff640 1 -- 172.21.15.29:0/3001565991 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3215 (secure 0 0 0) 0x7f2d08037ca0 con 0x7f2d18071900 2024-09-13T18:45:55.015 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:45:55.015 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/3867151553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3867151553},{"type":"v1","addr":"172.21.15.96:6835","nonce":3867151553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:22.006847+0000","modified":"2024-09-13T18:45:43.067420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6833/175129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":175129703},{"type":"v1","addr":"172.21.15.29:6833","nonce":175129703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:45:55.015 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-09-13T18:45:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.014+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2d0406ac30 msgr2=0x7f2d0406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.014+0000 7f2d1d9b5640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2d0406ac30 0x7f2d0406d0f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2d18140570 tx=0x7f2d0c009190 comp rx=0 tx=0).stop 2024-09-13T18:45:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.014+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/3001565991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d18071900 msgr2=0x7f2d180b6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.014+0000 7f2d1d9b5640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d18071900 0x7f2d180b6480 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2d08035040 tx=0x7f2d080046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.014+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/3001565991 shutdown_connections 2024-09-13T18:45:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.014+0000 7f2d1d9b5640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2d0406ac30 0x7f2d0406d0f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.014+0000 7f2d1d9b5640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2d1813d4f0 0x7f2d180afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.014+0000 7f2d1d9b5640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d180b0cd0 0x7f2d180af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.014+0000 7f2d1d9b5640 1 --2- 172.21.15.29:0/3001565991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d18071900 0x7f2d180b6480 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.014+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/3001565991 >> 172.21.15.29:0/3001565991 conn(0x7f2d1806a890 msgr2=0x7f2d180b6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.014+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/3001565991 shutdown_connections 2024-09-13T18:45:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.014+0000 7f2d1d9b5640 1 -- 172.21.15.29:0/3001565991 wait complete. 2024-09-13T18:45:55.230 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:45:22.006847+0000', 'modified': '2024-09-13T18:45:43.067420+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4239}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4239': {'gid': 4239, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6833/175129703', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6832', 'nonce': 175129703}, {'type': 'v1', 'addr': '172.21.15.29:6833', 'nonce': 175129703}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:45:55.230 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:45:55.230 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:45:55.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.332+0000 7f8b8911f640 1 Processor -- start 2024-09-13T18:45:55.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.332+0000 7f8b8911f640 1 -- start start 2024-09-13T18:45:55.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b8911f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8b8414c030 0x7f8b8414e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b8911f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8409cdb0 con 0x7f8b840ac9e0 2024-09-13T18:45:55.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b8911f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b840ae6c0 con 0x7f8b840b38b0 2024-09-13T18:45:55.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b8911f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b840ad300 con 0x7f8b8414c030 2024-09-13T18:45:55.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b82d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8b840ac9e0 0x7f8b84145d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44464/0 (socket says 172.21.15.29:44464) 2024-09-13T18:45:55.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b82d9d640 1 -- 172.21.15.29:0/2345700011 learned_addr learned my addr 172.21.15.29:0/2345700011 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:55.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852262650 0 0) 0x7f8b8409cdb0 con 0x7f8b840ac9e0 2024-09-13T18:45:55.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b8359e640 1 --2- 172.21.15.29:0/2345700011 >> v2:172.21.15.96:3300/0 conn(0x7f8b8414c030 0x7f8b8414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b6c003520 con 0x7f8b840ac9e0 2024-09-13T18:45:55.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3154288021 0 0) 0x7f8b6c003520 con 0x7f8b840ac9e0 2024-09-13T18:45:55.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 >> v2:172.21.15.96:3300/0 conn(0x7f8b8414c030 msgr2=0x7f8b8414e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b81d9b640 1 --2- 172.21.15.29:0/2345700011 >> v2:172.21.15.96:3300/0 conn(0x7f8b8414c030 0x7f8b8414e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.333+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 >> v1:172.21.15.96:6789/0 conn(0x7f8b840b38b0 legacy=0x7f8b84071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84099cf0 con 0x7f8b840ac9e0 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f8b74001690 con 0x7f8b840ac9e0 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 >> v1:172.21.15.29:6789/0 conn(0x7f8b840ac9e0 legacy=0x7f8b84145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b81d9b640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b6c003970 0x7f8b6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b81d9b640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b6c0047c0 0x7f8b6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b81d9b640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b6c005180 0x7f8b6c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840ad300 con 0x7f8b6c003970 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c00c120 con 0x7f8b6c005180 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b6c003970 0x7f8b6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c00c2e0 con 0x7f8b6c0047c0 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b8359e640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b6c005180 0x7f8b6c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b8259c640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b6c0047c0 0x7f8b6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b82d9d640 1 -- 172.21.15.29:0/2345700011 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b6c0047c0 msgr2=0x7f8b6c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b6c0047c0 0x7f8b6c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b82d9d640 1 -- 172.21.15.29:0/2345700011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b6c005180 msgr2=0x7f8b6c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b6c005180 0x7f8b6c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b82d9d640 1 -- 172.21.15.29:0/2345700011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c003520 con 0x7f8b6c003970 2024-09-13T18:45:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b8359e640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b6c005180 0x7f8b6c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b8259c640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b6c0047c0 0x7f8b6c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.334+0000 7f8b8359e640 1 -- 172.21.15.29:0/2345700011 reap_dead start 2024-09-13T18:45:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.335+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b6c003970 0x7f8b6c003d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8b8409cf40 tx=0x7f8b6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae3b69f4c49d99f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.335+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74005ad0 con 0x7f8b6c003970 2024-09-13T18:45:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.335+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7402d070 con 0x7f8b6c003970 2024-09-13T18:45:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.335+0000 7f8b81d9b640 1 -- 172.21.15.29:0/2345700011 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74007070 con 0x7f8b6c003970 2024-09-13T18:45:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.335+0000 7f8b8911f640 1 -- 172.21.15.29:0/2345700011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b6c003970 msgr2=0x7f8b6c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.335+0000 7f8b8911f640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b6c003970 0x7f8b6c003d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8b8409cf40 tx=0x7f8b6c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.335+0000 7f8b8911f640 1 -- 172.21.15.29:0/2345700011 shutdown_connections 2024-09-13T18:45:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.335+0000 7f8b8911f640 1 --2- 172.21.15.29:0/2345700011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b6c003970 0x7f8b6c003d90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.335+0000 7f8b8911f640 1 -- 172.21.15.29:0/2345700011 >> 172.21.15.29:0/2345700011 conn(0x7f8b840b3fb0 msgr2=0x7f8b840b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.335+0000 7f8b8911f640 1 -- 172.21.15.29:0/2345700011 shutdown_connections 2024-09-13T18:45:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.335+0000 7f8b8911f640 1 -- 172.21.15.29:0/2345700011 wait complete. 2024-09-13T18:45:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.337+0000 7f8b8911f640 1 Processor -- start 2024-09-13T18:45:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.337+0000 7f8b8911f640 1 -- start start 2024-09-13T18:45:55.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.337+0000 7f8b8911f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b6c003970 0x7f8b8414b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.337+0000 7f8b8911f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b841db230 0x7f8b841df090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.337+0000 7f8b8911f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b8409bde0 0x7f8b8413f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.337+0000 7f8b8911f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b841dc250 con 0x7f8b8409bde0 2024-09-13T18:45:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.337+0000 7f8b8911f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840aef00 con 0x7f8b841db230 2024-09-13T18:45:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.337+0000 7f8b8911f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8414bd70 con 0x7f8b6c003970 2024-09-13T18:45:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.337+0000 7f8b8359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b8409bde0 0x7f8b8413f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b8359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b8409bde0 0x7f8b8413f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59518/0 (socket says 172.21.15.29:59518) 2024-09-13T18:45:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b8359e640 1 -- 172.21.15.29:0/428258995 learned_addr learned my addr 172.21.15.29:0/428258995 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b8259c640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b841db230 0x7f8b841df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b6c003970 0x7f8b8414b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b8359e640 1 -- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b6c003970 msgr2=0x7f8b8414b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b8359e640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b6c003970 0x7f8b8414b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b8359e640 1 -- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b841db230 msgr2=0x7f8b841df090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b8359e640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b841db230 0x7f8b841df090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b8359e640 1 -- 172.21.15.29:0/428258995 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b841de8d0 con 0x7f8b8409bde0 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b8359e640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b8409bde0 0x7f8b8413f290 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8b840b4b30 tx=0x7f8b7c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b6b7fe640 1 -- 172.21.15.29:0/428258995 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00e050 con 0x7f8b8409bde0 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b6b7fe640 1 -- 172.21.15.29:0/428258995 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c00f040 con 0x7f8b8409bde0 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b8911f640 1 -- 172.21.15.29:0/428258995 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b841deb70 con 0x7f8b8409bde0 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b6b7fe640 1 -- 172.21.15.29:0/428258995 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c003990 con 0x7f8b8409bde0 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.338+0000 7f8b8911f640 1 -- 172.21.15.29:0/428258995 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b841df5d0 con 0x7f8b8409bde0 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.340+0000 7f8b6b7fe640 1 -- 172.21.15.29:0/428258995 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8b7c015440 con 0x7f8b8409bde0 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.341+0000 7f8b6b7fe640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8b7006ac00 0x7f8b7006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.341+0000 7f8b6b7fe640 1 -- 172.21.15.29:0/428258995 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b7c089f10 con 0x7f8b8409bde0 2024-09-13T18:45:55.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.341+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8b7006ac00 0x7f8b7006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.341+0000 7f8b8be41740 1 Processor -- start 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.341+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8b7006ac00 0x7f8b7006d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b74032000 tx=0x7f8b7402d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.341+0000 7f8b8be41740 1 -- start start 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8be41740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083867f0 0x55e9083b8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8be41740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 0x55e9083c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8be41740 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083c2be0 0x55e9083c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8be41740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9082e67c0 con 0x55e9083b8b60 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8be41740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9082f5b70 con 0x55e9083867f0 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8be41740 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9082f3300 con 0x55e9083c2be0 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 0x55e9083c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 0x55e9083c26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59532/0 (socket says 172.21.15.29:59532) 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8259c640 1 -- 172.21.15.29:0/3465641120 learned_addr learned my addr 172.21.15.29:0/3465641120 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/3465641120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083867f0 0x55e9083b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8359e640 1 --2- 172.21.15.29:0/3465641120 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083c2be0 0x55e9083c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8259c640 1 -- 172.21.15.29:0/3465641120 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083c2be0 msgr2=0x55e9083c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8259c640 1 --2- 172.21.15.29:0/3465641120 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083c2be0 0x55e9083c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8259c640 1 -- 172.21.15.29:0/3465641120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083867f0 msgr2=0x55e9083b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8259c640 1 --2- 172.21.15.29:0/3465641120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083867f0 0x55e9083b8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.342+0000 7f8b8259c640 1 -- 172.21.15.29:0/3465641120 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e90827b4b0 con 0x55e9083b8b60 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.343+0000 7f8b8259c640 1 --2- 172.21.15.29:0/3465641120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 0x55e9083c26a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8b780014b0 tx=0x7f8b78001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad1f1936f511bf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.343+0000 7f8b68ff9640 1 -- 172.21.15.29:0/3465641120 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7801a070 con 0x55e9083b8b60 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.343+0000 7f8b68ff9640 1 -- 172.21.15.29:0/3465641120 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b780053e0 con 0x55e9083b8b60 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.343+0000 7f8b68ff9640 1 -- 172.21.15.29:0/3465641120 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78007030 con 0x55e9083b8b60 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.343+0000 7f8b8be41740 1 -- 172.21.15.29:0/3465641120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 msgr2=0x55e9083c26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.343+0000 7f8b8be41740 1 --2- 172.21.15.29:0/3465641120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 0x55e9083c26a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8b780014b0 tx=0x7f8b78001970 comp rx=0 tx=0).stop 2024-09-13T18:45:55.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.343+0000 7f8b8be41740 1 -- 172.21.15.29:0/3465641120 shutdown_connections 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.343+0000 7f8b8be41740 1 --2- 172.21.15.29:0/3465641120 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083c2be0 0x55e9083c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.343+0000 7f8b8be41740 1 --2- 172.21.15.29:0/3465641120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 0x55e9083c26a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.343+0000 7f8b8be41740 1 --2- 172.21.15.29:0/3465641120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083867f0 0x55e9083b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.343+0000 7f8b8be41740 1 -- 172.21.15.29:0/3465641120 >> 172.21.15.29:0/3465641120 conn(0x55e908388500 msgr2=0x55e90838ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.344+0000 7f8b8be41740 1 -- 172.21.15.29:0/3465641120 shutdown_connections 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.344+0000 7f8b8be41740 1 -- 172.21.15.29:0/3465641120 wait complete. 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.344+0000 7f8b8be41740 1 -- start start 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.344+0000 7f8b8be41740 1 Processor -- start 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b8be41740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 0x55e9083bee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b8be41740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083c2be0 0x55e9083c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b8be41740 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083bfdf0 0x55e9083cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b8be41740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9082eebf0 con 0x55e9083b8b60 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b8be41740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9082ad250 con 0x55e9083c2be0 2024-09-13T18:45:55.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b8be41740 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9082acef0 con 0x55e9083bfdf0 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b8be41740 10 client.0 _ll_register_callbacks cb 0x55e9082df740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b82d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 0x55e9083bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b82d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 0x55e9083bee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59542/0 (socket says 172.21.15.29:59542) 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b82d9d640 1 -- 172.21.15.29:0/145029285 learned_addr learned my addr 172.21.15.29:0/145029285 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b8259c640 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083c2be0 0x55e9083c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b8359e640 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083bfdf0 0x55e9083cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b82d9d640 1 -- 172.21.15.29:0/145029285 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083bfdf0 msgr2=0x55e9083cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083bfdf0 0x55e9083cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b82d9d640 1 -- 172.21.15.29:0/145029285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083c2be0 msgr2=0x55e9083c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083c2be0 0x55e9083c1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b82d9d640 1 -- 172.21.15.29:0/145029285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7800f040 con 0x55e9083b8b60 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b8359e640 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083bfdf0 0x55e9083cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:55.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 0x55e9083bee40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c2d0 tx=0x7f8b7402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4919fed16f23e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b61ffb640 1 -- 172.21.15.29:0/145029285 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7403e660 con 0x55e9083b8b60 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b61ffb640 1 -- 172.21.15.29:0/145029285 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b7403e7c0 con 0x55e9083b8b60 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.345+0000 7f8b8be41740 1 -- 172.21.15.29:0/145029285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e907fe23c0 con 0x55e9083b8b60 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b61ffb640 1 -- 172.21.15.29:0/145029285 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b74007770 con 0x55e9083b8b60 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b8be41740 10 client.4797 fetch_fsmap learned FSMap version 9 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b8be41740 1 -- 172.21.15.29:0/145029285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e9082ed270 con 0x55e9083b8b60 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b61ffb640 1 -- 172.21.15.29:0/145029285 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e907fe23c0 con 0x55e9083b8b60 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b61ffb640 1 -- 172.21.15.29:0/145029285 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 9) v1 ==== 2032+0+0 (secure 0 0 0) 0x7f8b74048ca0 con 0x55e9083b8b60 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b8be41740 10 client.4797 fetch_fsmap finished waiting for FSMap version 9 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b8be41740 10 client.4797 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b8be41740 20 client.4797 populate_metadata read hostname 'smithi029' 2024-09-13T18:45:55.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b8be41740 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x55e90839e990 0x55e90839ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b8be41740 4 client.4797 mds_command: new command op to 4239 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:45:55.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b8be41740 1 -- 172.21.15.29:0/145029285 --> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e907ff36c0 con 0x55e90839e990 2024-09-13T18:45:55.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b8259c640 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x55e90839e990 0x55e90839ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b61ffb640 10 client.4797 ms_handle_connect on v2:172.21.15.29:6832/175129703 2024-09-13T18:45:55.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.346+0000 7f8b8259c640 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x55e90839e990 0x55e90839ed70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e554d1f0b46d56 server_cookie=25b84840343e4c7d in_seq=0 out_seq=0 2024-09-13T18:45:55.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b61ffb640 1 -- 172.21.15.29:0/145029285 <== mds.0 v2:172.21.15.29:6832/175129703 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55e907ff36c0 con 0x55e90839e990 2024-09-13T18:45:55.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b61ffb640 10 client.4797 handle_command_reply: tid=0 2024-09-13T18:45:55.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b8be41740 1 client.4797 shutdown 2024-09-13T18:45:55.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b8be41740 1 -- 172.21.15.29:0/145029285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 msgr2=0x55e9083bee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b8be41740 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 0x55e9083bee40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c2d0 tx=0x7f8b7402c000 comp rx=0 tx=0).stop 2024-09-13T18:45:55.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b8be41740 1 -- 172.21.15.29:0/145029285 shutdown_connections 2024-09-13T18:45:55.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b8be41740 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083bfdf0 0x55e9083cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b8be41740 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083c2be0 0x55e9083c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b8be41740 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x55e90839e990 0x55e90839ed70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b8be41740 1 --2- 172.21.15.29:0/145029285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083b8b60 0x55e9083bee40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b61ffb640 0 client.4797 ms_handle_reset on v2:172.21.15.29:6832/175129703 2024-09-13T18:45:55.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b8be41740 1 -- 172.21.15.29:0/145029285 >> 172.21.15.29:0/145029285 conn(0x55e9083867f0 msgr2=0x55e908385460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b8be41740 1 -- 172.21.15.29:0/145029285 shutdown_connections 2024-09-13T18:45:55.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b8be41740 1 -- 172.21.15.29:0/145029285 wait complete. 2024-09-13T18:45:55.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.347+0000 7f8b8be41740 20 client.4797 trim_cache size 0 max 16384 2024-09-13T18:45:55.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.362+0000 7f8b8be41740 1 Processor -- start 2024-09-13T18:45:55.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.362+0000 7f8b8be41740 1 -- start start 2024-09-13T18:45:55.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8be41740 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083b8b60 0x55e9083b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8be41740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083bfdf0 0x55e90838abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8be41740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 0x55e9083b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8be41740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e908272460 con 0x55e9083c2be0 2024-09-13T18:45:55.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8be41740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9083c2fc0 con 0x55e9083bfdf0 2024-09-13T18:45:55.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8be41740 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9082bf630 con 0x55e9083b8b60 2024-09-13T18:45:55.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 0x55e9083b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 0x55e9083b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59554/0 (socket says 172.21.15.29:59554) 2024-09-13T18:45:55.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8359e640 1 -- 172.21.15.29:0/1856574736 learned_addr learned my addr 172.21.15.29:0/1856574736 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:55.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8359e640 1 -- 172.21.15.29:0/1856574736 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083b8b60 msgr2=0x55e9083b73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8359e640 1 --2- 172.21.15.29:0/1856574736 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083b8b60 0x55e9083b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8359e640 1 -- 172.21.15.29:0/1856574736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083bfdf0 msgr2=0x55e90838abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8359e640 1 --2- 172.21.15.29:0/1856574736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083bfdf0 0x55e90838abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8359e640 1 -- 172.21.15.29:0/1856574736 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e90828f5f0 con 0x55e9083c2be0 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b8359e640 1 --2- 172.21.15.29:0/1856574736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 0x55e9083b3500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c088180 tx=0x7f8b7c058c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed1135d655adffa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b697fa640 1 -- 172.21.15.29:0/1856574736 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c056f20 con 0x55e9083c2be0 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b697fa640 1 -- 172.21.15.29:0/1856574736 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c055290 con 0x55e9083c2be0 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.363+0000 7f8b697fa640 1 -- 172.21.15.29:0/1856574736 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c059000 con 0x55e9083c2be0 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.364+0000 7f8b8be41740 1 -- 172.21.15.29:0/1856574736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 msgr2=0x55e9083b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.364+0000 7f8b8be41740 1 --2- 172.21.15.29:0/1856574736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 0x55e9083b3500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c088180 tx=0x7f8b7c058c90 comp rx=0 tx=0).stop 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.364+0000 7f8b8be41740 1 -- 172.21.15.29:0/1856574736 shutdown_connections 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.364+0000 7f8b8be41740 1 --2- 172.21.15.29:0/1856574736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 0x55e9083b3500 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.364+0000 7f8b8be41740 1 --2- 172.21.15.29:0/1856574736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083bfdf0 0x55e90838abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.364+0000 7f8b8be41740 1 --2- 172.21.15.29:0/1856574736 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083b8b60 0x55e9083b73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.364+0000 7f8b8be41740 1 -- 172.21.15.29:0/1856574736 >> 172.21.15.29:0/1856574736 conn(0x55e9083867f0 msgr2=0x55e908386bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.364+0000 7f8b8be41740 1 -- 172.21.15.29:0/1856574736 shutdown_connections 2024-09-13T18:45:55.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.364+0000 7f8b8be41740 1 -- 172.21.15.29:0/1856574736 wait complete. 2024-09-13T18:45:55.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.364+0000 7f8b8be41740 1 -- start start 2024-09-13T18:45:55.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.364+0000 7f8b8be41740 1 Processor -- start 2024-09-13T18:45:55.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8be41740 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083b8b60 0x55e9083858f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8be41740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083bfdf0 0x55e9083b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8be41740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 0x55e908425320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8be41740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9083dc760 con 0x55e9083c2be0 2024-09-13T18:45:55.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8be41740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9083c9f00 con 0x55e9083bfdf0 2024-09-13T18:45:55.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8be41740 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e908385e30 con 0x55e9083b8b60 2024-09-13T18:45:55.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8be41740 10 client.0 _ll_register_callbacks cb 0x7f8b6c004640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:45:55.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 0x55e908425320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 0x55e908425320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59566/0 (socket says 172.21.15.29:59566) 2024-09-13T18:45:55.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8359e640 1 -- 172.21.15.29:0/2186966287 learned_addr learned my addr 172.21.15.29:0/2186966287 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083b8b60 0x55e9083858f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8359e640 1 -- 172.21.15.29:0/2186966287 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083b8b60 msgr2=0x55e9083858f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8259c640 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083bfdf0 0x55e9083b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8359e640 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083b8b60 0x55e9083858f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8359e640 1 -- 172.21.15.29:0/2186966287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083bfdf0 msgr2=0x55e9083b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8359e640 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083bfdf0 0x55e9083b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.365+0000 7f8b8359e640 1 -- 172.21.15.29:0/2186966287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b841df5d0 con 0x55e9083c2be0 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b8359e640 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 0x55e908425320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c007fd0 tx=0x7f8b7c0880b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b54ab021a30123 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b61ffb640 1 -- 172.21.15.29:0/2186966287 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c058de0 con 0x55e9083c2be0 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b61ffb640 1 -- 172.21.15.29:0/2186966287 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b7c058f40 con 0x55e9083c2be0 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b8be41740 1 -- 172.21.15.29:0/2186966287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b780053e0 con 0x55e9083c2be0 2024-09-13T18:45:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b61ffb640 1 -- 172.21.15.29:0/2186966287 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b7c060a30 con 0x55e9083c2be0 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b8be41740 10 client.4803 fetch_fsmap learned FSMap version 9 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b8be41740 1 -- 172.21.15.29:0/2186966287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e9082b4d00 con 0x55e9083c2be0 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b61ffb640 1 -- 172.21.15.29:0/2186966287 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b780053e0 con 0x55e9083c2be0 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b61ffb640 1 -- 172.21.15.29:0/2186966287 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 9) v1 ==== 2032+0+0 (secure 0 0 0) 0x7f8b7c070180 con 0x55e9083c2be0 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b8be41740 10 client.4803 fetch_fsmap finished waiting for FSMap version 9 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b8be41740 10 client.4803 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b8be41740 20 client.4803 populate_metadata read hostname 'smithi029' 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b8be41740 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x55e908425860 0x55e9083b8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b8be41740 4 client.4803 mds_command: new command op to 4239 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b8be41740 1 -- 172.21.15.29:0/2186966287 --> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e908046d10 con 0x55e908425860 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.366+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x55e908425860 0x55e9083b8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b61ffb640 10 client.4803 ms_handle_connect on v2:172.21.15.29:6832/175129703 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b82d9d640 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x55e908425860 0x55e9083b8f40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89f6375adf81ea5d server_cookie=855eb2e082eaeabe in_seq=0 out_seq=0 2024-09-13T18:45:55.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b61ffb640 1 -- 172.21.15.29:0/2186966287 <== mds.0 v2:172.21.15.29:6832/175129703 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55e908046d10 con 0x55e908425860 2024-09-13T18:45:55.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b61ffb640 10 client.4803 handle_command_reply: tid=0 2024-09-13T18:45:55.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8be41740 1 client.4803 shutdown 2024-09-13T18:45:55.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8be41740 1 -- 172.21.15.29:0/2186966287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 msgr2=0x55e908425320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8be41740 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 0x55e908425320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c007fd0 tx=0x7f8b7c0880b0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8be41740 1 -- 172.21.15.29:0/2186966287 shutdown_connections 2024-09-13T18:45:55.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8be41740 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.29:6832/175129703,v1:172.21.15.29:6833/175129703] conn(0x55e908425860 0x55e9083b8f40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8be41740 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9083c2be0 0x55e908425320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8be41740 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e9083bfdf0 0x55e9083b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b61ffb640 0 client.4803 ms_handle_reset on v2:172.21.15.29:6832/175129703 2024-09-13T18:45:55.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8be41740 1 --2- 172.21.15.29:0/2186966287 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55e9083b8b60 0x55e9083858f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8be41740 1 -- 172.21.15.29:0/2186966287 >> 172.21.15.29:0/2186966287 conn(0x55e9083867f0 msgr2=0x55e9083be930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8be41740 1 -- 172.21.15.29:0/2186966287 shutdown_connections 2024-09-13T18:45:55.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8be41740 1 -- 172.21.15.29:0/2186966287 wait complete. 2024-09-13T18:45:55.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8be41740 20 client.4803 trim_cache size 0 max 16384 2024-09-13T18:45:55.377 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-13T18:45:55.377 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "41f49ea7-93ea-4289-a814-d28f860525af", 2024-09-13T18:45:55.377 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-09-13T18:45:55.377 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4239, 2024-09-13T18:45:55.377 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-13T18:45:55.377 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-13T18:45:55.377 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-13T18:45:55.378 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 33.359503756000002, 2024-09-13T18:45:55.378 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 9, 2024-09-13T18:45:55.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 24, 2024-09-13T18:45:55.378 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-09-13T18:45:55.378 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 39.391167590000002 2024-09-13T18:45:55.378 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-13T18:45:55.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8911f640 1 -- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8b7006ac00 msgr2=0x7f8b7006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8911f640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8b7006ac00 0x7f8b7006d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b74032000 tx=0x7f8b7402d000 comp rx=0 tx=0).stop 2024-09-13T18:45:55.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8911f640 1 -- 172.21.15.29:0/428258995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b8409bde0 msgr2=0x7f8b8413f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.367+0000 7f8b8911f640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b8409bde0 0x7f8b8413f290 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8b840b4b30 tx=0x7f8b7c010590 comp rx=0 tx=0).stop 2024-09-13T18:45:55.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.368+0000 7f8b8911f640 1 -- 172.21.15.29:0/428258995 shutdown_connections 2024-09-13T18:45:55.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.368+0000 7f8b8911f640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f8b7006ac00 0x7f8b7006d0c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.368+0000 7f8b8911f640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b8409bde0 0x7f8b8413f290 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.368+0000 7f8b8911f640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b841db230 0x7f8b841df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.368+0000 7f8b8911f640 1 --2- 172.21.15.29:0/428258995 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b6c003970 0x7f8b8414b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.368+0000 7f8b8911f640 1 -- 172.21.15.29:0/428258995 >> 172.21.15.29:0/428258995 conn(0x7f8b840b3fb0 msgr2=0x7f8b840b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.368+0000 7f8b8911f640 1 -- 172.21.15.29:0/428258995 shutdown_connections 2024-09-13T18:45:55.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.368+0000 7f8b8911f640 1 -- 172.21.15.29:0/428258995 wait complete. 2024-09-13T18:45:55.381 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T18:45:55.391 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T18:45:55.391 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T18:45:55.391 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T18:45:55.392 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T18:45:55.451 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T18:45:55.451 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-13T18:45:55.451 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T18:45:55.451 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:45:55.451 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:55.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:55.452 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-09-13T18:45:55.468 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T18:45:55.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:55.469 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T18:45:55.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:55.535 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-09-13T18:45:55.630 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T18:45:55.630 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:45:55.630 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:45:55.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.730+0000 7f6188b53640 1 Processor -- start 2024-09-13T18:45:55.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.730+0000 7f6188b53640 1 -- start start 2024-09-13T18:45:55.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.731+0000 7f6188b53640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61840b38b0 0x7f6184071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.731+0000 7f6188b53640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618409cdb0 con 0x7f6184071fb0 2024-09-13T18:45:55.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.731+0000 7f6188b53640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61840ae6c0 con 0x7f61840ac9e0 2024-09-13T18:45:55.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.731+0000 7f6188b53640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61840ad300 con 0x7f61840b38b0 2024-09-13T18:45:55.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.731+0000 7f6182d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6184071fb0 0x7f618414d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44470/0 (socket says 172.21.15.29:44470) 2024-09-13T18:45:55.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.731+0000 7f6182d9d640 1 -- 172.21.15.29:0/293942162 learned_addr learned my addr 172.21.15.29:0/293942162 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:45:55.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f6181d9b640 1 --2- 172.21.15.29:0/293942162 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61840b38b0 0x7f6184071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245530587 0 0) 0x7f618409cdb0 con 0x7f6184071fb0 2024-09-13T18:45:55.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f616c003520 con 0x7f6184071fb0 2024-09-13T18:45:55.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1764064813 0 0) 0x7f616c003520 con 0x7f6184071fb0 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61840b38b0 msgr2=0x7f6184071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 --2- 172.21.15.29:0/293942162 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61840b38b0 0x7f6184071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 >> v1:172.21.15.96:6789/0 conn(0x7f61840ac9e0 legacy=0x7f6184145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6184099cf0 con 0x7f6184071fb0 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f617c0019f0 con 0x7f6184071fb0 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 >> v1:172.21.15.29:6789/0 conn(0x7f6184071fb0 legacy=0x7f618414d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 --2- 172.21.15.29:0/293942162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616c0039a0 0x7f616c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 --2- 172.21.15.29:0/293942162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f616c004350 0x7f616c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 --2- 172.21.15.29:0/293942162 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61840b38b0 0x7f616c005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61840ad300 con 0x7f616c0039a0 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c00ba30 con 0x7f616c004350 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c00de00 con 0x7f61840b38b0 2024-09-13T18:45:55.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618259c640 1 --2- 172.21.15.29:0/293942162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616c0039a0 0x7f616c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f6181d9b640 1 --2- 172.21.15.29:0/293942162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f616c004350 0x7f616c004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f6182d9d640 1 --2- 172.21.15.29:0/293942162 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61840b38b0 0x7f616c005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618259c640 1 -- 172.21.15.29:0/293942162 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61840b38b0 msgr2=0x7f616c005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618259c640 1 --2- 172.21.15.29:0/293942162 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61840b38b0 0x7f616c005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618259c640 1 -- 172.21.15.29:0/293942162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f616c004350 msgr2=0x7f616c004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.732+0000 7f618259c640 1 --2- 172.21.15.29:0/293942162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f616c004350 0x7f616c004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.733+0000 7f618259c640 1 -- 172.21.15.29:0/293942162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c003520 con 0x7f616c0039a0 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.733+0000 7f618259c640 1 --2- 172.21.15.29:0/293942162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616c0039a0 0x7f616c003d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6174001860 tx=0x7f616c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc566dff2b52176 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.733+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617402ac10 con 0x7f616c0039a0 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.733+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617402ad90 con 0x7f616c0039a0 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.733+0000 7f618159a640 1 -- 172.21.15.29:0/293942162 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174032680 con 0x7f616c0039a0 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.734+0000 7f6188b53640 1 -- 172.21.15.29:0/293942162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616c0039a0 msgr2=0x7f616c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.734+0000 7f6188b53640 1 --2- 172.21.15.29:0/293942162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616c0039a0 0x7f616c003d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6174001860 tx=0x7f616c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.734+0000 7f6182d9d640 1 -- 172.21.15.29:0/293942162 reap_dead start 2024-09-13T18:45:55.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.734+0000 7f6188b53640 1 -- 172.21.15.29:0/293942162 shutdown_connections 2024-09-13T18:45:55.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.734+0000 7f6188b53640 1 -- 172.21.15.29:0/293942162 >> 172.21.15.29:0/293942162 conn(0x7f61840b3fb0 msgr2=0x7f61840b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.734+0000 7f6188b53640 1 -- 172.21.15.29:0/293942162 shutdown_connections 2024-09-13T18:45:55.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.734+0000 7f6188b53640 1 -- 172.21.15.29:0/293942162 wait complete. 2024-09-13T18:45:55.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.735+0000 7f6188b53640 1 Processor -- start 2024-09-13T18:45:55.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.735+0000 7f6188b53640 1 -- start start 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6188b53640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f616c0039a0 0x7f61840af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6188b53640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61841deee0 0x7f61841dae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6188b53640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61841db3d0 0x7f61841db850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6188b53640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61841dbd90 con 0x7f61841db3d0 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6188b53640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61841dea50 con 0x7f616c0039a0 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6188b53640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61841df360 con 0x7f61841deee0 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6182d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61841db3d0 0x7f61841db850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6182d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61841db3d0 0x7f61841db850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59578/0 (socket says 172.21.15.29:59578) 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6182d9d640 1 -- 172.21.15.29:0/433459834 learned_addr learned my addr 172.21.15.29:0/433459834 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6181d9b640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61841deee0 0x7f61841dae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f618259c640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f616c0039a0 0x7f61840af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6182d9d640 1 -- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61841deee0 msgr2=0x7f61841dae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6182d9d640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61841deee0 0x7f61841dae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6182d9d640 1 -- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f616c0039a0 msgr2=0x7f61840af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6182d9d640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f616c0039a0 0x7f61840af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.736+0000 7f6182d9d640 1 -- 172.21.15.29:0/433459834 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6184143c70 con 0x7f61841db3d0 2024-09-13T18:45:55.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.737+0000 7f6182d9d640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61841db3d0 0x7f61841db850 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f618406ad40 tx=0x7f617c007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.737+0000 7f6172ffd640 1 -- 172.21.15.29:0/433459834 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c00ab60 con 0x7f61841db3d0 2024-09-13T18:45:55.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.737+0000 7f6172ffd640 1 -- 172.21.15.29:0/433459834 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617c00ace0 con 0x7f61841db3d0 2024-09-13T18:45:55.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.737+0000 7f6188b53640 1 -- 172.21.15.29:0/433459834 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61841de400 con 0x7f61841db3d0 2024-09-13T18:45:55.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.737+0000 7f6172ffd640 1 -- 172.21.15.29:0/433459834 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c013630 con 0x7f61841db3d0 2024-09-13T18:45:55.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.737+0000 7f6188b53640 1 -- 172.21.15.29:0/433459834 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6184143990 con 0x7f61841db3d0 2024-09-13T18:45:55.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.738+0000 7f6188b53640 1 -- 172.21.15.29:0/433459834 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618409d770 con 0x7f61841db3d0 2024-09-13T18:45:55.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.738+0000 7f6172ffd640 1 -- 172.21.15.29:0/433459834 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f617c013790 con 0x7f61841db3d0 2024-09-13T18:45:55.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.739+0000 7f6172ffd640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f616406ac00 0x7f616406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.739+0000 7f6172ffd640 1 -- 172.21.15.29:0/433459834 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f617c089c90 con 0x7f61841db3d0 2024-09-13T18:45:55.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.739+0000 7f618259c640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f616406ac00 0x7f616406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.739+0000 7f618259c640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f616406ac00 0x7f616406d0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6174034000 tx=0x7f6174009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.743+0000 7f6172ffd640 1 -- 172.21.15.29:0/433459834 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f617c054b70 con 0x7f61841db3d0 2024-09-13T18:45:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.949+0000 7f6188b53640 1 -- 172.21.15.29:0/433459834 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f61840b6870 con 0x7f61841db3d0 2024-09-13T18:45:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.950+0000 7f6172ffd640 1 -- 172.21.15.29:0/433459834 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f617c058190 con 0x7f61841db3d0 2024-09-13T18:45:55.952 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:45:55.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.951+0000 7f6188b53640 1 -- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f616406ac00 msgr2=0x7f616406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.951+0000 7f6188b53640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f616406ac00 0x7f616406d0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6174034000 tx=0x7f6174009030 comp rx=0 tx=0).stop 2024-09-13T18:45:55.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.951+0000 7f6188b53640 1 -- 172.21.15.29:0/433459834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61841db3d0 msgr2=0x7f61841db850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.951+0000 7f6188b53640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61841db3d0 0x7f61841db850 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f618406ad40 tx=0x7f617c007b10 comp rx=0 tx=0).stop 2024-09-13T18:45:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.952+0000 7f6188b53640 1 -- 172.21.15.29:0/433459834 shutdown_connections 2024-09-13T18:45:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.952+0000 7f6188b53640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f616406ac00 0x7f616406d0c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.952+0000 7f6188b53640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61841db3d0 0x7f61841db850 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.952+0000 7f6188b53640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61841deee0 0x7f61841dae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.952+0000 7f6188b53640 1 --2- 172.21.15.29:0/433459834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f616c0039a0 0x7f61840af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.952+0000 7f6188b53640 1 -- 172.21.15.29:0/433459834 >> 172.21.15.29:0/433459834 conn(0x7f61840b3fb0 msgr2=0x7f61840b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.952+0000 7f6188b53640 1 -- 172.21.15.29:0/433459834 shutdown_connections 2024-09-13T18:45:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:45:55.952+0000 7f6188b53640 1 -- 172.21.15.29:0/433459834 wait complete. 2024-09-13T18:45:55.965 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:45:55.965 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:45:55.966 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-09-13T18:45:55.966 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:45:55.966 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:55.966 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:45:55.966 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:45:55.966 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:45:55.966 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:45:55.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:55.966 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-09-13T18:45:55.982 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:45:55.982 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:45:55.982 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:45:55.982 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:55.982 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-09-13T18:45:55.982 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:55.982 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42772sec preferred_lft 42772sec 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:45:55.983 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:55.984 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-09-13T18:45:55.984 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:45:55.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:55.984 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-09-13T18:45:55.984 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-13T18:45:55.984 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:45:55.984 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-09-13T18:45:55.984 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-09-13T18:45:55.984 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:45:55.984 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-13T18:45:56.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:56.084 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:45:56.108 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-09-13T18:45:56.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:56.110 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-09-13T18:45:56.167 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-09-13T18:45:56.168 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:45:56.168 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T18:45:56.168 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T18:45:56.168 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:45:56.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:56.168 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-09-13T18:45:56.168 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-13T18:45:56.168 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:45:56.169 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:45:56.169 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:45:56.169 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-13T18:45:56.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:56.262 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-09-13T18:45:56.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:56.278 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-09-13T18:45:56.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:56.333 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-09-13T18:45:56.333 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-13T18:45:56.333 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:45:56.333 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:45:56.334 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-13T18:45:56.412 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:45:56.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:56.412 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-09-13T18:45:56.412 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-13T18:45:56.412 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:45:56.412 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:45:56.413 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:45:56.413 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:45:56.413 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:45:56.413 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-13T18:45:56.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:56.529 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-09-13T18:45:56.529 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-13T18:45:56.529 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-09-13T18:45:56.529 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:45:56.529 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-13T18:45:56.568 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:45:56.568 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:45:56.568 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:56.625 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:45:56.626 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:45:56.626 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:56.681 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-09-13T18:45:56.748 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:45:56.748 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:45:56.813 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:45:56.814 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:45:56.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:56.815 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-09-13T18:45:56.871 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:45:56.871 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:45:56.914 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-09-13T18:45:56.939 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:45:56.939 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:45:56.998 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2024-09-13T18:45:56.996+0000 7fb912f6d480 -1 init, newargv = 0x564ca38d0df0 newargc=15 2024-09-13T18:45:56.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[45126]: starting ceph client 2024-09-13T18:45:57.003 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[45126]: starting fuse 2024-09-13T18:45:57.006 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:45:57.007 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:45:57.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:57.008 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-09-13T18:45:57.064 INFO:teuthology.orchestra.run.smithi029.stdout:41 2024-09-13T18:45:57.064 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-13T18:45:57.064 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:45:57.064 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-09-13T18:45:57.064 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-13T18:45:57.065 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-09-13T18:45:57.066 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:45:57.066 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:45:57.066 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:45:57.066 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-09-13T18:45:57.066 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-09-13T18:45:57.066 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-09-13T18:45:57.066 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:45:57.066 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-13T18:45:57.066 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2024-09-13T18:45:57.066 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-09-13T18:45:57.180 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.45126.asok 2024-09-13T18:45:57.367 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45126.asok 2024-09-13T18:45:57.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:57.367 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45126.asok status 2024-09-13T18:45:57.506 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-13T18:45:57.507 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-09-13T18:45:57.507 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:45:57.507 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:45:57.507 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2024-09-13T18:45:57.507 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-09-13T18:45:57.507 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:45:57.507 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "45126", 2024-09-13T18:45:57.507 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-09-13T18:45:57.507 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-13T18:45:57.507 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-09-13T18:45:57.507 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4646, 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4646 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3210024643 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-09-13T18:45:57.508 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-09-13T18:45:57.509 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:45:57.509 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3210024643 2024-09-13T18:45:57.509 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-13T18:45:57.509 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4646 192.168.0.1:0/3210024643", 2024-09-13T18:45:57.509 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/3210024643", 2024-09-13T18:45:57.509 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-09-13T18:45:57.509 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 9, 2024-09-13T18:45:57.509 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 24, 2024-09-13T18:45:57.509 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:45:57.509 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-09-13T18:45:57.509 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-09-13T18:45:57.509 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-13T18:45:57.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:57.515 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-09-13T18:45:57.515 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:57.532 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-09-13T18:45:57.532 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:57.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:57.532 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:57.598 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T18:45:57.612 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:45:57.613 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T18:45:57.613 INFO:tasks.workunit:timeout=3h 2024-09-13T18:45:57.613 INFO:tasks.workunit:cleanup=True 2024-09-13T18:45:57.613 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:57.654 INFO:teuthology.orchestra.run.smithi029.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:57.655 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T18:45:57.655 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-09-13T18:45:57.655 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:45:57.655 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-13T18:45:57.655 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T18:45:57.655 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-13 18:45:22.009150885 +0000 2024-09-13T18:45:57.655 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-13 18:45:30.679841405 +0000 2024-09-13T18:45:57.655 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2024-09-13T18:45:57.655 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:57.656 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T18:45:57.725 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:45:57.782 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T18:46:02.459 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:02.462 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:32.588 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:32.592 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:58.686 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 90% (11513/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T18:46:59.665 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:46:59.665 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:46:59.665 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:46:59.665 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:46:59.666 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:46:59.667 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:46:59.672 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T18:46:59.721 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:46:59.722 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:46:59.722 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:47:00.616 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:47:00.730 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:47:00.774 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:47:00.776 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:47:00.776 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:47:00.817 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:47:00.820 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:47:00.820 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T18:47:00.878 INFO:tasks.workunit:Running workunits matching fs/misc/acl.sh on client.0... 2024-09-13T18:47:00.879 INFO:tasks.workunit:Running workunit fs/misc/acl.sh... 2024-09-13T18:47:00.880 DEBUG:teuthology.orchestra.run.smithi029:workunit test fs/misc/acl.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/acl.sh 2024-09-13T18:47:00.945 INFO:tasks.workunit.client.0.smithi029.stderr:+ set -e 2024-09-13T18:47:00.945 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir -p testdir 2024-09-13T18:47:00.946 INFO:tasks.workunit.client.0.smithi029.stderr:+ cd testdir 2024-09-13T18:47:00.948 INFO:tasks.workunit.client.0.smithi029.stderr:+ set +e 2024-09-13T18:47:00.948 INFO:tasks.workunit.client.0.smithi029.stderr:+ setfacl -d -m u:nobody:rw . 2024-09-13T18:47:00.961 INFO:tasks.workunit.client.0.smithi029.stderr:+ test 0 '!=' 0 2024-09-13T18:47:00.962 INFO:tasks.workunit.client.0.smithi029.stderr:+ set -e 2024-09-13T18:47:00.962 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=0 2024-09-13T18:47:00.962 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 0 -lt 100 ']' 2024-09-13T18:47:00.962 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 0 + 1 2024-09-13T18:47:00.962 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=1 2024-09-13T18:47:00.962 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:00.964 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:00.964 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:00.966 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:00.967 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:00.967 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:01.566 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:01.567 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:01.777 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:01.777 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:01.787 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:01.787 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:01.787 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 1 -lt 100 ']' 2024-09-13T18:47:01.787 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 1 + 1 2024-09-13T18:47:01.819 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=2 2024-09-13T18:47:01.819 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:01.841 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:01.841 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:01.843 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:01.843 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:01.843 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:02.642 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:02.642 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:02.691 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:02.694 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:02.877 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:02.878 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:02.887 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:02.888 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:02.888 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -lt 100 ']' 2024-09-13T18:47:02.888 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 2 + 1 2024-09-13T18:47:02.936 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=3 2024-09-13T18:47:02.936 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:02.966 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:02.966 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:02.968 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:02.968 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:02.968 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:03.683 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:03.683 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:03.818 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:03.818 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:03.829 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:03.829 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:03.829 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 3 -lt 100 ']' 2024-09-13T18:47:03.829 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 3 + 1 2024-09-13T18:47:03.886 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=4 2024-09-13T18:47:03.886 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:03.897 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:03.897 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:03.899 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:03.899 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:03.900 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:04.374 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:04.375 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:04.571 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:04.571 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:04.579 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:04.579 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:04.579 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 4 -lt 100 ']' 2024-09-13T18:47:04.579 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 4 + 1 2024-09-13T18:47:04.611 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=5 2024-09-13T18:47:04.611 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:04.645 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:04.645 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:04.647 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:04.647 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:04.647 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:05.150 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:05.150 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:05.313 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:05.313 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:05.321 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:05.321 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:05.321 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 5 -lt 100 ']' 2024-09-13T18:47:05.321 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 5 + 1 2024-09-13T18:47:05.352 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=6 2024-09-13T18:47:05.352 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:05.374 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:05.374 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:05.376 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:05.376 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:05.377 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:05.924 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:05.925 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:06.079 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:06.079 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:06.087 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:06.087 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:06.087 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 6 -lt 100 ']' 2024-09-13T18:47:06.087 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 6 + 1 2024-09-13T18:47:06.119 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=7 2024-09-13T18:47:06.119 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:06.141 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:06.141 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:06.142 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:06.142 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:06.143 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:06.658 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:06.658 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:06.804 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:06.805 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:06.812 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:06.813 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:06.813 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 7 -lt 100 ']' 2024-09-13T18:47:06.813 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 7 + 1 2024-09-13T18:47:06.852 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=8 2024-09-13T18:47:06.852 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:06.874 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:06.874 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:06.876 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:06.876 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:06.876 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:07.399 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:07.399 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:07.545 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:07.545 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:07.553 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:07.553 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:07.553 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 8 -lt 100 ']' 2024-09-13T18:47:07.554 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 8 + 1 2024-09-13T18:47:07.585 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=9 2024-09-13T18:47:07.585 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:07.607 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:07.607 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:07.609 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:07.609 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:07.610 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:08.166 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:08.166 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:08.304 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:08.304 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:08.312 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:08.312 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:08.312 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 9 -lt 100 ']' 2024-09-13T18:47:08.312 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 9 + 1 2024-09-13T18:47:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=10 2024-09-13T18:47:08.344 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:08.379 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:08.379 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:08.381 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:08.381 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:08.381 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:08.882 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:08.882 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:09.070 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:09.070 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:09.079 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:09.080 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:09.080 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 10 -lt 100 ']' 2024-09-13T18:47:09.080 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 10 + 1 2024-09-13T18:47:09.118 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=11 2024-09-13T18:47:09.118 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:09.145 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:09.145 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:09.147 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:09.147 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:09.147 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:09.657 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:09.658 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:09.813 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:09.814 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:09.830 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:09.830 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:09.830 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 11 -lt 100 ']' 2024-09-13T18:47:09.831 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 11 + 1 2024-09-13T18:47:09.868 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=12 2024-09-13T18:47:09.868 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:09.891 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:09.891 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:09.893 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:09.893 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:09.893 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:10.433 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:10.433 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:10.620 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:10.621 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:10.630 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:10.630 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:10.630 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 12 -lt 100 ']' 2024-09-13T18:47:10.630 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 12 + 1 2024-09-13T18:47:10.668 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=13 2024-09-13T18:47:10.668 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:10.691 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:10.691 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:10.693 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:10.693 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:10.694 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:11.232 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:11.232 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:11.380 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:11.380 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:11.395 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:11.395 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:11.395 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 13 -lt 100 ']' 2024-09-13T18:47:11.395 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 13 + 1 2024-09-13T18:47:11.426 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=14 2024-09-13T18:47:11.426 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:11.449 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:11.449 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:11.451 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:11.451 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:11.451 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:11.969 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:11.969 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:12.111 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:12.112 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:12.120 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:12.121 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:12.121 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 14 -lt 100 ']' 2024-09-13T18:47:12.121 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 14 + 1 2024-09-13T18:47:12.160 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=15 2024-09-13T18:47:12.160 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:12.182 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:12.182 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:12.184 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:12.184 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:12.184 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:12.699 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:12.699 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:12.977 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:12.977 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:12.987 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:12.987 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:12.987 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 15 -lt 100 ']' 2024-09-13T18:47:12.987 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 15 + 1 2024-09-13T18:47:13.093 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=16 2024-09-13T18:47:13.094 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:13.123 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:13.124 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:13.126 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:13.126 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:13.126 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:13.648 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:13.649 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:13.788 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:13.788 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:13.803 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:13.803 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:13.803 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 16 -lt 100 ']' 2024-09-13T18:47:13.803 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 16 + 1 2024-09-13T18:47:13.834 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=17 2024-09-13T18:47:13.835 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:13.856 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:13.857 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:13.858 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:13.859 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:13.859 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:14.457 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:14.457 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:14.619 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:14.619 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:14.629 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:14.629 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:14.629 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 17 -lt 100 ']' 2024-09-13T18:47:14.629 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 17 + 1 2024-09-13T18:47:14.676 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=18 2024-09-13T18:47:14.676 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:14.699 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:14.699 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:14.701 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:14.701 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:14.701 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:15.248 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:15.249 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:15.403 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:15.403 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:15.412 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:15.412 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:15.412 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 18 -lt 100 ']' 2024-09-13T18:47:15.412 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 18 + 1 2024-09-13T18:47:15.451 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=19 2024-09-13T18:47:15.451 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:15.473 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:15.473 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:15.475 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:15.475 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:15.475 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:16.023 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:16.023 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:16.161 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:16.161 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:16.170 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:16.170 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:16.171 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 19 -lt 100 ']' 2024-09-13T18:47:16.171 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 19 + 1 2024-09-13T18:47:16.201 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=20 2024-09-13T18:47:16.201 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:16.223 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:16.223 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:16.225 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:16.225 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:16.225 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:16.757 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:16.757 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:16.922 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:16.922 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:16.937 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:16.937 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:16.938 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 20 -lt 100 ']' 2024-09-13T18:47:16.938 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 20 + 1 2024-09-13T18:47:16.984 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=21 2024-09-13T18:47:16.984 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:17.007 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:17.007 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:17.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:17.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:17.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:17.514 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:17.515 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:17.752 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:17.753 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:17.763 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:17.763 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:17.763 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 21 -lt 100 ']' 2024-09-13T18:47:17.763 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 21 + 1 2024-09-13T18:47:17.792 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=22 2024-09-13T18:47:17.793 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:17.814 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:17.815 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:17.816 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:17.816 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:17.816 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:18.656 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:18.657 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:18.886 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:18.886 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:18.895 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:18.895 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:18.895 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 22 -lt 100 ']' 2024-09-13T18:47:18.895 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 22 + 1 2024-09-13T18:47:18.942 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=23 2024-09-13T18:47:18.942 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:18.968 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:18.968 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:18.970 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:18.970 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:18.970 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:19.606 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:19.606 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:19.802 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:19.802 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:19.810 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:19.810 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:19.810 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 23 -lt 100 ']' 2024-09-13T18:47:19.811 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 23 + 1 2024-09-13T18:47:19.842 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=24 2024-09-13T18:47:19.842 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:19.864 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:19.865 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:19.866 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:19.867 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:19.867 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:20.415 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:20.415 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:20.610 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:20.610 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:20.619 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:20.619 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:20.619 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 24 -lt 100 ']' 2024-09-13T18:47:20.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 24 + 1 2024-09-13T18:47:20.650 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=25 2024-09-13T18:47:20.650 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:20.676 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:20.676 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:20.678 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:20.678 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:20.678 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:21.189 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:21.190 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:21.395 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:21.395 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:21.410 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:21.410 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:21.410 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 25 -lt 100 ']' 2024-09-13T18:47:21.411 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 25 + 1 2024-09-13T18:47:21.442 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=26 2024-09-13T18:47:21.442 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:21.464 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:21.465 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:21.466 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:21.466 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:21.467 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:22.031 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:22.031 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:22.243 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:22.244 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:22.254 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:22.254 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:22.254 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 26 -lt 100 ']' 2024-09-13T18:47:22.254 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 26 + 1 2024-09-13T18:47:22.300 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=27 2024-09-13T18:47:22.300 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:22.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:22.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:22.325 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:22.325 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:22.325 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:22.872 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:22.872 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:23.068 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:23.069 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:23.077 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:23.078 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:23.078 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 27 -lt 100 ']' 2024-09-13T18:47:23.078 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 27 + 1 2024-09-13T18:47:23.108 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=28 2024-09-13T18:47:23.109 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:23.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:23.131 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:23.133 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:23.133 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:23.133 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:23.872 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:23.873 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:24.137 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:24.137 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:24.153 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:24.154 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:24.154 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 28 -lt 100 ']' 2024-09-13T18:47:24.154 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 28 + 1 2024-09-13T18:47:24.225 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=29 2024-09-13T18:47:24.225 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:24.248 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:24.248 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:24.249 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:24.250 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:24.250 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:24.797 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:24.797 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:24.978 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:24.978 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:24.994 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:24.995 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:24.995 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 29 -lt 100 ']' 2024-09-13T18:47:24.995 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 29 + 1 2024-09-13T18:47:25.025 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=30 2024-09-13T18:47:25.025 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:25.047 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:25.047 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:25.049 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:25.050 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:25.050 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:25.547 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:25.547 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:25.760 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:25.760 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:25.770 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:25.770 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:25.770 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 30 -lt 100 ']' 2024-09-13T18:47:25.770 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 30 + 1 2024-09-13T18:47:25.808 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=31 2024-09-13T18:47:25.808 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:25.830 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:25.831 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:25.832 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:25.833 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:25.833 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:26.364 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:26.364 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:26.560 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:26.560 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:26.568 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:26.569 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:26.569 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 31 -lt 100 ']' 2024-09-13T18:47:26.569 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 31 + 1 2024-09-13T18:47:26.600 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=32 2024-09-13T18:47:26.600 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:26.622 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:26.622 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:26.623 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:26.624 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:26.624 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:27.147 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:27.147 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:27.336 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:27.336 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:27.352 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:27.352 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:27.352 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 32 -lt 100 ']' 2024-09-13T18:47:27.353 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 32 + 1 2024-09-13T18:47:27.383 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=33 2024-09-13T18:47:27.383 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:27.413 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:27.413 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:27.415 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:27.415 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:27.415 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:27.922 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:27.922 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:28.086 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:28.086 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:28.101 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:28.101 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:28.101 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 33 -lt 100 ']' 2024-09-13T18:47:28.101 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 33 + 1 2024-09-13T18:47:28.141 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=34 2024-09-13T18:47:28.141 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:28.171 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:28.172 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:28.173 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:28.173 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:28.174 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:28.713 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:28.713 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:28.878 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:28.878 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:28.893 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:28.893 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:28.893 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 34 -lt 100 ']' 2024-09-13T18:47:28.893 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 34 + 1 2024-09-13T18:47:28.924 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=35 2024-09-13T18:47:28.924 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:28.946 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:28.946 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:28.948 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:28.948 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:28.948 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:31.022 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:31.022 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:32.290 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:32.290 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:32.327 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:32.327 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:32.327 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 35 -lt 100 ']' 2024-09-13T18:47:32.327 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 35 + 1 2024-09-13T18:47:32.760 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=36 2024-09-13T18:47:32.760 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:32.825 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:32.825 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:32.827 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:32.827 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:32.827 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:33.821 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:33.825 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:34.729 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:34.730 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:35.017 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:35.018 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:35.050 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:35.051 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:35.051 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 36 -lt 100 ']' 2024-09-13T18:47:35.051 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 36 + 1 2024-09-13T18:47:35.146 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=37 2024-09-13T18:47:35.146 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:35.208 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:35.208 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:35.210 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:35.210 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:35.210 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:35.646 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:35.646 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:35.801 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:35.802 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:35.825 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:35.826 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:35.826 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 37 -lt 100 ']' 2024-09-13T18:47:35.826 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 37 + 1 2024-09-13T18:47:36.007 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=38 2024-09-13T18:47:36.008 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:36.018 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:36.018 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:36.021 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:36.021 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:36.021 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:36.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:36.513 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:36.718 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:36.719 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:36.733 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:36.733 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:36.733 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 38 -lt 100 ']' 2024-09-13T18:47:36.734 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 38 + 1 2024-09-13T18:47:36.765 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=39 2024-09-13T18:47:36.765 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:36.799 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:36.799 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:36.801 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:36.801 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:36.801 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:37.296 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:37.296 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:37.492 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:37.492 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:37.500 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:37.500 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:37.501 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 39 -lt 100 ']' 2024-09-13T18:47:37.501 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 39 + 1 2024-09-13T18:47:37.532 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=40 2024-09-13T18:47:37.532 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:37.553 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:37.554 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:37.556 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:37.556 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:37.556 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:38.045 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:38.046 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:38.202 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:38.202 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:38.217 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:38.217 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:38.217 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 40 -lt 100 ']' 2024-09-13T18:47:38.217 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 40 + 1 2024-09-13T18:47:38.248 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=41 2024-09-13T18:47:38.248 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:38.272 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:38.272 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:38.273 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:38.273 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:38.273 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:38.787 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:38.788 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:38.960 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:38.960 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:38.975 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:38.975 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:38.976 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 41 -lt 100 ']' 2024-09-13T18:47:38.976 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 41 + 1 2024-09-13T18:47:39.007 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=42 2024-09-13T18:47:39.007 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:39.028 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:39.028 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:39.031 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:39.031 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:39.031 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:39.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:39.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:39.658 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:39.659 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:39.667 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:39.667 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:39.667 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 42 -lt 100 ']' 2024-09-13T18:47:39.667 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 42 + 1 2024-09-13T18:47:39.698 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=43 2024-09-13T18:47:39.698 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:39.720 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:39.720 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:39.722 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:39.722 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:39.722 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:40.245 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:40.245 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:40.400 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:40.400 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:40.416 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:40.417 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:40.417 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 43 -lt 100 ']' 2024-09-13T18:47:40.417 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 43 + 1 2024-09-13T18:47:40.448 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=44 2024-09-13T18:47:40.448 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:40.470 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:40.470 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:40.472 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:40.472 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:40.472 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:41.012 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:41.012 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:41.175 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:41.175 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:41.183 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:41.184 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:41.184 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 44 -lt 100 ']' 2024-09-13T18:47:41.184 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 44 + 1 2024-09-13T18:47:41.214 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=45 2024-09-13T18:47:41.214 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:41.236 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:41.237 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:41.239 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:41.239 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:41.239 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:41.728 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:41.729 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:41.901 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:41.901 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:41.916 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:41.916 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:41.917 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 45 -lt 100 ']' 2024-09-13T18:47:41.917 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 45 + 1 2024-09-13T18:47:41.947 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=46 2024-09-13T18:47:41.948 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:41.988 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:41.989 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:41.991 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:41.991 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:41.991 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:42.487 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:42.487 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:42.716 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:42.716 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:42.725 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:42.725 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:42.725 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 46 -lt 100 ']' 2024-09-13T18:47:42.725 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 46 + 1 2024-09-13T18:47:42.756 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=47 2024-09-13T18:47:42.756 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:42.782 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:42.782 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:42.784 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:42.784 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:42.784 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:43.295 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:43.295 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:43.460 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:43.460 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:43.474 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:43.474 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:43.475 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 47 -lt 100 ']' 2024-09-13T18:47:43.475 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 47 + 1 2024-09-13T18:47:43.506 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=48 2024-09-13T18:47:43.506 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:43.528 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:43.529 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:43.530 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:43.531 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:43.531 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:44.045 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:44.045 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:44.218 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:44.218 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:44.233 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:44.233 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:44.233 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 48 -lt 100 ']' 2024-09-13T18:47:44.233 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 48 + 1 2024-09-13T18:47:44.269 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=49 2024-09-13T18:47:44.269 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:44.295 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:44.295 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:44.297 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:44.297 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:44.297 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:44.903 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:44.903 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:45.093 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:45.093 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:45.109 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:45.109 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:45.109 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 49 -lt 100 ']' 2024-09-13T18:47:45.109 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 49 + 1 2024-09-13T18:47:45.155 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=50 2024-09-13T18:47:45.156 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:45.190 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:45.190 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:45.192 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:45.193 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:45.193 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:45.653 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:45.653 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:45.809 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:45.809 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:45.826 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:45.826 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:45.826 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 50 -lt 100 ']' 2024-09-13T18:47:45.826 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 50 + 1 2024-09-13T18:47:45.864 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=51 2024-09-13T18:47:45.864 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:45.887 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:45.887 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:45.888 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:45.889 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:45.889 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:46.386 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:46.387 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:46.616 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:46.616 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:46.624 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:46.624 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:46.624 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 51 -lt 100 ']' 2024-09-13T18:47:46.624 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 51 + 1 2024-09-13T18:47:46.656 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=52 2024-09-13T18:47:46.656 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:46.678 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:46.678 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:46.680 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:46.680 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:46.680 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:47.211 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:47.211 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:47.367 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:47.367 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:47.382 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:47.383 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:47.383 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 52 -lt 100 ']' 2024-09-13T18:47:47.383 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 52 + 1 2024-09-13T18:47:47.414 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=53 2024-09-13T18:47:47.414 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:47.436 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:47.436 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:47.438 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:47.438 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:47.438 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:47.911 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:47.911 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:48.092 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:48.092 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:48.107 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:48.108 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:48.108 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 53 -lt 100 ']' 2024-09-13T18:47:48.108 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 53 + 1 2024-09-13T18:47:48.138 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=54 2024-09-13T18:47:48.139 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:48.169 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:48.169 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:48.171 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:48.171 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:48.171 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:48.686 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:48.686 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:48.881 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:48.882 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:48.891 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:48.891 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:48.891 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 54 -lt 100 ']' 2024-09-13T18:47:48.891 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 54 + 1 2024-09-13T18:47:48.925 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=55 2024-09-13T18:47:48.925 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:48.944 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:48.944 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:48.946 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:48.946 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:48.946 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:49.461 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:49.461 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:49.879 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:49.879 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:50.059 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:50.059 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:50.059 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 55 -lt 100 ']' 2024-09-13T18:47:50.059 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 55 + 1 2024-09-13T18:47:50.130 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=56 2024-09-13T18:47:50.130 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:50.157 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:50.157 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:50.158 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:50.158 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:50.158 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:50.686 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:50.686 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:50.879 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:50.879 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:50.890 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:50.890 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:50.890 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 56 -lt 100 ']' 2024-09-13T18:47:50.890 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 56 + 1 2024-09-13T18:47:50.921 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=57 2024-09-13T18:47:50.922 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:50.944 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:50.944 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:50.946 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:50.946 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:50.946 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:51.452 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:51.453 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:51.640 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:51.640 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:51.648 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:51.648 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:51.649 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 57 -lt 100 ']' 2024-09-13T18:47:51.649 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 57 + 1 2024-09-13T18:47:51.680 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=58 2024-09-13T18:47:51.680 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:51.714 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:51.714 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:51.717 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:52.244 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:52.244 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:52.459 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:52.459 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:52.476 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:52.476 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:52.476 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 58 -lt 100 ']' 2024-09-13T18:47:52.476 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 58 + 1 2024-09-13T18:47:52.505 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=59 2024-09-13T18:47:52.505 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:52.527 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:52.527 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:52.529 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:52.529 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:52.529 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:53.027 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:53.027 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:53.226 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:53.226 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:53.241 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:53.241 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:53.241 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 59 -lt 100 ']' 2024-09-13T18:47:53.241 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 59 + 1 2024-09-13T18:47:53.280 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=60 2024-09-13T18:47:53.280 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:53.302 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:53.302 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:53.304 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:53.304 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:53.304 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:53.794 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:53.794 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:53.956 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:53.957 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:53.965 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:53.965 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:53.965 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 60 -lt 100 ']' 2024-09-13T18:47:53.965 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 60 + 1 2024-09-13T18:47:53.997 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=61 2024-09-13T18:47:53.997 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:54.018 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:54.019 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:54.020 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:54.020 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:54.021 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:54.519 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:54.519 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:54.706 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:54.707 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:54.715 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:54.715 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:54.715 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 61 -lt 100 ']' 2024-09-13T18:47:54.715 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 61 + 1 2024-09-13T18:47:54.746 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=62 2024-09-13T18:47:54.746 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:54.768 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:54.768 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:54.770 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:54.771 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:54.771 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:55.277 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:55.277 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:55.448 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:55.448 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:55.457 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:55.457 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:55.457 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 62 -lt 100 ']' 2024-09-13T18:47:55.457 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 62 + 1 2024-09-13T18:47:55.488 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=63 2024-09-13T18:47:55.488 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:55.510 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:55.510 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:55.512 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:55.512 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:55.513 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:56.027 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:56.027 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:56.199 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:56.200 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:56.215 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:56.215 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:56.215 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 63 -lt 100 ']' 2024-09-13T18:47:56.215 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 63 + 1 2024-09-13T18:47:56.246 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=64 2024-09-13T18:47:56.246 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:56.268 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:56.268 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:56.270 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:56.270 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:56.271 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:56.793 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:56.794 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:56.997 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:56.997 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:57.006 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:57.006 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:57.006 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 64 -lt 100 ']' 2024-09-13T18:47:57.006 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 64 + 1 2024-09-13T18:47:57.037 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=65 2024-09-13T18:47:57.037 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:57.060 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:57.060 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:57.061 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:57.062 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:57.062 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:57.577 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:57.578 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:57.766 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:57.766 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:57.782 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:57.782 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:57.782 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 65 -lt 100 ']' 2024-09-13T18:47:57.782 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 65 + 1 2024-09-13T18:47:57.854 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=66 2024-09-13T18:47:57.855 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:57.885 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:57.885 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:57.888 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:57.888 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:57.888 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:58.377 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:58.377 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:58.533 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:58.533 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:58.547 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:58.548 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:58.548 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 66 -lt 100 ']' 2024-09-13T18:47:58.548 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 66 + 1 2024-09-13T18:47:58.587 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=67 2024-09-13T18:47:58.588 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:58.614 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:58.614 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:58.615 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:58.615 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:58.616 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:59.126 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:59.127 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:59.297 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:47:59.297 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:47:59.306 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:59.307 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:47:59.307 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 67 -lt 100 ']' 2024-09-13T18:47:59.307 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 67 + 1 2024-09-13T18:47:59.337 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=68 2024-09-13T18:47:59.337 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:47:59.360 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:59.360 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:47:59.364 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:47:59.365 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:47:59.365 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:47:59.860 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:47:59.860 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:00.081 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:00.081 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:00.097 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:00.097 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:00.098 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 68 -lt 100 ']' 2024-09-13T18:48:00.098 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 68 + 1 2024-09-13T18:48:00.129 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=69 2024-09-13T18:48:00.129 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:00.151 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:00.151 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:00.153 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:00.153 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:00.153 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:00.743 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:00.743 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:00.915 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:00.916 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:00.931 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:00.931 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:00.931 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 69 -lt 100 ']' 2024-09-13T18:48:00.931 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 69 + 1 2024-09-13T18:48:00.962 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=70 2024-09-13T18:48:00.962 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:00.985 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:00.985 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:00.987 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:00.987 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:00.988 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:01.493 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:01.493 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:01.656 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:01.656 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:01.664 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:01.664 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:01.664 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 70 -lt 100 ']' 2024-09-13T18:48:01.664 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 70 + 1 2024-09-13T18:48:01.695 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=71 2024-09-13T18:48:01.696 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:01.718 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:01.718 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:01.720 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:01.720 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:01.720 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:02.260 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:02.260 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:02.439 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:02.439 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:02.447 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:02.448 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:02.448 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 71 -lt 100 ']' 2024-09-13T18:48:02.448 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 71 + 1 2024-09-13T18:48:02.479 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=72 2024-09-13T18:48:02.479 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:02.521 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:02.521 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:02.523 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:02.523 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:02.523 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:03.026 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:03.026 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:03.189 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:03.189 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:03.197 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:03.197 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:03.197 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 72 -lt 100 ']' 2024-09-13T18:48:03.197 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 72 + 1 2024-09-13T18:48:03.245 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=73 2024-09-13T18:48:03.245 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:03.267 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:03.268 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:03.269 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:03.270 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:03.270 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:03.851 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:03.851 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:04.055 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:04.055 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:04.097 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:04.098 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:04.098 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 73 -lt 100 ']' 2024-09-13T18:48:04.098 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 73 + 1 2024-09-13T18:48:04.128 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=74 2024-09-13T18:48:04.129 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:04.151 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:04.151 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:04.152 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:04.153 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:04.153 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:04.701 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:04.701 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:04.890 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:04.890 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:04.905 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:04.905 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:04.905 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 74 -lt 100 ']' 2024-09-13T18:48:04.906 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 74 + 1 2024-09-13T18:48:04.937 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=75 2024-09-13T18:48:04.937 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:04.959 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:04.959 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:04.960 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:04.961 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:04.961 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:05.442 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:05.442 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:05.607 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:05.607 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:05.622 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:05.622 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:05.622 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 75 -lt 100 ']' 2024-09-13T18:48:05.622 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 75 + 1 2024-09-13T18:48:05.653 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=76 2024-09-13T18:48:05.653 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:05.676 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:05.676 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:05.677 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:05.677 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:05.678 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:05.992 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:05.995 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:06.351 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:06.351 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:06.554 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:06.554 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:06.569 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:06.569 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:06.569 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 76 -lt 100 ']' 2024-09-13T18:48:06.569 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 76 + 1 2024-09-13T18:48:06.645 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=77 2024-09-13T18:48:06.645 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:06.656 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:06.656 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:06.658 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:06.658 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:06.659 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:07.334 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:07.334 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:07.496 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:07.497 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:07.515 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:07.515 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:07.515 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 77 -lt 100 ']' 2024-09-13T18:48:07.515 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 77 + 1 2024-09-13T18:48:07.603 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=78 2024-09-13T18:48:07.603 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:07.615 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:07.615 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:07.617 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:07.617 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:07.617 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:08.101 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:08.101 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:08.321 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:08.321 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:08.330 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:08.330 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:08.331 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 78 -lt 100 ']' 2024-09-13T18:48:08.331 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 78 + 1 2024-09-13T18:48:08.361 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=79 2024-09-13T18:48:08.361 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:08.387 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:08.387 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:08.389 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:08.389 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:08.390 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:08.892 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:08.892 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:09.056 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:09.057 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:09.082 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:09.082 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:09.082 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 79 -lt 100 ']' 2024-09-13T18:48:09.083 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 79 + 1 2024-09-13T18:48:09.144 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=80 2024-09-13T18:48:09.145 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:09.166 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:09.167 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:09.169 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:09.169 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:09.169 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:09.692 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:09.692 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:09.938 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:09.938 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:09.970 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:09.970 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:09.970 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 80 -lt 100 ']' 2024-09-13T18:48:09.970 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 80 + 1 2024-09-13T18:48:10.011 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=81 2024-09-13T18:48:10.011 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:10.037 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:10.037 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:10.039 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:10.039 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:10.039 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:10.650 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:10.650 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:10.821 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:10.821 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:10.830 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:10.830 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:10.830 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 81 -lt 100 ']' 2024-09-13T18:48:10.830 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 81 + 1 2024-09-13T18:48:10.861 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=82 2024-09-13T18:48:10.861 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:10.883 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:10.883 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:10.885 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:10.885 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:10.885 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:11.367 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:11.367 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:11.554 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:11.554 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:11.563 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:11.563 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:11.563 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 82 -lt 100 ']' 2024-09-13T18:48:11.563 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 82 + 1 2024-09-13T18:48:11.602 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=83 2024-09-13T18:48:11.603 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:11.625 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:11.625 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:11.627 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:11.627 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:11.627 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:12.133 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:12.133 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:12.314 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:12.314 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:12.329 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:12.329 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:12.329 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 83 -lt 100 ']' 2024-09-13T18:48:12.329 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 83 + 1 2024-09-13T18:48:12.361 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=84 2024-09-13T18:48:12.361 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:12.383 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:12.383 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:12.385 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:12.385 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:12.385 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:12.925 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:12.925 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:13.106 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:13.106 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:13.121 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:13.121 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:13.121 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 84 -lt 100 ']' 2024-09-13T18:48:13.121 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 84 + 1 2024-09-13T18:48:13.152 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=85 2024-09-13T18:48:13.152 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:13.174 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:13.175 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:13.176 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:13.177 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:13.177 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:13.666 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:13.666 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:13.847 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:13.848 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:13.862 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:13.863 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:13.863 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 85 -lt 100 ']' 2024-09-13T18:48:13.863 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 85 + 1 2024-09-13T18:48:13.894 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=86 2024-09-13T18:48:13.894 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:13.924 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:13.925 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:13.926 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:13.927 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:13.927 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:14.433 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:14.433 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:14.637 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:14.637 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:14.646 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:14.646 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:14.646 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 86 -lt 100 ']' 2024-09-13T18:48:14.646 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 86 + 1 2024-09-13T18:48:14.677 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=87 2024-09-13T18:48:14.677 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:14.749 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:14.749 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:14.751 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:14.751 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:14.751 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:15.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:15.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:15.414 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:15.414 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:15.429 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:15.429 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:15.429 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 87 -lt 100 ']' 2024-09-13T18:48:15.429 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 87 + 1 2024-09-13T18:48:15.460 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=88 2024-09-13T18:48:15.461 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:15.482 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:15.483 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:15.484 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:15.485 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:15.485 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:16.024 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:16.025 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:16.189 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:16.189 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:16.204 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:16.204 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:16.204 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 88 -lt 100 ']' 2024-09-13T18:48:16.204 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 88 + 1 2024-09-13T18:48:16.235 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=89 2024-09-13T18:48:16.235 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:16.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:16.258 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:16.259 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:16.260 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:16.260 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:16.816 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:16.817 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:16.980 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:16.981 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:16.995 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:16.996 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:16.996 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 89 -lt 100 ']' 2024-09-13T18:48:16.996 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 89 + 1 2024-09-13T18:48:17.027 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=90 2024-09-13T18:48:17.027 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:17.049 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:17.049 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:17.051 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:17.051 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:17.051 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:17.574 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:17.574 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:17.755 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:17.755 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:17.770 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:17.770 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:17.771 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 90 -lt 100 ']' 2024-09-13T18:48:17.771 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 90 + 1 2024-09-13T18:48:17.802 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=91 2024-09-13T18:48:17.802 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:17.836 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:17.836 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:17.838 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:17.838 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:17.838 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:18.324 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:18.324 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:18.501 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:18.501 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:18.512 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:18.512 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:18.512 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 91 -lt 100 ']' 2024-09-13T18:48:18.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 91 + 1 2024-09-13T18:48:18.543 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=92 2024-09-13T18:48:18.543 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:18.566 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:18.566 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:18.568 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:18.568 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:18.568 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:19.074 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:19.074 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:19.263 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:19.263 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:19.279 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:19.279 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:19.279 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 92 -lt 100 ']' 2024-09-13T18:48:19.279 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 92 + 1 2024-09-13T18:48:19.318 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=93 2024-09-13T18:48:19.318 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:19.341 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:19.341 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:19.343 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:19.343 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:19.343 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:19.841 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:19.841 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:20.031 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:20.031 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:20.046 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:20.046 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:20.047 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 93 -lt 100 ']' 2024-09-13T18:48:20.047 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 93 + 1 2024-09-13T18:48:20.085 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=94 2024-09-13T18:48:20.085 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:20.107 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:20.107 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:20.109 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:20.109 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:20.109 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:20.624 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:20.624 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:20.937 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:20.937 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:20.998 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:20.998 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:20.998 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 94 -lt 100 ']' 2024-09-13T18:48:20.998 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 94 + 1 2024-09-13T18:48:21.258 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=95 2024-09-13T18:48:21.258 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:21.299 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:21.299 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:21.301 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:21.301 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:21.301 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:21.832 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:21.832 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:21.988 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:21.988 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:22.003 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:22.003 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:22.004 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 95 -lt 100 ']' 2024-09-13T18:48:22.004 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 95 + 1 2024-09-13T18:48:22.035 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=96 2024-09-13T18:48:22.035 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:22.056 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:22.057 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:22.059 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:22.060 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:22.060 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:22.573 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:22.574 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:22.778 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:22.778 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:22.786 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:22.786 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:22.786 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 96 -lt 100 ']' 2024-09-13T18:48:22.786 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 96 + 1 2024-09-13T18:48:22.818 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=97 2024-09-13T18:48:22.818 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:22.843 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:22.844 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:22.845 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:22.846 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:22.846 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:23.323 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:23.324 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:23.500 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:23.500 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:23.511 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:23.511 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:23.512 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 97 -lt 100 ']' 2024-09-13T18:48:23.512 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 97 + 1 2024-09-13T18:48:23.543 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=98 2024-09-13T18:48:23.543 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:23.565 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:23.565 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:23.567 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:23.567 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:23.567 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:24.090 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:24.090 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:24.300 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:24.300 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:24.311 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:24.311 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:24.311 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 98 -lt 100 ']' 2024-09-13T18:48:24.311 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 98 + 1 2024-09-13T18:48:24.343 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=99 2024-09-13T18:48:24.343 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:24.365 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:24.365 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:24.367 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:24.368 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:24.368 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:24.890 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:24.890 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:25.075 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:25.075 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:25.087 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:25.087 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:25.087 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 99 -lt 100 ']' 2024-09-13T18:48:25.087 INFO:tasks.workunit.client.0.smithi029.stderr:++ expr 99 + 1 2024-09-13T18:48:25.117 INFO:tasks.workunit.client.0.smithi029.stderr:+ c=100 2024-09-13T18:48:25.118 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:25.140 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:25.140 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:25.142 INFO:tasks.workunit.client.0.smithi029.stderr:+ c1=2 2024-09-13T18:48:25.142 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 3 2024-09-13T18:48:25.142 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-13T18:48:25.648 INFO:tasks.workunit.client.0.smithi029.stderr:++ getfacl d1 2024-09-13T18:48:25.648 INFO:tasks.workunit.client.0.smithi029.stderr:++ grep -c nobody:rw 2024-09-13T18:48:25.853 INFO:tasks.workunit.client.0.smithi029.stderr:+ c2=2 2024-09-13T18:48:25.853 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:25.861 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:25.861 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 2 -ne 2 ']' 2024-09-13T18:48:25.861 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' 100 -lt 100 ']' 2024-09-13T18:48:25.870 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir d1 2024-09-13T18:48:25.889 INFO:tasks.workunit.client.0.smithi029.stderr:+ setfattr -n system.posix_acl_access -v 0x02000000 d1 2024-09-13T18:48:25.903 INFO:tasks.workunit.client.0.smithi029.stderr:+ setfattr -n system.posix_acl_default -v 0x02000000 . 2024-09-13T18:48:25.905 INFO:tasks.workunit.client.0.smithi029.stderr:+ expect_failure getfattr -n system.posix_acl_access d1 2024-09-13T18:48:25.905 INFO:tasks.workunit.client.0.smithi029.stderr:+ getfattr -n system.posix_acl_access d1 2024-09-13T18:48:25.907 INFO:tasks.workunit.client.0.smithi029.stderr:d1: system.posix_acl_access: No such attribute 2024-09-13T18:48:25.907 INFO:tasks.workunit.client.0.smithi029.stderr:+ return 0 2024-09-13T18:48:25.907 INFO:tasks.workunit.client.0.smithi029.stderr:+ expect_failure getfattr -n system.posix_acl_default . 2024-09-13T18:48:25.907 INFO:tasks.workunit.client.0.smithi029.stderr:+ getfattr -n system.posix_acl_default . 2024-09-13T18:48:25.908 INFO:tasks.workunit.client.0.smithi029.stderr:.: system.posix_acl_default: No such attribute 2024-09-13T18:48:25.908 INFO:tasks.workunit.client.0.smithi029.stderr:+ return 0 2024-09-13T18:48:25.908 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir d1 2024-09-13T18:48:25.927 INFO:tasks.workunit.client.0.smithi029.stderr:+ cd .. 2024-09-13T18:48:25.928 INFO:tasks.workunit.client.0.smithi029.stderr:+ rmdir testdir 2024-09-13T18:48:25.935 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo OK 2024-09-13T18:48:25.936 INFO:tasks.workunit.client.0.smithi029.stdout:OK 2024-09-13T18:48:25.937 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:48:25.937 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T18:48:26.549 INFO:tasks.workunit:Stopping ['fs/misc/acl.sh'] on client.0... 2024-09-13T18:48:26.550 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T18:48:27.351 DEBUG:teuthology.parallel:result is None 2024-09-13T18:48:27.351 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:48:27.444 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T18:48:37.573 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:37.576 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:07.713 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:07.717 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:28.704 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 91% (11623/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T18:49:29.696 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:49:29.696 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:49:29.696 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:49:29.696 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:49:29.696 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:49:29.696 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:49:29.697 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:49:29.697 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:49:29.697 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:49:29.697 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-09-13T18:49:29.697 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:49:29.697 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-09-13T18:49:29.697 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:49:29.697 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-09-13T18:49:29.697 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:49:29.697 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:49:29.697 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:49:29.697 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:49:29.703 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T18:49:29.918 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:49:29.921 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:49:29.921 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:49:31.219 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:49:31.329 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:49:31.373 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:49:31.374 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:49:31.375 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:49:31.416 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:49:31.431 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:49:31.431 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T18:49:31.458 INFO:tasks.workunit:Running workunits matching fs/misc/chmod.sh on client.0... 2024-09-13T18:49:31.459 INFO:tasks.workunit:Running workunit fs/misc/chmod.sh... 2024-09-13T18:49:31.460 DEBUG:teuthology.orchestra.run.smithi029:workunit test fs/misc/chmod.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh 2024-09-13T18:49:31.566 INFO:tasks.workunit.client.0.smithi029.stderr:+ set -e 2024-09-13T18:49:31.566 INFO:tasks.workunit.client.0.smithi029.stderr:+ file=test_chmod.47075 2024-09-13T18:49:31.566 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo foo 2024-09-13T18:49:31.602 INFO:tasks.workunit.client.0.smithi029.stderr:+ test 0 '!=' 0 2024-09-13T18:49:31.603 INFO:tasks.workunit.client.0.smithi029.stderr:+ chmod 400 test_chmod.47075 2024-09-13T18:49:31.610 INFO:tasks.workunit.client.0.smithi029.stderr:+ test 0 '!=' 0 2024-09-13T18:49:31.610 INFO:tasks.workunit.client.0.smithi029.stderr:+ check_perms test_chmod.47075 -r-------- 2024-09-13T18:49:31.611 INFO:tasks.workunit.client.0.smithi029.stderr:+ file=test_chmod.47075 2024-09-13T18:49:31.611 INFO:tasks.workunit.client.0.smithi029.stderr:++ ls -la test_chmod.47075 2024-09-13T18:49:31.619 INFO:tasks.workunit.client.0.smithi029.stderr:+ r='-r--------. 1 ubuntu ubuntu 4 Sep 13 18:49 test_chmod.47075' 2024-09-13T18:49:31.619 INFO:tasks.workunit.client.0.smithi029.stderr:+ test 0 '!=' 0 2024-09-13T18:49:31.619 INFO:tasks.workunit.client.0.smithi029.stderr:+ perms=-r-------- 2024-09-13T18:49:31.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Sep 13 18:49 test_chmod.47075 2024-09-13T18:49:31.619 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-09-13T18:49:31.672 INFO:tasks.workunit.client.0.smithi029.stderr:+ test -r-------- '!=' -r--------. 2024-09-13T18:49:31.673 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Sep 13 18:49 test_chmod.47075 2024-09-13T18:49:31.673 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-09-13T18:49:31.675 INFO:tasks.workunit.client.0.smithi029.stderr:+ test -r--------. '!=' -r--------. 2024-09-13T18:49:31.675 INFO:tasks.workunit.client.0.smithi029.stderr:+ set +e 2024-09-13T18:49:31.675 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo bar 2024-09-13T18:49:31.675 INFO:tasks.workunit.client.0.smithi029.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh: line 40: test_chmod.47075: Permission denied 2024-09-13T18:49:31.675 INFO:tasks.workunit.client.0.smithi029.stderr:+ test 1 = 0 2024-09-13T18:49:31.676 INFO:tasks.workunit.client.0.smithi029.stderr:+ set -e 2024-09-13T18:49:31.676 INFO:tasks.workunit.client.0.smithi029.stderr:+ chmod 600 test_chmod.47075 2024-09-13T18:49:31.676 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo bar 2024-09-13T18:49:31.677 INFO:tasks.workunit.client.0.smithi029.stderr:+ test 0 '!=' 0 2024-09-13T18:49:31.677 INFO:tasks.workunit.client.0.smithi029.stderr:+ check_perms test_chmod.47075 -rw------- 2024-09-13T18:49:31.677 INFO:tasks.workunit.client.0.smithi029.stderr:+ file=test_chmod.47075 2024-09-13T18:49:31.677 INFO:tasks.workunit.client.0.smithi029.stderr:++ ls -la test_chmod.47075 2024-09-13T18:49:31.679 INFO:tasks.workunit.client.0.smithi029.stderr:+ r='-rw-------. 1 ubuntu ubuntu 8 Sep 13 18:49 test_chmod.47075' 2024-09-13T18:49:31.679 INFO:tasks.workunit.client.0.smithi029.stderr:+ test 0 '!=' 0 2024-09-13T18:49:31.679 INFO:tasks.workunit.client.0.smithi029.stderr:+ perms=-rw------- 2024-09-13T18:49:31.680 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Sep 13 18:49 test_chmod.47075 2024-09-13T18:49:31.680 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-09-13T18:49:31.681 INFO:tasks.workunit.client.0.smithi029.stderr:+ test -rw------- '!=' -rw-------. 2024-09-13T18:49:31.682 INFO:tasks.workunit.client.0.smithi029.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Sep 13 18:49 test_chmod.47075 2024-09-13T18:49:31.682 INFO:tasks.workunit.client.0.smithi029.stderr:++ awk '{print $1}' 2024-09-13T18:49:31.684 INFO:tasks.workunit.client.0.smithi029.stderr:+ test -rw-------. '!=' -rw-------. 2024-09-13T18:49:31.684 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo foo 2024-09-13T18:49:31.685 INFO:tasks.workunit.client.0.smithi029.stderr:+ test 0 '!=' 0 2024-09-13T18:49:31.685 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:49:31.685 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T18:49:31.723 INFO:tasks.workunit:Stopping ['fs/misc/chmod.sh'] on client.0... 2024-09-13T18:49:31.724 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T18:49:32.032 DEBUG:teuthology.parallel:result is None 2024-09-13T18:49:32.033 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:49:32.050 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T18:49:37.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:37.785 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:50:07.845 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:50:07.849 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:50:33.067 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 90% (11502/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T18:50:33.586 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:50:33.586 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:50:33.587 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:50:33.588 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-13T18:50:33.588 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:50:33.593 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T18:50:33.609 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:50:33.612 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:50:33.612 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:50:33.662 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:50:33.714 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:50:33.754 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:50:33.756 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:50:33.756 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:50:33.795 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:50:33.799 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:50:33.799 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T18:50:33.855 INFO:tasks.workunit:Running workunits matching fs/misc/dac_override.sh on client.0... 2024-09-13T18:50:33.856 INFO:tasks.workunit:Running workunit fs/misc/dac_override.sh... 2024-09-13T18:50:33.857 DEBUG:teuthology.orchestra.run.smithi029:workunit test fs/misc/dac_override.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dac_override.sh 2024-09-13T18:50:33.920 INFO:tasks.workunit.client.0.smithi029.stderr:+ set -e 2024-09-13T18:50:33.920 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir -p testdir 2024-09-13T18:50:33.922 INFO:tasks.workunit.client.0.smithi029.stderr:+ file=test_chmod.47323 2024-09-13T18:50:33.922 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo foo 2024-09-13T18:50:33.924 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo chmod 600 testdir 2024-09-13T18:50:33.940 INFO:tasks.workunit.client.0.smithi029.stderr:+ expect_failure cat testdir/test_chmod.47323 2024-09-13T18:50:33.941 INFO:tasks.workunit.client.0.smithi029.stderr:+ cat testdir/test_chmod.47323 2024-09-13T18:50:33.942 INFO:tasks.workunit.client.0.smithi029.stderr:cat: testdir/test_chmod.47323: Permission denied 2024-09-13T18:50:33.942 INFO:tasks.workunit.client.0.smithi029.stderr:+ return 0 2024-09-13T18:50:33.942 INFO:tasks.workunit.client.0.smithi029.stderr:+ sudo cat testdir/test_chmod.47323 2024-09-13T18:50:33.952 INFO:tasks.workunit.client.0.smithi029.stdout:foo 2024-09-13T18:50:33.954 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:50:33.954 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T18:50:34.039 INFO:tasks.workunit:Stopping ['fs/misc/dac_override.sh'] on client.0... 2024-09-13T18:50:34.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T18:50:34.309 DEBUG:teuthology.parallel:result is None 2024-09-13T18:50:34.309 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:50:34.343 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:50:34.344 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T18:50:34.356 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T18:50:34.356 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:50:34.356 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:50:34.400 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:50:34.400 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:50:34.457 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:50:34.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.946+0000 7f3dc215e640 1 Processor -- start 2024-09-13T18:50:34.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.946+0000 7f3dc215e640 1 -- start start 2024-09-13T18:50:34.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.947+0000 7f3dc215e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3dbc0b04a0 0x7f3dbc145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:34.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.947+0000 7f3dc215e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dbc06f230 con 0x7f3dbc146130 2024-09-13T18:50:34.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.947+0000 7f3dc215e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dbc0b23a0 con 0x7f3dbc0b1fc0 2024-09-13T18:50:34.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.947+0000 7f3dc215e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dbc0b08d0 con 0x7f3dbc0b04a0 2024-09-13T18:50:34.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.947+0000 7f3dbaffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3dbc0b04a0 0x7f3dbc145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:34.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.947+0000 7f3dbbfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3dbc146130 0x7f3dbc14cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41006/0 (socket says 172.21.15.29:41006) 2024-09-13T18:50:34.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.947+0000 7f3dbbfff640 1 -- 172.21.15.29:0/3396063323 learned_addr learned my addr 172.21.15.29:0/3396063323 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:34.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.948+0000 7f3dbaffd640 1 -- 172.21.15.29:0/3396063323 >> v1:172.21.15.96:6789/0 conn(0x7f3dbc0b1fc0 legacy=0x7f3dbc13c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:34.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.948+0000 7f3dbaffd640 1 -- 172.21.15.29:0/3396063323 >> v1:172.21.15.29:6789/0 conn(0x7f3dbc146130 legacy=0x7f3dbc14cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:34.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.948+0000 7f3dba7fc640 1 -- 172.21.15.29:0/3396063323 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870132072 0 0) 0x7f3dbc06f230 con 0x7f3dbc146130 2024-09-13T18:50:34.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.948+0000 7f3dbaffd640 1 -- 172.21.15.29:0/3396063323 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc0b0d70 con 0x7f3dbc0b04a0 2024-09-13T18:50:34.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.948+0000 7f3dbaffd640 1 --2- 172.21.15.29:0/3396063323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dbc0b04a0 0x7f3dbc145bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3db00097a0 tx=0x7f3db002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a6401e60e097b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:34.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.948+0000 7f3dba7fc640 1 -- 172.21.15.29:0/3396063323 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0032440 con 0x7f3dbc0b04a0 2024-09-13T18:50:34.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.949+0000 7f3dba7fc640 1 -- 172.21.15.29:0/3396063323 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db00325a0 con 0x7f3dbc0b04a0 2024-09-13T18:50:34.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.949+0000 7f3dba7fc640 1 -- 172.21.15.29:0/3396063323 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0032930 con 0x7f3dbc0b04a0 2024-09-13T18:50:34.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.949+0000 7f3dc215e640 1 -- 172.21.15.29:0/3396063323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dbc0b04a0 msgr2=0x7f3dbc145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:34.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.949+0000 7f3dc215e640 1 --2- 172.21.15.29:0/3396063323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dbc0b04a0 0x7f3dbc145bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3db00097a0 tx=0x7f3db002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:50:34.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.949+0000 7f3dc215e640 1 -- 172.21.15.29:0/3396063323 shutdown_connections 2024-09-13T18:50:34.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.949+0000 7f3dc215e640 1 --2- 172.21.15.29:0/3396063323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dbc0b04a0 0x7f3dbc145bf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:34.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.949+0000 7f3dc215e640 1 -- 172.21.15.29:0/3396063323 >> 172.21.15.29:0/3396063323 conn(0x7f3dbc06a890 msgr2=0x7f3dbc0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:34.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.949+0000 7f3dc215e640 1 -- 172.21.15.29:0/3396063323 shutdown_connections 2024-09-13T18:50:34.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.949+0000 7f3dc215e640 1 -- 172.21.15.29:0/3396063323 wait complete. 2024-09-13T18:50:34.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.965+0000 7f3dc215e640 1 Processor -- start 2024-09-13T18:50:34.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.965+0000 7f3dc215e640 1 -- start start 2024-09-13T18:50:34.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.966+0000 7f3dc215e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dbc0b04a0 0x7f3dbc13ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:34.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.966+0000 7f3dc215e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dbc0b1fc0 0x7f3dbc1d93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:34.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.966+0000 7f3dc215e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3dbc146130 0x7f3dbc1d9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:34.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.966+0000 7f3dc215e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc0aabc0 con 0x7f3dbc0b1fc0 2024-09-13T18:50:34.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.966+0000 7f3dc215e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc1d8cb0 con 0x7f3dbc0b04a0 2024-09-13T18:50:34.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.966+0000 7f3dc215e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc0aa230 con 0x7f3dbc146130 2024-09-13T18:50:34.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.966+0000 7f3dbaffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dbc0b1fc0 0x7f3dbc1d93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:34.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.966+0000 7f3dbaffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dbc0b1fc0 0x7f3dbc1d93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55696/0 (socket says 172.21.15.29:55696) 2024-09-13T18:50:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.966+0000 7f3dbaffd640 1 -- 172.21.15.29:0/2749777749 learned_addr learned my addr 172.21.15.29:0/2749777749 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.966+0000 7f3dbbfff640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3dbc146130 0x7f3dbc1d9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.966+0000 7f3dbb7fe640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dbc0b04a0 0x7f3dbc13ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.967+0000 7f3dbaffd640 1 -- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3dbc146130 msgr2=0x7f3dbc1d9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.967+0000 7f3dbaffd640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3dbc146130 0x7f3dbc1d9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.967+0000 7f3dbaffd640 1 -- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dbc0b04a0 msgr2=0x7f3dbc13ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.967+0000 7f3dbaffd640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dbc0b04a0 0x7f3dbc13ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.967+0000 7f3dbaffd640 1 -- 172.21.15.29:0/2749777749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db0009400 con 0x7f3dbc0b1fc0 2024-09-13T18:50:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.967+0000 7f3dbb7fe640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dbc0b04a0 0x7f3dbc13ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.967+0000 7f3dbaffd640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dbc0b1fc0 0x7f3dbc1d93c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3db00097a0 tx=0x7f3db00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.967+0000 7f3da3fff640 1 -- 172.21.15.29:0/2749777749 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0030b80 con 0x7f3dbc0b1fc0 2024-09-13T18:50:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.967+0000 7f3da3fff640 1 -- 172.21.15.29:0/2749777749 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db0030ce0 con 0x7f3dbc0b1fc0 2024-09-13T18:50:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.967+0000 7f3da3fff640 1 -- 172.21.15.29:0/2749777749 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db003b640 con 0x7f3dbc0b1fc0 2024-09-13T18:50:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.967+0000 7f3dc215e640 1 -- 172.21.15.29:0/2749777749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc0aa510 con 0x7f3dbc0b1fc0 2024-09-13T18:50:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.967+0000 7f3dc215e640 1 -- 172.21.15.29:0/2749777749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dbc13f8f0 con 0x7f3dbc0b1fc0 2024-09-13T18:50:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.969+0000 7f3da3fff640 1 -- 172.21.15.29:0/2749777749 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3db0039040 con 0x7f3dbc0b1fc0 2024-09-13T18:50:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.969+0000 7f3da3fff640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f3da806ac00 0x7f3da806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.969+0000 7f3da3fff640 1 -- 172.21.15.29:0/2749777749 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3db00a9f80 con 0x7f3dbc0b1fc0 2024-09-13T18:50:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.969+0000 7f3dc215e640 1 -- 172.21.15.29:0/2749777749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dbc1d90e0 con 0x7f3dbc0b1fc0 2024-09-13T18:50:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.969+0000 7f3dbb7fe640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f3da806ac00 0x7f3da806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.970+0000 7f3dbb7fe640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f3da806ac00 0x7f3da806d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3dac003eb0 tx=0x7f3dac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:34.974+0000 7f3da3fff640 1 -- 172.21.15.29:0/2749777749 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3dbc1d90e0 con 0x7f3dbc0b1fc0 2024-09-13T18:50:35.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.147+0000 7f3dc215e640 1 -- 172.21.15.29:0/2749777749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dbc1d90e0 con 0x7f3dbc0b1fc0 2024-09-13T18:50:35.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.148+0000 7f3da3fff640 1 -- 172.21.15.29:0/2749777749 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18627 (secure 0 0 0) 0x7f3dbc1d90e0 con 0x7f3dbc0b1fc0 2024-09-13T18:50:35.151 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:50:35.151 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:46:11.136377+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.f","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:50:35.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.150+0000 7f3dc215e640 1 -- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f3da806ac00 msgr2=0x7f3da806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.150+0000 7f3dc215e640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f3da806ac00 0x7f3da806d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3dac003eb0 tx=0x7f3dac009040 comp rx=0 tx=0).stop 2024-09-13T18:50:35.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.150+0000 7f3dc215e640 1 -- 172.21.15.29:0/2749777749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dbc0b1fc0 msgr2=0x7f3dbc1d93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.150+0000 7f3dc215e640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dbc0b1fc0 0x7f3dbc1d93c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3db00097a0 tx=0x7f3db00046c0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.150+0000 7f3dc215e640 1 -- 172.21.15.29:0/2749777749 shutdown_connections 2024-09-13T18:50:35.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.150+0000 7f3dc215e640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f3da806ac00 0x7f3da806d0c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.150+0000 7f3dc215e640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3dbc146130 0x7f3dbc1d9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.150+0000 7f3dc215e640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dbc0b1fc0 0x7f3dbc1d93c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.150+0000 7f3dc215e640 1 --2- 172.21.15.29:0/2749777749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dbc0b04a0 0x7f3dbc13ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.150+0000 7f3dc215e640 1 -- 172.21.15.29:0/2749777749 >> 172.21.15.29:0/2749777749 conn(0x7f3dbc06a890 msgr2=0x7f3dbc070580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.150+0000 7f3dc215e640 1 -- 172.21.15.29:0/2749777749 shutdown_connections 2024-09-13T18:50:35.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.150+0000 7f3dc215e640 1 -- 172.21.15.29:0/2749777749 wait complete. 2024-09-13T18:50:35.184 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:45:17.630827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:45:20.113248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:20.978194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:24.059966+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:50:35.185 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:50:35.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.286+0000 7f9a7126b640 1 Processor -- start 2024-09-13T18:50:35.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.286+0000 7f9a7126b640 1 -- start start 2024-09-13T18:50:35.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a7126b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9a6c0b44b0 0x7f9a6c1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a7126b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9a6c0b5f50 0x7f9a6c13f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a7126b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9a6c0b3320 0x7f9a6c13fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a7126b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6c0b5580 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a7126b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6c0b3880 con 0x7f9a6c0b3320 2024-09-13T18:50:35.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a7126b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0b4890 con 0x7f9a6c0b44b0 2024-09-13T18:50:35.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a6a7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9a6c0b5f50 0x7f9a6c13f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a6a7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9a6c0b5f50 0x7f9a6c13f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55702/0 (socket says 172.21.15.29:55702) 2024-09-13T18:50:35.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a6a7fc640 1 -- 172.21.15.29:0/1992202045 learned_addr learned my addr 172.21.15.29:0/1992202045 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:35.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a6affd640 1 --2- 172.21.15.29:0/1992202045 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9a6c0b44b0 0x7f9a6c1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a6b7fe640 1 --2- 172.21.15.29:0/1992202045 >> v2:172.21.15.96:3300/0 conn(0x7f9a6c0b3320 0x7f9a6c13fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a6a7fc640 1 -- 172.21.15.29:0/1992202045 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9a6c0b44b0 msgr2=0x7f9a6c1462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:35.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.287+0000 7f9a6a7fc640 1 --2- 172.21.15.29:0/1992202045 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9a6c0b44b0 0x7f9a6c1462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.288+0000 7f9a6a7fc640 1 -- 172.21.15.29:0/1992202045 >> v2:172.21.15.96:3300/0 conn(0x7f9a6c0b3320 msgr2=0x7f9a6c13fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:35.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.288+0000 7f9a6a7fc640 1 --2- 172.21.15.29:0/1992202045 >> v2:172.21.15.96:3300/0 conn(0x7f9a6c0b3320 0x7f9a6c13fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.288+0000 7f9a6a7fc640 1 -- 172.21.15.29:0/1992202045 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0b57f0 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.288+0000 7f9a6a7fc640 1 --2- 172.21.15.29:0/1992202045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a6c0b5f50 0x7f9a6c13f5f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0a7bb0 tx=0x7f9a6002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90b728018ea081f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.288+0000 7f9a69ffb640 1 -- 172.21.15.29:0/1992202045 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60032440 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.288+0000 7f9a69ffb640 1 -- 172.21.15.29:0/1992202045 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a600325a0 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.288+0000 7f9a69ffb640 1 -- 172.21.15.29:0/1992202045 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60032930 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.289+0000 7f9a7126b640 1 -- 172.21.15.29:0/1992202045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a6c0b5f50 msgr2=0x7f9a6c13f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.289+0000 7f9a7126b640 1 --2- 172.21.15.29:0/1992202045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a6c0b5f50 0x7f9a6c13f5f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0a7bb0 tx=0x7f9a6002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.289+0000 7f9a7126b640 1 -- 172.21.15.29:0/1992202045 shutdown_connections 2024-09-13T18:50:35.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.289+0000 7f9a7126b640 1 --2- 172.21.15.29:0/1992202045 >> v2:172.21.15.96:3300/0 conn(0x7f9a6c0b3320 0x7f9a6c13fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.289+0000 7f9a7126b640 1 --2- 172.21.15.29:0/1992202045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a6c0b5f50 0x7f9a6c13f5f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.289+0000 7f9a7126b640 1 --2- 172.21.15.29:0/1992202045 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9a6c0b44b0 0x7f9a6c1462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.289+0000 7f9a7126b640 1 -- 172.21.15.29:0/1992202045 >> 172.21.15.29:0/1992202045 conn(0x7f9a6c0b8050 msgr2=0x7f9a6c0b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.289+0000 7f9a7126b640 1 -- 172.21.15.29:0/1992202045 shutdown_connections 2024-09-13T18:50:35.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.289+0000 7f9a7126b640 1 -- 172.21.15.29:0/1992202045 wait complete. 2024-09-13T18:50:35.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.290+0000 7f9a7126b640 1 Processor -- start 2024-09-13T18:50:35.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.290+0000 7f9a7126b640 1 -- start start 2024-09-13T18:50:35.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a7126b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a6c0b3320 0x7f9a6c13dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a7126b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9a6c0b44b0 0x7f9a6c1ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a7126b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a6c0b5f50 0x7f9a6c1de730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a7126b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c1cd080 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a7126b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c1ced30 con 0x7f9a6c0b3320 2024-09-13T18:50:35.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a7126b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c1cd2d0 con 0x7f9a6c0b44b0 2024-09-13T18:50:35.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a6b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a6c0b5f50 0x7f9a6c1de730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a6b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a6c0b5f50 0x7f9a6c1de730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55714/0 (socket says 172.21.15.29:55714) 2024-09-13T18:50:35.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a6affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a6c0b3320 0x7f9a6c13dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a6b7fe640 1 -- 172.21.15.29:0/1719257866 learned_addr learned my addr 172.21.15.29:0/1719257866 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:35.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a6a7fc640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9a6c0b44b0 0x7f9a6c1ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a6b7fe640 1 -- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9a6c0b44b0 msgr2=0x7f9a6c1ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a6b7fe640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9a6c0b44b0 0x7f9a6c1ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a6b7fe640 1 -- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a6c0b3320 msgr2=0x7f9a6c13dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a6b7fe640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a6c0b3320 0x7f9a6c13dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.291+0000 7f9a6b7fe640 1 -- 172.21.15.29:0/1719257866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a600094d0 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.292+0000 7f9a6b7fe640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a6c0b5f50 0x7f9a6c1de730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400d830 tx=0x7f9a6400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.292+0000 7f9a537fe640 1 -- 172.21.15.29:0/1719257866 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6400b6c0 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.292+0000 7f9a537fe640 1 -- 172.21.15.29:0/1719257866 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6400b840 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.292+0000 7f9a7126b640 1 -- 172.21.15.29:0/1719257866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6c1cd5b0 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.292+0000 7f9a537fe640 1 -- 172.21.15.29:0/1719257866 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6400bbf0 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.292+0000 7f9a7126b640 1 -- 172.21.15.29:0/1719257866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c13e580 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.293+0000 7f9a7126b640 1 -- 172.21.15.29:0/1719257866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6c1cd7f0 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.293+0000 7f9a537fe640 1 -- 172.21.15.29:0/1719257866 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9a6401e460 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.294+0000 7f9a537fe640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9a5806ac30 0x7f9a5806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.294+0000 7f9a537fe640 1 -- 172.21.15.29:0/1719257866 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9a64089c70 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.294+0000 7f9a6affd640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9a5806ac30 0x7f9a5806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.294+0000 7f9a6affd640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9a5806ac30 0x7f9a5806d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c003aa0 tx=0x7f9a5c0098d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.298+0000 7f9a537fe640 1 -- 172.21.15.29:0/1719257866 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9a6c1cd7f0 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.467+0000 7f9a7126b640 1 -- 172.21.15.29:0/1719257866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a6c1cd7f0 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.467+0000 7f9a537fe640 1 -- 172.21.15.29:0/1719257866 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a6c1cd7f0 con 0x7f9a6c0b5f50 2024-09-13T18:50:35.470 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-09-13T18:50:35.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.469+0000 7f9a7126b640 1 -- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9a5806ac30 msgr2=0x7f9a5806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.469+0000 7f9a7126b640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9a5806ac30 0x7f9a5806d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c003aa0 tx=0x7f9a5c0098d0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.469+0000 7f9a7126b640 1 -- 172.21.15.29:0/1719257866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a6c0b5f50 msgr2=0x7f9a6c1de730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.469+0000 7f9a7126b640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a6c0b5f50 0x7f9a6c1de730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400d830 tx=0x7f9a6400dcf0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.469+0000 7f9a7126b640 1 -- 172.21.15.29:0/1719257866 shutdown_connections 2024-09-13T18:50:35.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.469+0000 7f9a7126b640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9a5806ac30 0x7f9a5806d0f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.469+0000 7f9a7126b640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a6c0b5f50 0x7f9a6c1de730 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.469+0000 7f9a7126b640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9a6c0b44b0 0x7f9a6c1ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.469+0000 7f9a7126b640 1 --2- 172.21.15.29:0/1719257866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a6c0b3320 0x7f9a6c13dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.469+0000 7f9a7126b640 1 -- 172.21.15.29:0/1719257866 >> 172.21.15.29:0/1719257866 conn(0x7f9a6c0b8050 msgr2=0x7f9a6c13f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.469+0000 7f9a7126b640 1 -- 172.21.15.29:0/1719257866 shutdown_connections 2024-09-13T18:50:35.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.469+0000 7f9a7126b640 1 -- 172.21.15.29:0/1719257866 wait complete. 2024-09-13T18:50:35.483 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:50:35.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.585+0000 7f67e9ad0640 1 Processor -- start 2024-09-13T18:50:35.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.585+0000 7f67e9ad0640 1 -- start start 2024-09-13T18:50:35.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.586+0000 7f67e9ad0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f67e40b42f0 0x7f67e413f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.586+0000 7f67e9ad0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f67e413fb50 0x7f67e4150300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.586+0000 7f67e9ad0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e40b2af0 con 0x7f67e40bbdb0 2024-09-13T18:50:35.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.586+0000 7f67e9ad0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e40b3540 con 0x7f67e40b42f0 2024-09-13T18:50:35.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.586+0000 7f67e9ad0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e40bc190 con 0x7f67e413fb50 2024-09-13T18:50:35.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.586+0000 7f67dbfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f67e40b42f0 0x7f67e413f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.586+0000 7f67dbfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f67e40b42f0 0x7f67e413f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55730/0 (socket says 172.21.15.29:55730) 2024-09-13T18:50:35.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.586+0000 7f67dbfff640 1 -- 172.21.15.29:0/19811079 learned_addr learned my addr 172.21.15.29:0/19811079 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:35.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.586+0000 7f67e3fff640 1 --2- 172.21.15.29:0/19811079 >> v2:172.21.15.96:3300/0 conn(0x7f67e413fb50 0x7f67e4150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.587+0000 7f67dbfff640 1 -- 172.21.15.29:0/19811079 >> v2:172.21.15.96:3300/0 conn(0x7f67e413fb50 msgr2=0x7f67e4150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:35.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.587+0000 7f67dbfff640 1 --2- 172.21.15.29:0/19811079 >> v2:172.21.15.96:3300/0 conn(0x7f67e413fb50 0x7f67e4150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.587+0000 7f67dbfff640 1 -- 172.21.15.29:0/19811079 >> v1:172.21.15.96:6789/0 conn(0x7f67e40bbdb0 legacy=0x7f67e4148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.587+0000 7f67e2ffd640 1 -- 172.21.15.29:0/19811079 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431827719 0 0) 0x7f67e40b2af0 con 0x7f67e40bbdb0 2024-09-13T18:50:35.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.587+0000 7f67dbfff640 1 -- 172.21.15.29:0/19811079 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e40b2d40 con 0x7f67e40b42f0 2024-09-13T18:50:35.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.587+0000 7f67dbfff640 1 --2- 172.21.15.29:0/19811079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e40b42f0 0x7f67e413f610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f67e40b7620 tx=0x7f67cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78fefa79741bc94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.587+0000 7f67e2ffd640 1 -- 172.21.15.29:0/19811079 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc032440 con 0x7f67e40b42f0 2024-09-13T18:50:35.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.587+0000 7f67e2ffd640 1 -- 172.21.15.29:0/19811079 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc0325a0 con 0x7f67e40b42f0 2024-09-13T18:50:35.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.587+0000 7f67e2ffd640 1 -- 172.21.15.29:0/19811079 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc032930 con 0x7f67e40b42f0 2024-09-13T18:50:35.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.588+0000 7f67e9ad0640 1 -- 172.21.15.29:0/19811079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e40b42f0 msgr2=0x7f67e413f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.588+0000 7f67e9ad0640 1 --2- 172.21.15.29:0/19811079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e40b42f0 0x7f67e413f610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f67e40b7620 tx=0x7f67cc02a270 comp rx=0 tx=0).stop 2024-09-13T18:50:35.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.588+0000 7f67e9ad0640 1 -- 172.21.15.29:0/19811079 shutdown_connections 2024-09-13T18:50:35.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.588+0000 7f67e9ad0640 1 --2- 172.21.15.29:0/19811079 >> v2:172.21.15.96:3300/0 conn(0x7f67e413fb50 0x7f67e4150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.588+0000 7f67e9ad0640 1 --2- 172.21.15.29:0/19811079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e40b42f0 0x7f67e413f610 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.588+0000 7f67e9ad0640 1 -- 172.21.15.29:0/19811079 >> 172.21.15.29:0/19811079 conn(0x7f67e4071c30 msgr2=0x7f67e40bb430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.588+0000 7f67e9ad0640 1 -- 172.21.15.29:0/19811079 shutdown_connections 2024-09-13T18:50:35.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.588+0000 7f67e9ad0640 1 -- 172.21.15.29:0/19811079 wait complete. 2024-09-13T18:50:35.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.589+0000 7f67e9ad0640 1 Processor -- start 2024-09-13T18:50:35.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.589+0000 7f67e9ad0640 1 -- start start 2024-09-13T18:50:35.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e9ad0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e40b42f0 0x7f67e4145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e9ad0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67e40bbdb0 0x7f67e41db160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e9ad0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67e413fb50 0x7f67e41de6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e9ad0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e41414d0 con 0x7f67e40b42f0 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e9ad0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e41403a0 con 0x7f67e413fb50 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e9ad0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e413ad80 con 0x7f67e40bbdb0 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e40b42f0 0x7f67e4145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e40b42f0 0x7f67e4145d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55736/0 (socket says 172.21.15.29:55736) 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e37fe640 1 -- 172.21.15.29:0/4145455962 learned_addr learned my addr 172.21.15.29:0/4145455962 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67dbfff640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67e40bbdb0 0x7f67e41db160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e3fff640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67e413fb50 0x7f67e41de6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e37fe640 1 -- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67e40bbdb0 msgr2=0x7f67e41db160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e37fe640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67e40bbdb0 0x7f67e41db160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e37fe640 1 -- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67e413fb50 msgr2=0x7f67e41de6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e37fe640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67e413fb50 0x7f67e41de6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e37fe640 1 -- 172.21.15.29:0/4145455962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc0094d0 con 0x7f67e40b42f0 2024-09-13T18:50:35.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.590+0000 7f67e37fe640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e40b42f0 0x7f67e4145d30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c410 tx=0x7f67d400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.591+0000 7f67e0ff9640 1 -- 172.21.15.29:0/4145455962 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40035f0 con 0x7f67e40b42f0 2024-09-13T18:50:35.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.591+0000 7f67e0ff9640 1 -- 172.21.15.29:0/4145455962 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d4003770 con 0x7f67e40b42f0 2024-09-13T18:50:35.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.591+0000 7f67e9ad0640 1 -- 172.21.15.29:0/4145455962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e4146530 con 0x7f67e40b42f0 2024-09-13T18:50:35.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.591+0000 7f67e0ff9640 1 -- 172.21.15.29:0/4145455962 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4003b20 con 0x7f67e40b42f0 2024-09-13T18:50:35.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.591+0000 7f67e9ad0640 1 -- 172.21.15.29:0/4145455962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e4141130 con 0x7f67e40b42f0 2024-09-13T18:50:35.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.592+0000 7f67e9ad0640 1 -- 172.21.15.29:0/4145455962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e413af40 con 0x7f67e40b42f0 2024-09-13T18:50:35.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.592+0000 7f67e0ff9640 1 -- 172.21.15.29:0/4145455962 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f67d4003c80 con 0x7f67e40b42f0 2024-09-13T18:50:35.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.592+0000 7f67e0ff9640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f67c406ac00 0x7f67c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.593+0000 7f67e0ff9640 1 -- 172.21.15.29:0/4145455962 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f67d4088c40 con 0x7f67e40b42f0 2024-09-13T18:50:35.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.593+0000 7f67dbfff640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f67c406ac00 0x7f67c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.593+0000 7f67dbfff640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f67c406ac00 0x7f67c406d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67cc034000 tx=0x7f67cc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.597+0000 7f67e0ff9640 1 -- 172.21.15.29:0/4145455962 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f67d4053ba0 con 0x7f67e40b42f0 2024-09-13T18:50:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.767+0000 7f67e9ad0640 1 -- 172.21.15.29:0/4145455962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67e40b4c80 con 0x7f67e40b42f0 2024-09-13T18:50:35.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.767+0000 7f67e0ff9640 1 -- 172.21.15.29:0/4145455962 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67d40170a0 con 0x7f67e40b42f0 2024-09-13T18:50:35.770 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-13T18:50:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.769+0000 7f67e9ad0640 1 -- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f67c406ac00 msgr2=0x7f67c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.769+0000 7f67e9ad0640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f67c406ac00 0x7f67c406d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67cc034000 tx=0x7f67cc02e000 comp rx=0 tx=0).stop 2024-09-13T18:50:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.769+0000 7f67e9ad0640 1 -- 172.21.15.29:0/4145455962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e40b42f0 msgr2=0x7f67e4145d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.769+0000 7f67e9ad0640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e40b42f0 0x7f67e4145d30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c410 tx=0x7f67d400c8d0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.769+0000 7f67e9ad0640 1 -- 172.21.15.29:0/4145455962 shutdown_connections 2024-09-13T18:50:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.769+0000 7f67e9ad0640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f67c406ac00 0x7f67c406d0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.769+0000 7f67e9ad0640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67e413fb50 0x7f67e41de6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.769+0000 7f67e9ad0640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67e40bbdb0 0x7f67e41db160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.769+0000 7f67e9ad0640 1 --2- 172.21.15.29:0/4145455962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e40b42f0 0x7f67e4145d30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.769+0000 7f67e9ad0640 1 -- 172.21.15.29:0/4145455962 >> 172.21.15.29:0/4145455962 conn(0x7f67e4071c30 msgr2=0x7f67e40b7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.769+0000 7f67e9ad0640 1 -- 172.21.15.29:0/4145455962 shutdown_connections 2024-09-13T18:50:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.769+0000 7f67e9ad0640 1 -- 172.21.15.29:0/4145455962 wait complete. 2024-09-13T18:50:35.783 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:50:35.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.885+0000 7fbf3f976640 1 Processor -- start 2024-09-13T18:50:35.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.885+0000 7fbf3f976640 1 -- start start 2024-09-13T18:50:35.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.886+0000 7fbf3f976640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbf380b5f50 0x7fbf3813f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.886+0000 7fbf3f976640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf380b3320 0x7fbf3813fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.886+0000 7fbf3f976640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf380b3880 con 0x7fbf380b44b0 2024-09-13T18:50:35.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.886+0000 7fbf3f976640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf380b5580 con 0x7fbf380b5f50 2024-09-13T18:50:35.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.886+0000 7fbf3f976640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380b4890 con 0x7fbf380b3320 2024-09-13T18:50:35.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.886+0000 7fbf3cf11640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbf380b5f50 0x7fbf3813f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.886+0000 7fbf3cf11640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbf380b5f50 0x7fbf3813f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55750/0 (socket says 172.21.15.29:55750) 2024-09-13T18:50:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.886+0000 7fbf3cf11640 1 -- 172.21.15.29:0/2675034827 learned_addr learned my addr 172.21.15.29:0/2675034827 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.886+0000 7fbf3df13640 1 --2- 172.21.15.29:0/2675034827 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf380b3320 0x7fbf3813fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.887+0000 7fbf3cf11640 1 -- 172.21.15.29:0/2675034827 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf380b3320 msgr2=0x7fbf3813fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.887+0000 7fbf3cf11640 1 --2- 172.21.15.29:0/2675034827 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf380b3320 0x7fbf3813fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.887+0000 7fbf3cf11640 1 -- 172.21.15.29:0/2675034827 >> v1:172.21.15.96:6789/0 conn(0x7fbf380b44b0 legacy=0x7fbf381462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.887+0000 7fbf3cf11640 1 -- 172.21.15.29:0/2675034827 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf380b57f0 con 0x7fbf380b5f50 2024-09-13T18:50:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.887+0000 7fbf3cf11640 1 --2- 172.21.15.29:0/2675034827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf380b5f50 0x7fbf3813f5f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009870 tx=0x7fbf2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418dff3b9ca8838a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.888+0000 7fbf2ffff640 1 -- 172.21.15.29:0/2675034827 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28032440 con 0x7fbf380b5f50 2024-09-13T18:50:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.888+0000 7fbf2ffff640 1 -- 172.21.15.29:0/2675034827 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf280325a0 con 0x7fbf380b5f50 2024-09-13T18:50:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.888+0000 7fbf2ffff640 1 -- 172.21.15.29:0/2675034827 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28032930 con 0x7fbf380b5f50 2024-09-13T18:50:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.888+0000 7fbf3f976640 1 -- 172.21.15.29:0/2675034827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf380b5f50 msgr2=0x7fbf3813f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.888+0000 7fbf3f976640 1 --2- 172.21.15.29:0/2675034827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf380b5f50 0x7fbf3813f5f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009870 tx=0x7fbf2802a270 comp rx=0 tx=0).stop 2024-09-13T18:50:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.888+0000 7fbf3f976640 1 -- 172.21.15.29:0/2675034827 shutdown_connections 2024-09-13T18:50:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.888+0000 7fbf3f976640 1 --2- 172.21.15.29:0/2675034827 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf380b3320 0x7fbf3813fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.888+0000 7fbf3f976640 1 --2- 172.21.15.29:0/2675034827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf380b5f50 0x7fbf3813f5f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.888+0000 7fbf3f976640 1 -- 172.21.15.29:0/2675034827 >> 172.21.15.29:0/2675034827 conn(0x7fbf380b8050 msgr2=0x7fbf380b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.888+0000 7fbf3f976640 1 -- 172.21.15.29:0/2675034827 shutdown_connections 2024-09-13T18:50:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.888+0000 7fbf3f976640 1 -- 172.21.15.29:0/2675034827 wait complete. 2024-09-13T18:50:35.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.889+0000 7fbf3f976640 1 Processor -- start 2024-09-13T18:50:35.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.889+0000 7fbf3f976640 1 -- start start 2024-09-13T18:50:35.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3f976640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380b3320 0x7fbf3813bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3f976640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf380b44b0 0x7fbf3813c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3f976640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf380b5f50 0x7fbf381deca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3f976640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3813ead0 con 0x7fbf380b5f50 2024-09-13T18:50:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3f976640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3813de60 con 0x7fbf380b3320 2024-09-13T18:50:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3f976640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3813cef0 con 0x7fbf380b44b0 2024-09-13T18:50:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3df13640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf380b5f50 0x7fbf381deca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3df13640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf380b5f50 0x7fbf381deca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55764/0 (socket says 172.21.15.29:55764) 2024-09-13T18:50:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3df13640 1 -- 172.21.15.29:0/153446315 learned_addr learned my addr 172.21.15.29:0/153446315 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3d712640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380b3320 0x7fbf3813bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3cf11640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf380b44b0 0x7fbf3813c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3df13640 1 -- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf380b44b0 msgr2=0x7fbf3813c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3df13640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf380b44b0 0x7fbf3813c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3df13640 1 -- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380b3320 msgr2=0x7fbf3813bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3df13640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380b3320 0x7fbf3813bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.890+0000 7fbf3df13640 1 -- 172.21.15.29:0/153446315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf280094d0 con 0x7fbf380b5f50 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.891+0000 7fbf3df13640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf380b5f50 0x7fbf381deca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000efc0 tx=0x7fbf3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.891+0000 7fbf2dffb640 1 -- 172.21.15.29:0/153446315 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30009b20 con 0x7fbf380b5f50 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.891+0000 7fbf2dffb640 1 -- 172.21.15.29:0/153446315 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3000f040 con 0x7fbf380b5f50 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.891+0000 7fbf2dffb640 1 -- 172.21.15.29:0/153446315 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300146c0 con 0x7fbf380b5f50 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.891+0000 7fbf3f976640 1 -- 172.21.15.29:0/153446315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3813e060 con 0x7fbf380b5f50 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.891+0000 7fbf3f976640 1 -- 172.21.15.29:0/153446315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3813d260 con 0x7fbf380b5f50 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.892+0000 7fbf3f976640 1 -- 172.21.15.29:0/153446315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf3813cd50 con 0x7fbf380b5f50 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.892+0000 7fbf2dffb640 1 -- 172.21.15.29:0/153446315 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbf30014820 con 0x7fbf380b5f50 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.893+0000 7fbf2dffb640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbf1c06ac30 0x7fbf1c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.893+0000 7fbf2dffb640 1 -- 172.21.15.29:0/153446315 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbf3008a2c0 con 0x7fbf380b5f50 2024-09-13T18:50:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.893+0000 7fbf3d712640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbf1c06ac30 0x7fbf1c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.893+0000 7fbf3d712640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbf1c06ac30 0x7fbf1c06d0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf34000f60 tx=0x7fbf34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:35.897+0000 7fbf2dffb640 1 -- 172.21.15.29:0/153446315 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbf3813cd50 con 0x7fbf380b5f50 2024-09-13T18:50:36.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.068+0000 7fbf3f976640 1 -- 172.21.15.29:0/153446315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf3813c250 con 0x7fbf380b5f50 2024-09-13T18:50:36.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.068+0000 7fbf2dffb640 1 -- 172.21.15.29:0/153446315 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf3813c250 con 0x7fbf380b5f50 2024-09-13T18:50:36.071 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-09-13T18:50:36.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.070+0000 7fbf3f976640 1 -- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbf1c06ac30 msgr2=0x7fbf1c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.070+0000 7fbf3f976640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbf1c06ac30 0x7fbf1c06d0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf34000f60 tx=0x7fbf34009040 comp rx=0 tx=0).stop 2024-09-13T18:50:36.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.070+0000 7fbf3f976640 1 -- 172.21.15.29:0/153446315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf380b5f50 msgr2=0x7fbf381deca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.070+0000 7fbf3f976640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf380b5f50 0x7fbf381deca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000efc0 tx=0x7fbf3000c490 comp rx=0 tx=0).stop 2024-09-13T18:50:36.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.070+0000 7fbf3f976640 1 -- 172.21.15.29:0/153446315 shutdown_connections 2024-09-13T18:50:36.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.070+0000 7fbf3f976640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbf1c06ac30 0x7fbf1c06d0f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.070+0000 7fbf3f976640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf380b5f50 0x7fbf381deca0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.070+0000 7fbf3f976640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf380b44b0 0x7fbf3813c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.070+0000 7fbf3f976640 1 --2- 172.21.15.29:0/153446315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380b3320 0x7fbf3813bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.070+0000 7fbf3f976640 1 -- 172.21.15.29:0/153446315 >> 172.21.15.29:0/153446315 conn(0x7fbf380b8050 msgr2=0x7fbf380b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.070+0000 7fbf3f976640 1 -- 172.21.15.29:0/153446315 shutdown_connections 2024-09-13T18:50:36.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.070+0000 7fbf3f976640 1 -- 172.21.15.29:0/153446315 wait complete. 2024-09-13T18:50:36.084 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:50:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.187+0000 7fd10c073640 1 Processor -- start 2024-09-13T18:50:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.187+0000 7fd10c073640 1 -- start start 2024-09-13T18:50:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.187+0000 7fd10c073640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd104093de0 0x7fd10406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.187+0000 7fd10c073640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd1040b5990 0x7fd1040b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.187+0000 7fd10c073640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1040b70b0 con 0x7fd1040b6c50 2024-09-13T18:50:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.187+0000 7fd10c073640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1040b2230 con 0x7fd1040b5990 2024-09-13T18:50:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.187+0000 7fd10c073640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040b3ae0 con 0x7fd104093de0 2024-09-13T18:50:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.187+0000 7fd10a610640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd1040b5990 0x7fd1040b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.188+0000 7fd10a610640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd1040b5990 0x7fd1040b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55768/0 (socket says 172.21.15.29:55768) 2024-09-13T18:50:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.188+0000 7fd10a610640 1 -- 172.21.15.29:0/742304617 learned_addr learned my addr 172.21.15.29:0/742304617 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.188+0000 7fd10960e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd1040b6c50 0x7fd1040b5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41010/0 (socket says 172.21.15.29:41010) 2024-09-13T18:50:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.188+0000 7fd109e0f640 1 --2- 172.21.15.29:0/742304617 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd104093de0 0x7fd10406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.188+0000 7fd108e0d640 1 -- 172.21.15.29:0/742304617 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570644466 0 0) 0x7fd1040b70b0 con 0x7fd1040b6c50 2024-09-13T18:50:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.191+0000 7fd108e0d640 1 -- 172.21.15.29:0/742304617 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0f0003500 con 0x7fd1040b6c50 2024-09-13T18:50:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.191+0000 7fd10a610640 1 -- 172.21.15.29:0/742304617 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd104093de0 msgr2=0x7fd10406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.191+0000 7fd10a610640 1 --2- 172.21.15.29:0/742304617 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd104093de0 0x7fd10406b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.191+0000 7fd10a610640 1 -- 172.21.15.29:0/742304617 >> v1:172.21.15.29:6789/0 conn(0x7fd1040b6c50 legacy=0x7fd1040b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.191+0000 7fd10a610640 1 -- 172.21.15.29:0/742304617 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1040b6170 con 0x7fd1040b5990 2024-09-13T18:50:36.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.192+0000 7fd10a610640 1 --2- 172.21.15.29:0/742304617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1040b5990 0x7fd1040b35a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00bef0 tx=0x7fd0fc009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9239e175e68203 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.192+0000 7fd108e0d640 1 -- 172.21.15.29:0/742304617 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc009d80 con 0x7fd1040b5990 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.192+0000 7fd108e0d640 1 -- 172.21.15.29:0/742304617 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc02d050 con 0x7fd1040b5990 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.192+0000 7fd108e0d640 1 -- 172.21.15.29:0/742304617 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc00b310 con 0x7fd1040b5990 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.193+0000 7fd10c073640 1 -- 172.21.15.29:0/742304617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1040b5990 msgr2=0x7fd1040b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.193+0000 7fd10c073640 1 --2- 172.21.15.29:0/742304617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1040b5990 0x7fd1040b35a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00bef0 tx=0x7fd0fc009800 comp rx=0 tx=0).stop 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.193+0000 7fd10c073640 1 -- 172.21.15.29:0/742304617 shutdown_connections 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.193+0000 7fd10c073640 1 --2- 172.21.15.29:0/742304617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1040b5990 0x7fd1040b35a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.193+0000 7fd10c073640 1 --2- 172.21.15.29:0/742304617 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd104093de0 0x7fd10406b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.193+0000 7fd10c073640 1 -- 172.21.15.29:0/742304617 >> 172.21.15.29:0/742304617 conn(0x7fd104099230 msgr2=0x7fd104099640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.193+0000 7fd10c073640 1 -- 172.21.15.29:0/742304617 shutdown_connections 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.193+0000 7fd10c073640 1 -- 172.21.15.29:0/742304617 wait complete. 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.194+0000 7fd10c073640 1 Processor -- start 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.194+0000 7fd10c073640 1 -- start start 2024-09-13T18:50:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd10c073640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd104093de0 0x7fd1040980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd10c073640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1040b5990 0x7fd10409cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd10c073640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1040b6c50 0x7fd10409a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd10c073640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040719b0 con 0x7fd104093de0 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd10c073640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10409d270 con 0x7fd1040b6c50 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd10c073640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd104072070 con 0x7fd1040b5990 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd109e0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd104093de0 0x7fd1040980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd109e0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd104093de0 0x7fd1040980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55772/0 (socket says 172.21.15.29:55772) 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd109e0f640 1 -- 172.21.15.29:0/1226339675 learned_addr learned my addr 172.21.15.29:0/1226339675 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd10a610640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1040b6c50 0x7fd10409a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd10960e640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1040b5990 0x7fd10409cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd109e0f640 1 -- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1040b5990 msgr2=0x7fd10409cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd109e0f640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1040b5990 0x7fd10409cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd109e0f640 1 -- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1040b6c50 msgr2=0x7fd10409a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd109e0f640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1040b6c50 0x7fd10409a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd109e0f640 1 -- 172.21.15.29:0/1226339675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc00bb50 con 0x7fd104093de0 2024-09-13T18:50:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd10a610640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1040b6c50 0x7fd10409a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd109e0f640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd104093de0 0x7fd1040980d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd100007c40 tx=0x7fd1000124a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd0fa7fc640 1 -- 172.21.15.29:0/1226339675 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100007e50 con 0x7fd104093de0 2024-09-13T18:50:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.195+0000 7fd0fa7fc640 1 -- 172.21.15.29:0/1226339675 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd100014040 con 0x7fd104093de0 2024-09-13T18:50:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.196+0000 7fd0fa7fc640 1 -- 172.21.15.29:0/1226339675 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100018610 con 0x7fd104093de0 2024-09-13T18:50:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.196+0000 7fd10c073640 1 -- 172.21.15.29:0/1226339675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10409d080 con 0x7fd104093de0 2024-09-13T18:50:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.196+0000 7fd10c073640 1 -- 172.21.15.29:0/1226339675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10406f350 con 0x7fd104093de0 2024-09-13T18:50:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.197+0000 7fd10c073640 1 -- 172.21.15.29:0/1226339675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10406f510 con 0x7fd104093de0 2024-09-13T18:50:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.197+0000 7fd0fa7fc640 1 -- 172.21.15.29:0/1226339675 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd100018770 con 0x7fd104093de0 2024-09-13T18:50:36.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.198+0000 7fd0fa7fc640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd0e806ac00 0x7fd0e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.198+0000 7fd0fa7fc640 1 -- 172.21.15.29:0/1226339675 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd10008dad0 con 0x7fd104093de0 2024-09-13T18:50:36.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.198+0000 7fd10960e640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd0e806ac00 0x7fd0e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.198+0000 7fd10960e640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd0e806ac00 0x7fd0e806d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd1041ec450 tx=0x7fd0f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.202+0000 7fd0fa7fc640 1 -- 172.21.15.29:0/1226339675 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd100058980 con 0x7fd104093de0 2024-09-13T18:50:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.371+0000 7fd10c073640 1 -- 172.21.15.29:0/1226339675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd10406b5b0 con 0x7fd104093de0 2024-09-13T18:50:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.371+0000 7fd0fa7fc640 1 -- 172.21.15.29:0/1226339675 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd10005bfa0 con 0x7fd104093de0 2024-09-13T18:50:36.374 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.373+0000 7fd10c073640 1 -- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd0e806ac00 msgr2=0x7fd0e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.373+0000 7fd10c073640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd0e806ac00 0x7fd0e806d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd1041ec450 tx=0x7fd0f4009040 comp rx=0 tx=0).stop 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.373+0000 7fd10c073640 1 -- 172.21.15.29:0/1226339675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd104093de0 msgr2=0x7fd1040980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.373+0000 7fd10c073640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd104093de0 0x7fd1040980d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd100007c40 tx=0x7fd1000124a0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.373+0000 7fd10c073640 1 -- 172.21.15.29:0/1226339675 shutdown_connections 2024-09-13T18:50:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.373+0000 7fd10c073640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fd0e806ac00 0x7fd0e806d0c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.373+0000 7fd10c073640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1040b6c50 0x7fd10409a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.373+0000 7fd10c073640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1040b5990 0x7fd10409cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.373+0000 7fd10c073640 1 --2- 172.21.15.29:0/1226339675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd104093de0 0x7fd1040980d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.373+0000 7fd10c073640 1 -- 172.21.15.29:0/1226339675 >> 172.21.15.29:0/1226339675 conn(0x7fd104099230 msgr2=0x7fd10408e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.373+0000 7fd10c073640 1 -- 172.21.15.29:0/1226339675 shutdown_connections 2024-09-13T18:50:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.373+0000 7fd10c073640 1 -- 172.21.15.29:0/1226339675 wait complete. 2024-09-13T18:50:36.387 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:50:36.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.486+0000 7efe8ca4f640 1 Processor -- start 2024-09-13T18:50:36.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.486+0000 7efe8ca4f640 1 -- start start 2024-09-13T18:50:36.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.487+0000 7efe8ca4f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe880ac9e0 0x7efe88145d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.487+0000 7efe8ca4f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efe8814b020 0x7efe8814d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.487+0000 7efe8ca4f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8809cdb0 con 0x7efe880b38b0 2024-09-13T18:50:36.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.487+0000 7efe8ca4f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe880ad300 con 0x7efe8814b020 2024-09-13T18:50:36.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.487+0000 7efe8ca4f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe880adfc0 con 0x7efe880ac9e0 2024-09-13T18:50:36.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.487+0000 7efe85d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efe880b38b0 0x7efe88071a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41026/0 (socket says 172.21.15.29:41026) 2024-09-13T18:50:36.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.487+0000 7efe85d9b640 1 -- 172.21.15.29:0/2504432379 learned_addr learned my addr 172.21.15.29:0/2504432379 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:36.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.488+0000 7efe8659c640 1 --2- 172.21.15.29:0/2504432379 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe880ac9e0 0x7efe88145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.488+0000 7efe86d9d640 1 --2- 172.21.15.29:0/2504432379 >> v2:172.21.15.96:3300/0 conn(0x7efe8814b020 0x7efe8814d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.488+0000 7efe8559a640 1 -- 172.21.15.29:0/2504432379 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089698484 0 0) 0x7efe8809cdb0 con 0x7efe880b38b0 2024-09-13T18:50:36.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.488+0000 7efe8559a640 1 -- 172.21.15.29:0/2504432379 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe70003520 con 0x7efe880b38b0 2024-09-13T18:50:36.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.488+0000 7efe86d9d640 1 -- 172.21.15.29:0/2504432379 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe880ac9e0 msgr2=0x7efe88145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.488+0000 7efe86d9d640 1 --2- 172.21.15.29:0/2504432379 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe880ac9e0 0x7efe88145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.488+0000 7efe86d9d640 1 -- 172.21.15.29:0/2504432379 >> v1:172.21.15.29:6789/0 conn(0x7efe880b38b0 legacy=0x7efe88071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.488+0000 7efe8559a640 1 -- 172.21.15.29:0/2504432379 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3635045877 0 0) 0x7efe70003520 con 0x7efe880b38b0 2024-09-13T18:50:36.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.488+0000 7efe86d9d640 1 -- 172.21.15.29:0/2504432379 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe88146240 con 0x7efe8814b020 2024-09-13T18:50:36.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.488+0000 7efe8659c640 1 --2- 172.21.15.29:0/2504432379 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe880ac9e0 0x7efe88145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:36.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.489+0000 7efe86d9d640 1 --2- 172.21.15.29:0/2504432379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8814b020 0x7efe8814d410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efe80009dc0 tx=0x7efe8002a580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cb1e2f0d28e5258 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.489+0000 7efe8559a640 1 -- 172.21.15.29:0/2504432379 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c001670 con 0x7efe8814b020 2024-09-13T18:50:36.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.489+0000 7efe8559a640 1 -- 172.21.15.29:0/2504432379 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8002d050 con 0x7efe8814b020 2024-09-13T18:50:36.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.489+0000 7efe8559a640 1 -- 172.21.15.29:0/2504432379 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80007740 con 0x7efe8814b020 2024-09-13T18:50:36.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.489+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2504432379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8814b020 msgr2=0x7efe8814d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.489+0000 7efe8ca4f640 1 --2- 172.21.15.29:0/2504432379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8814b020 0x7efe8814d410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efe80009dc0 tx=0x7efe8002a580 comp rx=0 tx=0).stop 2024-09-13T18:50:36.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.490+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2504432379 shutdown_connections 2024-09-13T18:50:36.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.490+0000 7efe8ca4f640 1 --2- 172.21.15.29:0/2504432379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8814b020 0x7efe8814d410 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.490+0000 7efe8ca4f640 1 --2- 172.21.15.29:0/2504432379 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe880ac9e0 0x7efe88145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.490+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2504432379 >> 172.21.15.29:0/2504432379 conn(0x7efe880b3fb0 msgr2=0x7efe880b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.490+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2504432379 shutdown_connections 2024-09-13T18:50:36.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.490+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2504432379 wait complete. 2024-09-13T18:50:36.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.491+0000 7efe8ca4f640 1 Processor -- start 2024-09-13T18:50:36.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.491+0000 7efe8ca4f640 1 -- start start 2024-09-13T18:50:36.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.491+0000 7efe8ca4f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe880ac9e0 0x7efe8813b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.491+0000 7efe8ca4f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe880b38b0 0x7efe881da090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.491+0000 7efe8ca4f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8814b020 0x7efe881da5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.491+0000 7efe8ca4f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe881438d0 con 0x7efe8814b020 2024-09-13T18:50:36.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.491+0000 7efe8ca4f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe881d9240 con 0x7efe880b38b0 2024-09-13T18:50:36.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.491+0000 7efe8ca4f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe881d9520 con 0x7efe880ac9e0 2024-09-13T18:50:36.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.491+0000 7efe86d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8814b020 0x7efe881da5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.491+0000 7efe86d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8814b020 0x7efe881da5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55778/0 (socket says 172.21.15.29:55778) 2024-09-13T18:50:36.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.491+0000 7efe86d9d640 1 -- 172.21.15.29:0/2873998900 learned_addr learned my addr 172.21.15.29:0/2873998900 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:36.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe85d9b640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe880b38b0 0x7efe881da090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe8659c640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe880ac9e0 0x7efe8813b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe86d9d640 1 -- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe880ac9e0 msgr2=0x7efe8813b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe86d9d640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe880ac9e0 0x7efe8813b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe86d9d640 1 -- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe880b38b0 msgr2=0x7efe881da090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe86d9d640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe880b38b0 0x7efe881da090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe86d9d640 1 -- 172.21.15.29:0/2873998900 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78009400 con 0x7efe8814b020 2024-09-13T18:50:36.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe86d9d640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8814b020 0x7efe881da5d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe8002ab70 tx=0x7efe80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe76ffd640 1 -- 172.21.15.29:0/2873998900 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80007740 con 0x7efe8814b020 2024-09-13T18:50:36.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe76ffd640 1 -- 172.21.15.29:0/2873998900 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe800078a0 con 0x7efe8814b020 2024-09-13T18:50:36.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2873998900 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe80009a70 con 0x7efe8814b020 2024-09-13T18:50:36.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe76ffd640 1 -- 172.21.15.29:0/2873998900 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80007c10 con 0x7efe8814b020 2024-09-13T18:50:36.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.492+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2873998900 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe881d8f10 con 0x7efe8814b020 2024-09-13T18:50:36.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.493+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2873998900 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe880ad760 con 0x7efe8814b020 2024-09-13T18:50:36.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.494+0000 7efe76ffd640 1 -- 172.21.15.29:0/2873998900 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efe80007d70 con 0x7efe8814b020 2024-09-13T18:50:36.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.494+0000 7efe76ffd640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efe6806ac00 0x7efe6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.494+0000 7efe76ffd640 1 -- 172.21.15.29:0/2873998900 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efe800aab00 con 0x7efe8814b020 2024-09-13T18:50:36.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.495+0000 7efe8659c640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efe6806ac00 0x7efe6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.495+0000 7efe8659c640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efe6806ac00 0x7efe6806d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efe78009cd0 tx=0x7efe78009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.499+0000 7efe76ffd640 1 -- 172.21.15.29:0/2873998900 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efe80075a60 con 0x7efe8814b020 2024-09-13T18:50:36.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.683+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2873998900 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efe8809d770 con 0x7efe8814b020 2024-09-13T18:50:36.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.683+0000 7efe76ffd640 1 -- 172.21.15.29:0/2873998900 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7efe80009450 con 0x7efe8814b020 2024-09-13T18:50:36.686 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.685+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efe6806ac00 msgr2=0x7efe6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.685+0000 7efe8ca4f640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efe6806ac00 0x7efe6806d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efe78009cd0 tx=0x7efe78009190 comp rx=0 tx=0).stop 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.685+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2873998900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8814b020 msgr2=0x7efe881da5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.685+0000 7efe8ca4f640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8814b020 0x7efe881da5d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe8002ab70 tx=0x7efe80004a40 comp rx=0 tx=0).stop 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.685+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2873998900 shutdown_connections 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.685+0000 7efe8ca4f640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efe6806ac00 0x7efe6806d0c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.685+0000 7efe8ca4f640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8814b020 0x7efe881da5d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.685+0000 7efe8ca4f640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe880b38b0 0x7efe881da090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.685+0000 7efe8ca4f640 1 --2- 172.21.15.29:0/2873998900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe880ac9e0 0x7efe8813b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.685+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2873998900 >> 172.21.15.29:0/2873998900 conn(0x7efe880b3fb0 msgr2=0x7efe88071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.686+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2873998900 shutdown_connections 2024-09-13T18:50:36.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.686+0000 7efe8ca4f640 1 -- 172.21.15.29:0/2873998900 wait complete. 2024-09-13T18:50:36.699 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-13T18:50:36.699 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:50:36.716 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:50:36.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.854+0000 7efdd9432640 1 Processor -- start 2024-09-13T18:50:36.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.854+0000 7efdd9432640 1 -- start start 2024-09-13T18:50:36.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd9432640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efdd40b31d0 0x7efdd40b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd9432640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdd413f8e0 0x7efdd413fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd9432640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd4149410 con 0x7efdd40b35b0 2024-09-13T18:50:36.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd9432640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd4149fb0 con 0x7efdd413f8e0 2024-09-13T18:50:36.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd9432640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd40b4550 con 0x7efdd40b31d0 2024-09-13T18:50:36.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd37fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdd413f8e0 0x7efdd413fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd37fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdd413f8e0 0x7efdd413fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55794/0 (socket says 172.21.15.29:55794) 2024-09-13T18:50:36.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd37fe640 1 -- 172.21.15.29:0/4044430185 learned_addr learned my addr 172.21.15.29:0/4044430185 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:36.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd2ffd640 1 --2- 172.21.15.29:0/4044430185 >> v2:172.21.15.96:3300/0 conn(0x7efdd40b31d0 0x7efdd40b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd37fe640 1 -- 172.21.15.29:0/4044430185 >> v2:172.21.15.96:3300/0 conn(0x7efdd40b31d0 msgr2=0x7efdd40b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd37fe640 1 --2- 172.21.15.29:0/4044430185 >> v2:172.21.15.96:3300/0 conn(0x7efdd40b31d0 0x7efdd40b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd37fe640 1 -- 172.21.15.29:0/4044430185 >> v1:172.21.15.96:6789/0 conn(0x7efdd40b35b0 legacy=0x7efdd41498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.855+0000 7efdd37fe640 1 -- 172.21.15.29:0/4044430185 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd40b4810 con 0x7efdd413f8e0 2024-09-13T18:50:36.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.856+0000 7efdd37fe640 1 --2- 172.21.15.29:0/4044430185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdd413f8e0 0x7efdd413fd00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efdd40bb4a0 tx=0x7efdcc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52c656c36beeff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.856+0000 7efdd1ffb640 1 -- 172.21.15.29:0/4044430185 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc031600 con 0x7efdd413f8e0 2024-09-13T18:50:36.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.856+0000 7efdd1ffb640 1 -- 172.21.15.29:0/4044430185 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc02d050 con 0x7efdd413f8e0 2024-09-13T18:50:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.856+0000 7efdd1ffb640 1 -- 172.21.15.29:0/4044430185 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc031980 con 0x7efdd413f8e0 2024-09-13T18:50:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.857+0000 7efdd9432640 1 -- 172.21.15.29:0/4044430185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdd413f8e0 msgr2=0x7efdd413fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.857+0000 7efdd9432640 1 --2- 172.21.15.29:0/4044430185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdd413f8e0 0x7efdd413fd00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efdd40bb4a0 tx=0x7efdcc02a6a0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.857+0000 7efdd9432640 1 -- 172.21.15.29:0/4044430185 shutdown_connections 2024-09-13T18:50:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.857+0000 7efdd9432640 1 --2- 172.21.15.29:0/4044430185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdd413f8e0 0x7efdd413fd00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.857+0000 7efdd9432640 1 --2- 172.21.15.29:0/4044430185 >> v2:172.21.15.96:3300/0 conn(0x7efdd40b31d0 0x7efdd40b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.857+0000 7efdd9432640 1 -- 172.21.15.29:0/4044430185 >> 172.21.15.29:0/4044430185 conn(0x7efdd40bb590 msgr2=0x7efdd40bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.857+0000 7efdd9432640 1 -- 172.21.15.29:0/4044430185 shutdown_connections 2024-09-13T18:50:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.857+0000 7efdd9432640 1 -- 172.21.15.29:0/4044430185 wait complete. 2024-09-13T18:50:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.858+0000 7efdd9432640 1 Processor -- start 2024-09-13T18:50:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.858+0000 7efdd9432640 1 -- start start 2024-09-13T18:50:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd9432640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdd40b31d0 0x7efdd4142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd9432640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdd40b35b0 0x7efdd41db320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd9432640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd413f8e0 0x7efdd41db860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd9432640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd41df5a0 con 0x7efdd40b31d0 2024-09-13T18:50:36.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd9432640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd40a9460 con 0x7efdd413f8e0 2024-09-13T18:50:36.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd9432640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd40a7bd0 con 0x7efdd40b35b0 2024-09-13T18:50:36.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdd40b31d0 0x7efdd4142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdd40b31d0 0x7efdd4142d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55802/0 (socket says 172.21.15.29:55802) 2024-09-13T18:50:36.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd2ffd640 1 -- 172.21.15.29:0/3646777297 learned_addr learned my addr 172.21.15.29:0/3646777297 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:36.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd27fc640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdd40b35b0 0x7efdd41db320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd37fe640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd413f8e0 0x7efdd41db860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd2ffd640 1 -- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdd40b35b0 msgr2=0x7efdd41db320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd2ffd640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdd40b35b0 0x7efdd41db320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd2ffd640 1 -- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd413f8e0 msgr2=0x7efdd41db860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd2ffd640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd413f8e0 0x7efdd41db860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd2ffd640 1 -- 172.21.15.29:0/3646777297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc009b30 con 0x7efdd40b31d0 2024-09-13T18:50:36.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd2ffd640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdd40b31d0 0x7efdd4142d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efdc400e9b0 tx=0x7efdc400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdbb7fe640 1 -- 172.21.15.29:0/3646777297 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4009670 con 0x7efdd40b31d0 2024-09-13T18:50:36.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdbb7fe640 1 -- 172.21.15.29:0/3646777297 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc400c9a0 con 0x7efdd40b31d0 2024-09-13T18:50:36.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdd9432640 1 -- 172.21.15.29:0/3646777297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd41deee0 con 0x7efdd40b31d0 2024-09-13T18:50:36.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.859+0000 7efdbb7fe640 1 -- 172.21.15.29:0/3646777297 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc400cd50 con 0x7efdd40b31d0 2024-09-13T18:50:36.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.860+0000 7efdd9432640 1 -- 172.21.15.29:0/3646777297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd4141e90 con 0x7efdd40b31d0 2024-09-13T18:50:36.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.861+0000 7efdd9432640 1 -- 172.21.15.29:0/3646777297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd4067300 con 0x7efdd40b31d0 2024-09-13T18:50:36.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.861+0000 7efdbb7fe640 1 -- 172.21.15.29:0/3646777297 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efdc4013470 con 0x7efdd40b31d0 2024-09-13T18:50:36.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.861+0000 7efdbb7fe640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efdc006ac00 0x7efdc006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.862+0000 7efdbb7fe640 1 -- 172.21.15.29:0/3646777297 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efdc4089970 con 0x7efdd40b31d0 2024-09-13T18:50:36.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.862+0000 7efdd27fc640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efdc006ac00 0x7efdc006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.862+0000 7efdd27fc640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efdc006ac00 0x7efdc006d0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efdd4142a10 tx=0x7efdc8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:36.866+0000 7efdbb7fe640 1 -- 172.21.15.29:0/3646777297 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efdc4054830 con 0x7efdd40b31d0 2024-09-13T18:50:37.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.035+0000 7efdd9432640 1 -- 172.21.15.29:0/3646777297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdd41db170 con 0x7efdd40b31d0 2024-09-13T18:50:37.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.036+0000 7efdbb7fe640 1 -- 172.21.15.29:0/3646777297 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18627 (secure 0 0 0) 0x7efdc4057e50 con 0x7efdd40b31d0 2024-09-13T18:50:37.039 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:50:37.040 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:46:11.136377+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.f","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:50:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.038+0000 7efdd9432640 1 -- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efdc006ac00 msgr2=0x7efdc006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.038+0000 7efdd9432640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efdc006ac00 0x7efdc006d0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efdd4142a10 tx=0x7efdc8009040 comp rx=0 tx=0).stop 2024-09-13T18:50:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.038+0000 7efdd9432640 1 -- 172.21.15.29:0/3646777297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdd40b31d0 msgr2=0x7efdd4142d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.038+0000 7efdd9432640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdd40b31d0 0x7efdd4142d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efdc400e9b0 tx=0x7efdc400ee70 comp rx=0 tx=0).stop 2024-09-13T18:50:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.038+0000 7efdd9432640 1 -- 172.21.15.29:0/3646777297 shutdown_connections 2024-09-13T18:50:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.038+0000 7efdd9432640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efdc006ac00 0x7efdc006d0c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.038+0000 7efdd9432640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd413f8e0 0x7efdd41db860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.038+0000 7efdd9432640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdd40b35b0 0x7efdd41db320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.038+0000 7efdd9432640 1 --2- 172.21.15.29:0/3646777297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdd40b31d0 0x7efdd4142d30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.038+0000 7efdd9432640 1 -- 172.21.15.29:0/3646777297 >> 172.21.15.29:0/3646777297 conn(0x7efdd40bb590 msgr2=0x7efdd40b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:37.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.038+0000 7efdd9432640 1 -- 172.21.15.29:0/3646777297 shutdown_connections 2024-09-13T18:50:37.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.038+0000 7efdd9432640 1 -- 172.21.15.29:0/3646777297 wait complete. 2024-09-13T18:50:37.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:45:17.630827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:45:20.113248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:20.978194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:24.059966+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:50:37.052 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:50:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.154+0000 7f933b0c9640 1 Processor -- start 2024-09-13T18:50:37.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.154+0000 7f933b0c9640 1 -- start start 2024-09-13T18:50:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f933b0c9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f933413f5b0 0x7f93340b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f933b0c9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9334145d50 0x7f933414c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f933b0c9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93340b5d60 con 0x7f93340b5280 2024-09-13T18:50:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f933b0c9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933406d0c0 con 0x7f933413f5b0 2024-09-13T18:50:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f933b0c9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93340b5710 con 0x7f9334145d50 2024-09-13T18:50:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f9333fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f93340b5280 0x7f9334145640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41034/0 (socket says 172.21.15.29:41034) 2024-09-13T18:50:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f9333fff640 1 -- 172.21.15.29:0/778665823 learned_addr learned my addr 172.21.15.29:0/778665823 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f9339666640 1 --2- 172.21.15.29:0/778665823 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9334145d50 0x7f933414c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f9338e65640 1 --2- 172.21.15.29:0/778665823 >> v2:172.21.15.96:3300/0 conn(0x7f933413f5b0 0x7f93340b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f93337fe640 1 -- 172.21.15.29:0/778665823 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214497892 0 0) 0x7f93340b5d60 con 0x7f93340b5280 2024-09-13T18:50:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f93337fe640 1 -- 172.21.15.29:0/778665823 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9324003520 con 0x7f93340b5280 2024-09-13T18:50:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f9338e65640 1 -- 172.21.15.29:0/778665823 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9334145d50 msgr2=0x7f933414c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f9338e65640 1 --2- 172.21.15.29:0/778665823 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9334145d50 0x7f933414c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f93337fe640 1 -- 172.21.15.29:0/778665823 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3805687269 0 0) 0x7f9324003520 con 0x7f93340b5280 2024-09-13T18:50:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f9338e65640 1 -- 172.21.15.29:0/778665823 >> v1:172.21.15.29:6789/0 conn(0x7f93340b5280 legacy=0x7f9334145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f9338e65640 1 -- 172.21.15.29:0/778665823 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93340b59f0 con 0x7f933413f5b0 2024-09-13T18:50:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.155+0000 7f9339666640 1 --2- 172.21.15.29:0/778665823 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9334145d50 0x7f933414c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.156+0000 7f9338e65640 1 --2- 172.21.15.29:0/778665823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f933413f5b0 0x7f93340b6a60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f93280097a0 tx=0x7f932802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7aafdbe77499456 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.156+0000 7f93337fe640 1 -- 172.21.15.29:0/778665823 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320001670 con 0x7f933413f5b0 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.156+0000 7f93337fe640 1 -- 172.21.15.29:0/778665823 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932802ab10 con 0x7f933413f5b0 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.156+0000 7f93337fe640 1 -- 172.21.15.29:0/778665823 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932802aea0 con 0x7f933413f5b0 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.157+0000 7f933b0c9640 1 -- 172.21.15.29:0/778665823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f933413f5b0 msgr2=0x7f93340b6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.157+0000 7f933b0c9640 1 --2- 172.21.15.29:0/778665823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f933413f5b0 0x7f93340b6a60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f93280097a0 tx=0x7f932802a080 comp rx=0 tx=0).stop 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.157+0000 7f933b0c9640 1 -- 172.21.15.29:0/778665823 shutdown_connections 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.157+0000 7f933b0c9640 1 --2- 172.21.15.29:0/778665823 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9334145d50 0x7f933414c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.157+0000 7f933b0c9640 1 --2- 172.21.15.29:0/778665823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f933413f5b0 0x7f93340b6a60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.157+0000 7f933b0c9640 1 -- 172.21.15.29:0/778665823 >> 172.21.15.29:0/778665823 conn(0x7f933406a2f0 msgr2=0x7f933406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.157+0000 7f933b0c9640 1 -- 172.21.15.29:0/778665823 shutdown_connections 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.157+0000 7f933b0c9640 1 -- 172.21.15.29:0/778665823 wait complete. 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.158+0000 7f933b0c9640 1 Processor -- start 2024-09-13T18:50:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.158+0000 7f933b0c9640 1 -- start start 2024-09-13T18:50:37.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f933b0c9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f933413f5b0 0x7f9334070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f933b0c9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9334145d50 0x7f933413fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f933b0c9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93340b06e0 0x7f93340b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f933b0c9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93341d7760 con 0x7f93340b06e0 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f933b0c9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933413cdf0 con 0x7f9334145d50 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f933b0c9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93341d7f60 con 0x7f933413f5b0 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f9339666640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93340b06e0 0x7f93340b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f9339666640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93340b06e0 0x7f93340b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55806/0 (socket says 172.21.15.29:55806) 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f9339666640 1 -- 172.21.15.29:0/1834414683 learned_addr learned my addr 172.21.15.29:0/1834414683 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f9333fff640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9334145d50 0x7f933413fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f9338e65640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f933413f5b0 0x7f9334070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f9339666640 1 -- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f933413f5b0 msgr2=0x7f9334070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f9339666640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f933413f5b0 0x7f9334070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f9339666640 1 -- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9334145d50 msgr2=0x7f933413fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f9339666640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9334145d50 0x7f933413fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f9339666640 1 -- 172.21.15.29:0/1834414683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c00ab80 con 0x7f93340b06e0 2024-09-13T18:50:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f9338e65640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f933413f5b0 0x7f9334070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f9339666640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93340b06e0 0x7f93340b0b90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f932c00ffc0 tx=0x7f932c00d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.159+0000 7f93317fa640 1 -- 172.21.15.29:0/1834414683 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c019070 con 0x7f93340b06e0 2024-09-13T18:50:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.160+0000 7f93317fa640 1 -- 172.21.15.29:0/1834414683 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c010040 con 0x7f93340b06e0 2024-09-13T18:50:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.160+0000 7f93317fa640 1 -- 172.21.15.29:0/1834414683 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c00ade0 con 0x7f93340b06e0 2024-09-13T18:50:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.160+0000 7f933b0c9640 1 -- 172.21.15.29:0/1834414683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9328009400 con 0x7f93340b06e0 2024-09-13T18:50:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.160+0000 7f933b0c9640 1 -- 172.21.15.29:0/1834414683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93341d7950 con 0x7f93340b06e0 2024-09-13T18:50:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.160+0000 7f933b0c9640 1 -- 172.21.15.29:0/1834414683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93340672b0 con 0x7f93340b06e0 2024-09-13T18:50:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.161+0000 7f93317fa640 1 -- 172.21.15.29:0/1834414683 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f932c015480 con 0x7f93340b06e0 2024-09-13T18:50:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.161+0000 7f93317fa640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f931806ac00 0x7f931806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.161+0000 7f93317fa640 1 -- 172.21.15.29:0/1834414683 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f932c08a900 con 0x7f93340b06e0 2024-09-13T18:50:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.162+0000 7f9338e65640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f931806ac00 0x7f931806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.162+0000 7f9338e65640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f931806ac00 0x7f931806d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9328034000 tx=0x7f932802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.166+0000 7f93317fa640 1 -- 172.21.15.29:0/1834414683 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f932c0557b0 con 0x7f93340b06e0 2024-09-13T18:50:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.335+0000 7f933b0c9640 1 -- 172.21.15.29:0/1834414683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93340b5fb0 con 0x7f93340b06e0 2024-09-13T18:50:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.336+0000 7f93317fa640 1 -- 172.21.15.29:0/1834414683 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f932c058dd0 con 0x7f93340b06e0 2024-09-13T18:50:37.338 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-09-13T18:50:37.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.338+0000 7f933b0c9640 1 -- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f931806ac00 msgr2=0x7f931806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.338+0000 7f933b0c9640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f931806ac00 0x7f931806d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9328034000 tx=0x7f932802e000 comp rx=0 tx=0).stop 2024-09-13T18:50:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.338+0000 7f933b0c9640 1 -- 172.21.15.29:0/1834414683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93340b06e0 msgr2=0x7f93340b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.338+0000 7f933b0c9640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93340b06e0 0x7f93340b0b90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f932c00ffc0 tx=0x7f932c00d490 comp rx=0 tx=0).stop 2024-09-13T18:50:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.338+0000 7f933b0c9640 1 -- 172.21.15.29:0/1834414683 shutdown_connections 2024-09-13T18:50:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.338+0000 7f933b0c9640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f931806ac00 0x7f931806d0c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.338+0000 7f933b0c9640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93340b06e0 0x7f93340b0b90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.338+0000 7f933b0c9640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9334145d50 0x7f933413fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.338+0000 7f933b0c9640 1 --2- 172.21.15.29:0/1834414683 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f933413f5b0 0x7f9334070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.338+0000 7f933b0c9640 1 -- 172.21.15.29:0/1834414683 >> 172.21.15.29:0/1834414683 conn(0x7f933406a2f0 msgr2=0x7f933406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.338+0000 7f933b0c9640 1 -- 172.21.15.29:0/1834414683 shutdown_connections 2024-09-13T18:50:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.338+0000 7f933b0c9640 1 -- 172.21.15.29:0/1834414683 wait complete. 2024-09-13T18:50:37.352 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:50:37.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.453+0000 7f9e1f911640 1 Processor -- start 2024-09-13T18:50:37.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.453+0000 7f9e1f911640 1 -- start start 2024-09-13T18:50:37.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.454+0000 7f9e1f911640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e1813f9f0 0x7f9e1806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.454+0000 7f9e1f911640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e18071bb0 con 0x7f9e1813fdd0 2024-09-13T18:50:37.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.454+0000 7f9e1f911640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e18071920 con 0x7f9e18145920 2024-09-13T18:50:37.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.454+0000 7f9e1f911640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e18070b10 con 0x7f9e1813f9f0 2024-09-13T18:50:37.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.454+0000 7f9e1ceac640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9e1813fdd0 0x7f9e18071210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41050/0 (socket says 172.21.15.29:41050) 2024-09-13T18:50:37.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.454+0000 7f9e1ceac640 1 -- 172.21.15.29:0/446524517 learned_addr learned my addr 172.21.15.29:0/446524517 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:37.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.454+0000 7f9e1d6ad640 1 --2- 172.21.15.29:0/446524517 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e1813f9f0 0x7f9e1806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.454+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191532354 0 0) 0x7f9e18071bb0 con 0x7f9e1813fdd0 2024-09-13T18:50:37.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.454+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e04003520 con 0x7f9e1813fdd0 2024-09-13T18:50:37.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.454+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4175970059 0 0) 0x7f9e04003520 con 0x7f9e1813fdd0 2024-09-13T18:50:37.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.454+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e1813f9f0 msgr2=0x7f9e1806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e0ffff640 1 --2- 172.21.15.29:0/446524517 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e1813f9f0 0x7f9e1806aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 >> v1:172.21.15.96:6789/0 conn(0x7f9e18145920 legacy=0x7f9e18150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1806f390 con 0x7f9e1813fdd0 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f9e08001670 con 0x7f9e1813fdd0 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 >> v1:172.21.15.29:6789/0 conn(0x7f9e1813fdd0 legacy=0x7f9e18071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e0ffff640 1 --2- 172.21.15.29:0/446524517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e040039a0 0x7f9e04003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e0ffff640 1 --2- 172.21.15.29:0/446524517 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e1813f9f0 0x7f9e040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e0ffff640 1 --2- 172.21.15.29:0/446524517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e04004d00 0x7f9e04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0400ba30 con 0x7f9e040039a0 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0400bb70 con 0x7f9e04004d00 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0400bd30 con 0x7f9e1813f9f0 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e1d6ad640 1 --2- 172.21.15.29:0/446524517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e040039a0 0x7f9e04003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e1ceac640 1 --2- 172.21.15.29:0/446524517 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e1813f9f0 0x7f9e040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e1deae640 1 --2- 172.21.15.29:0/446524517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e04004d00 0x7f9e04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e1d6ad640 1 -- 172.21.15.29:0/446524517 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e1813f9f0 msgr2=0x7f9e040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e1d6ad640 1 --2- 172.21.15.29:0/446524517 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e1813f9f0 0x7f9e040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e1d6ad640 1 -- 172.21.15.29:0/446524517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e04004d00 msgr2=0x7f9e04005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e1d6ad640 1 --2- 172.21.15.29:0/446524517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e04004d00 0x7f9e04005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.455+0000 7f9e1d6ad640 1 -- 172.21.15.29:0/446524517 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04003520 con 0x7f9e040039a0 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.456+0000 7f9e1d6ad640 1 --2- 172.21.15.29:0/446524517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e040039a0 0x7f9e04003d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009ac0 tx=0x7f9e040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3189b0d7c74ff3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.456+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e14031400 con 0x7f9e040039a0 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.456+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1402d050 con 0x7f9e040039a0 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.456+0000 7f9e0ffff640 1 -- 172.21.15.29:0/446524517 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e14031780 con 0x7f9e040039a0 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.456+0000 7f9e1f911640 1 -- 172.21.15.29:0/446524517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e040039a0 msgr2=0x7f9e04003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.456+0000 7f9e1f911640 1 --2- 172.21.15.29:0/446524517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e040039a0 0x7f9e04003d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009ac0 tx=0x7f9e040057f0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.456+0000 7f9e1deae640 1 -- 172.21.15.29:0/446524517 reap_dead start 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.456+0000 7f9e1f911640 1 -- 172.21.15.29:0/446524517 shutdown_connections 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.456+0000 7f9e1f911640 1 -- 172.21.15.29:0/446524517 >> 172.21.15.29:0/446524517 conn(0x7f9e180b4710 msgr2=0x7f9e180b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.457+0000 7f9e1f911640 1 -- 172.21.15.29:0/446524517 shutdown_connections 2024-09-13T18:50:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.457+0000 7f9e1f911640 1 -- 172.21.15.29:0/446524517 wait complete. 2024-09-13T18:50:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.458+0000 7f9e1f911640 1 Processor -- start 2024-09-13T18:50:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.458+0000 7f9e1f911640 1 -- start start 2024-09-13T18:50:37.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.458+0000 7f9e1f911640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e040039a0 0x7f9e180abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.458+0000 7f9e1f911640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180ad130 0x7f9e180ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.458+0000 7f9e1f911640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e180ae6f0 0x7f9e1813ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.458+0000 7f9e1f911640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180aeb70 con 0x7f9e180ae6f0 2024-09-13T18:50:37.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.458+0000 7f9e1f911640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e18149440 con 0x7f9e180ad130 2024-09-13T18:50:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.458+0000 7f9e1f911640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e181491a0 con 0x7f9e040039a0 2024-09-13T18:50:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.458+0000 7f9e1deae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e180ae6f0 0x7f9e1813ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.458+0000 7f9e1deae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e180ae6f0 0x7f9e1813ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55820/0 (socket says 172.21.15.29:55820) 2024-09-13T18:50:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.458+0000 7f9e1deae640 1 -- 172.21.15.29:0/1530935525 learned_addr learned my addr 172.21.15.29:0/1530935525 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e1ceac640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180ad130 0x7f9e180ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e1d6ad640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e040039a0 0x7f9e180abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e1deae640 1 -- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e040039a0 msgr2=0x7f9e180abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e1deae640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e040039a0 0x7f9e180abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e1deae640 1 -- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180ad130 msgr2=0x7f9e180ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e1deae640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180ad130 0x7f9e180ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e1deae640 1 -- 172.21.15.29:0/1530935525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e180ad8b0 con 0x7f9e180ae6f0 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e1deae640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e180ae6f0 0x7f9e1813ed30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9e18145d00 tx=0x7f9e1000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e0dffb640 1 -- 172.21.15.29:0/1530935525 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10006d60 con 0x7f9e180ae6f0 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e0dffb640 1 -- 172.21.15.29:0/1530935525 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e10003970 con 0x7f9e180ae6f0 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e0dffb640 1 -- 172.21.15.29:0/1530935525 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10003d20 con 0x7f9e180ae6f0 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e1f911640 1 -- 172.21.15.29:0/1530935525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e180ac580 con 0x7f9e180ae6f0 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.459+0000 7f9e1f911640 1 -- 172.21.15.29:0/1530935525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e180ad5b0 con 0x7f9e180ae6f0 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.460+0000 7f9e1f911640 1 -- 172.21.15.29:0/1530935525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e180702b0 con 0x7f9e180ae6f0 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.460+0000 7f9e0dffb640 1 -- 172.21.15.29:0/1530935525 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9e100050d0 con 0x7f9e180ae6f0 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.461+0000 7f9e0dffb640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9dfc06ac00 0x7f9dfc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.461+0000 7f9e0dffb640 1 -- 172.21.15.29:0/1530935525 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9e10088950 con 0x7f9e180ae6f0 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.461+0000 7f9e1d6ad640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9dfc06ac00 0x7f9dfc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.462+0000 7f9e1d6ad640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9dfc06ac00 0x7f9dfc06d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e14033000 tx=0x7f9e14008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:37.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.465+0000 7f9e0dffb640 1 -- 172.21.15.29:0/1530935525 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9e100538b0 con 0x7f9e180ae6f0 2024-09-13T18:50:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.635+0000 7f9e1f911640 1 -- 172.21.15.29:0/1530935525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e180b5d60 con 0x7f9e180ae6f0 2024-09-13T18:50:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.635+0000 7f9e0dffb640 1 -- 172.21.15.29:0/1530935525 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e10056ed0 con 0x7f9e180ae6f0 2024-09-13T18:50:37.638 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-13T18:50:37.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.637+0000 7f9e1f911640 1 -- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9dfc06ac00 msgr2=0x7f9dfc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.637+0000 7f9e1f911640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9dfc06ac00 0x7f9dfc06d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e14033000 tx=0x7f9e14008030 comp rx=0 tx=0).stop 2024-09-13T18:50:37.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.637+0000 7f9e1f911640 1 -- 172.21.15.29:0/1530935525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e180ae6f0 msgr2=0x7f9e1813ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.637+0000 7f9e1f911640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e180ae6f0 0x7f9e1813ed30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9e18145d00 tx=0x7f9e1000ff70 comp rx=0 tx=0).stop 2024-09-13T18:50:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.637+0000 7f9e1f911640 1 -- 172.21.15.29:0/1530935525 shutdown_connections 2024-09-13T18:50:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.637+0000 7f9e1f911640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f9dfc06ac00 0x7f9dfc06d0c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.637+0000 7f9e1f911640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e180ae6f0 0x7f9e1813ed30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.637+0000 7f9e1f911640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e180ad130 0x7f9e180ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.637+0000 7f9e1f911640 1 --2- 172.21.15.29:0/1530935525 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9e040039a0 0x7f9e180abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.637+0000 7f9e1f911640 1 -- 172.21.15.29:0/1530935525 >> 172.21.15.29:0/1530935525 conn(0x7f9e180b4710 msgr2=0x7f9e18144b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.637+0000 7f9e1f911640 1 -- 172.21.15.29:0/1530935525 shutdown_connections 2024-09-13T18:50:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.637+0000 7f9e1f911640 1 -- 172.21.15.29:0/1530935525 wait complete. 2024-09-13T18:50:37.651 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:50:37.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.753+0000 7f7fc0ded640 1 Processor -- start 2024-09-13T18:50:37.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.753+0000 7f7fc0ded640 1 -- start start 2024-09-13T18:50:37.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.754+0000 7f7fc0ded640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc0b44b0 0x7f7fbc1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.754+0000 7f7fc0ded640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fbc0b3880 con 0x7f7fbc0b5f50 2024-09-13T18:50:37.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.754+0000 7f7fc0ded640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fbc0b4890 con 0x7f7fbc0b3320 2024-09-13T18:50:37.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.754+0000 7f7fc0ded640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0b5580 con 0x7f7fbc0b44b0 2024-09-13T18:50:37.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.754+0000 7f7fb9d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7fbc0b5f50 0x7f7fbc13f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41066/0 (socket says 172.21.15.29:41066) 2024-09-13T18:50:37.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.754+0000 7f7fb9d9b640 1 -- 172.21.15.29:0/4046355787 learned_addr learned my addr 172.21.15.29:0/4046355787 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.754+0000 7f7fba59c640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc0b44b0 0x7f7fbc1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.754+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323025931 0 0) 0x7f7fbc0b3880 con 0x7f7fbc0b5f50 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.754+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fa4003520 con 0x7f7fbc0b5f50 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.754+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092043788 0 0) 0x7f7fbc0b4890 con 0x7f7fbc0b3320 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.754+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fbc0b3880 con 0x7f7fbc0b3320 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.754+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 307347724 0 0) 0x7f7fa4003520 con 0x7f7fbc0b5f50 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc0b44b0 msgr2=0x7f7fbc1462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb959a640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc0b44b0 0x7f7fbc1462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 >> v1:172.21.15.96:6789/0 conn(0x7f7fbc0b3320 legacy=0x7f7fbc1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc0b57f0 con 0x7f7fbc0b5f50 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f7fb0001670 con 0x7f7fbc0b5f50 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 >> v1:172.21.15.29:6789/0 conn(0x7f7fbc0b5f50 legacy=0x7f7fbc13f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb959a640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fa4003b30 0x7f7fa4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb959a640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc0b44b0 0x7f7fa40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb959a640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fa4004d00 0x7f7fa4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa400ba30 con 0x7f7fa4003b30 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa400bb70 con 0x7f7fa4004d00 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa400bce0 con 0x7f7fbc0b44b0 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fba59c640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fa4003b30 0x7f7fa4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fbad9d640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fa4004d00 0x7f7fa4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb9d9b640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc0b44b0 0x7f7fa40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fba59c640 1 -- 172.21.15.29:0/4046355787 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc0b44b0 msgr2=0x7f7fa40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fba59c640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc0b44b0 0x7f7fa40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fba59c640 1 -- 172.21.15.29:0/4046355787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fa4004d00 msgr2=0x7f7fa4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fba59c640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fa4004d00 0x7f7fa4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fba59c640 1 -- 172.21.15.29:0/4046355787 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4003520 con 0x7f7fa4003b30 2024-09-13T18:50:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.755+0000 7f7fb9d9b640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc0b44b0 0x7f7fa40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.756+0000 7f7fba59c640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fa4003b30 0x7f7fa4003f30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009fc0 tx=0x7f7fa40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59991d6a405162ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.756+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac031640 con 0x7f7fa4003b30 2024-09-13T18:50:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.756+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac02d070 con 0x7f7fa4003b30 2024-09-13T18:50:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.756+0000 7f7fb959a640 1 -- 172.21.15.29:0/4046355787 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac0319e0 con 0x7f7fa4003b30 2024-09-13T18:50:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.756+0000 7f7fc0ded640 1 -- 172.21.15.29:0/4046355787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fa4003b30 msgr2=0x7f7fa4003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.756+0000 7f7fc0ded640 1 --2- 172.21.15.29:0/4046355787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fa4003b30 0x7f7fa4003f30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009fc0 tx=0x7f7fa40057f0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.756+0000 7f7fbad9d640 1 -- 172.21.15.29:0/4046355787 reap_dead start 2024-09-13T18:50:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.757+0000 7f7fc0ded640 1 -- 172.21.15.29:0/4046355787 shutdown_connections 2024-09-13T18:50:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.757+0000 7f7fc0ded640 1 -- 172.21.15.29:0/4046355787 >> 172.21.15.29:0/4046355787 conn(0x7f7fbc0b8050 msgr2=0x7f7fbc0b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.757+0000 7f7fc0ded640 1 -- 172.21.15.29:0/4046355787 shutdown_connections 2024-09-13T18:50:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.757+0000 7f7fc0ded640 1 -- 172.21.15.29:0/4046355787 wait complete. 2024-09-13T18:50:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.758+0000 7f7fc0ded640 1 Processor -- start 2024-09-13T18:50:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.758+0000 7f7fc0ded640 1 -- start start 2024-09-13T18:50:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.758+0000 7f7fc0ded640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fa4003b30 0x7f7fbc0bbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.758+0000 7f7fc0ded640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc136bd0 0x7f7fbc1de550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.758+0000 7f7fc0ded640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fbc1347d0 0x7f7fbc134c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.758+0000 7f7fc0ded640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc137030 con 0x7f7fbc1347d0 2024-09-13T18:50:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.758+0000 7f7fc0ded640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc13cda0 con 0x7f7fa4003b30 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.758+0000 7f7fc0ded640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0bb2c0 con 0x7f7fbc136bd0 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fbad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fbc1347d0 0x7f7fbc134c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fbad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fbc1347d0 0x7f7fbc134c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55834/0 (socket says 172.21.15.29:55834) 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fbad9d640 1 -- 172.21.15.29:0/3881334115 learned_addr learned my addr 172.21.15.29:0/3881334115 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fba59c640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fa4003b30 0x7f7fbc0bbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fb9d9b640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc136bd0 0x7f7fbc1de550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fbad9d640 1 -- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc136bd0 msgr2=0x7f7fbc1de550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fbad9d640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc136bd0 0x7f7fbc1de550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fbad9d640 1 -- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fa4003b30 msgr2=0x7f7fbc0bbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fbad9d640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fa4003b30 0x7f7fbc0bbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fbad9d640 1 -- 172.21.15.29:0/3881334115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc13b5b0 con 0x7f7fbc1347d0 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fbad9d640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fbc1347d0 0x7f7fbc134c50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc06b180 tx=0x7f7fb400f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7faaffd640 1 -- 172.21.15.29:0/3881334115 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40050d0 con 0x7f7fbc1347d0 2024-09-13T18:50:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7faaffd640 1 -- 172.21.15.29:0/3881334115 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb4005250 con 0x7f7fbc1347d0 2024-09-13T18:50:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fc0ded640 1 -- 172.21.15.29:0/3881334115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fbc13b890 con 0x7f7fbc1347d0 2024-09-13T18:50:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7faaffd640 1 -- 172.21.15.29:0/3881334115 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4006aa0 con 0x7f7fbc1347d0 2024-09-13T18:50:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.759+0000 7f7fc0ded640 1 -- 172.21.15.29:0/3881334115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fbc0baf90 con 0x7f7fbc1347d0 2024-09-13T18:50:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.760+0000 7f7fc0ded640 1 -- 172.21.15.29:0/3881334115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fbc13fd90 con 0x7f7fbc1347d0 2024-09-13T18:50:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.761+0000 7f7faaffd640 1 -- 172.21.15.29:0/3881334115 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7fb4006c00 con 0x7f7fbc1347d0 2024-09-13T18:50:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.761+0000 7f7faaffd640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7f9c06ac00 0x7f7f9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.761+0000 7f7faaffd640 1 -- 172.21.15.29:0/3881334115 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7fb40887d0 con 0x7f7fbc1347d0 2024-09-13T18:50:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.761+0000 7f7fba59c640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7f9c06ac00 0x7f7f9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.762+0000 7f7fba59c640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7f9c06ac00 0x7f7f9c06d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7fac035000 tx=0x7f7fac02f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:37.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.765+0000 7f7faaffd640 1 -- 172.21.15.29:0/3881334115 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7fb4053690 con 0x7f7fbc1347d0 2024-09-13T18:50:37.924 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:50:37.927 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:50:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.934+0000 7f7fc0ded640 1 -- 172.21.15.29:0/3881334115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7fbc142cf0 con 0x7f7fbc1347d0 2024-09-13T18:50:37.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.935+0000 7f7faaffd640 1 -- 172.21.15.29:0/3881334115 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7fb4056cb0 con 0x7f7fbc1347d0 2024-09-13T18:50:37.937 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-09-13T18:50:37.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.937+0000 7f7fc0ded640 1 -- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7f9c06ac00 msgr2=0x7f7f9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.937+0000 7f7fc0ded640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7f9c06ac00 0x7f7f9c06d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7fac035000 tx=0x7f7fac02f000 comp rx=0 tx=0).stop 2024-09-13T18:50:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.937+0000 7f7fc0ded640 1 -- 172.21.15.29:0/3881334115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fbc1347d0 msgr2=0x7f7fbc134c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.937+0000 7f7fc0ded640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fbc1347d0 0x7f7fbc134c50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc06b180 tx=0x7f7fb400f9f0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.937+0000 7f7fc0ded640 1 -- 172.21.15.29:0/3881334115 shutdown_connections 2024-09-13T18:50:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.937+0000 7f7fc0ded640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f7f9c06ac00 0x7f7f9c06d0c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.937+0000 7f7fc0ded640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fbc1347d0 0x7f7fbc134c50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.937+0000 7f7fc0ded640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7fbc136bd0 0x7f7fbc1de550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.937+0000 7f7fc0ded640 1 --2- 172.21.15.29:0/3881334115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fa4003b30 0x7f7fbc0bbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.937+0000 7f7fc0ded640 1 -- 172.21.15.29:0/3881334115 >> 172.21.15.29:0/3881334115 conn(0x7f7fbc0b8050 msgr2=0x7f7fbc0b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.937+0000 7f7fc0ded640 1 -- 172.21.15.29:0/3881334115 shutdown_connections 2024-09-13T18:50:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:37.937+0000 7f7fc0ded640 1 -- 172.21.15.29:0/3881334115 wait complete. 2024-09-13T18:50:37.950 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:50:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.133+0000 7f58d7b76640 1 Processor -- start 2024-09-13T18:50:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.133+0000 7f58d7b76640 1 -- start start 2024-09-13T18:50:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d7b76640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f58d00b44b0 0x7f58d01462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d7b76640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f58d00b5f50 0x7f58d013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d7b76640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d00b3880 con 0x7f58d00b3320 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d7b76640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d00b5580 con 0x7f58d00b44b0 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d7b76640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00b4890 con 0x7f58d00b5f50 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d5912640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f58d00b44b0 0x7f58d01462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d5912640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f58d00b44b0 0x7f58d01462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55846/0 (socket says 172.21.15.29:55846) 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d5912640 1 -- 172.21.15.29:0/3674171825 learned_addr learned my addr 172.21.15.29:0/3674171825 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d5111640 1 --2- 172.21.15.29:0/3674171825 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f58d00b5f50 0x7f58d013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d5912640 1 -- 172.21.15.29:0/3674171825 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f58d00b5f50 msgr2=0x7f58d013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d5912640 1 --2- 172.21.15.29:0/3674171825 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f58d00b5f50 0x7f58d013f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d5912640 1 -- 172.21.15.29:0/3674171825 >> v1:172.21.15.96:6789/0 conn(0x7f58d00b3320 legacy=0x7f58d013fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d5912640 1 -- 172.21.15.29:0/3674171825 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d00b57f0 con 0x7f58d00b44b0 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.134+0000 7f58d5111640 1 --2- 172.21.15.29:0/3674171825 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f58d00b5f50 0x7f58d013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.135+0000 7f58d5912640 1 --2- 172.21.15.29:0/3674171825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58d00b44b0 0x7f58d01462e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009870 tx=0x7f58cc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e394cf8d6f3ce155 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.135+0000 7f58d4910640 1 -- 172.21.15.29:0/3674171825 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc032440 con 0x7f58d00b44b0 2024-09-13T18:50:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.135+0000 7f58d4910640 1 -- 172.21.15.29:0/3674171825 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc0325a0 con 0x7f58d00b44b0 2024-09-13T18:50:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.135+0000 7f58d4910640 1 -- 172.21.15.29:0/3674171825 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc032930 con 0x7f58d00b44b0 2024-09-13T18:50:38.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.136+0000 7f58d7b76640 1 -- 172.21.15.29:0/3674171825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58d00b44b0 msgr2=0x7f58d01462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:38.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.136+0000 7f58d7b76640 1 --2- 172.21.15.29:0/3674171825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58d00b44b0 0x7f58d01462e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009870 tx=0x7f58cc02a210 comp rx=0 tx=0).stop 2024-09-13T18:50:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.136+0000 7f58d7b76640 1 -- 172.21.15.29:0/3674171825 shutdown_connections 2024-09-13T18:50:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.136+0000 7f58d7b76640 1 --2- 172.21.15.29:0/3674171825 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f58d00b5f50 0x7f58d013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.136+0000 7f58d7b76640 1 --2- 172.21.15.29:0/3674171825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58d00b44b0 0x7f58d01462e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.136+0000 7f58d7b76640 1 -- 172.21.15.29:0/3674171825 >> 172.21.15.29:0/3674171825 conn(0x7f58d00b8050 msgr2=0x7f58d00b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.136+0000 7f58d7b76640 1 -- 172.21.15.29:0/3674171825 shutdown_connections 2024-09-13T18:50:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.136+0000 7f58d7b76640 1 -- 172.21.15.29:0/3674171825 wait complete. 2024-09-13T18:50:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.137+0000 7f58d7b76640 1 Processor -- start 2024-09-13T18:50:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.137+0000 7f58d7b76640 1 -- start start 2024-09-13T18:50:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.137+0000 7f58d7b76640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58d00b3320 0x7f58d013da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.137+0000 7f58d7b76640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d00b44b0 0x7f58d01ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.137+0000 7f58d7b76640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f58d00b5f50 0x7f58d01de780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.137+0000 7f58d7b76640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01cf050 con 0x7f58d00b3320 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.137+0000 7f58d7b76640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01cd150 con 0x7f58d00b44b0 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.137+0000 7f58d7b76640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01cee00 con 0x7f58d00b5f50 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.137+0000 7f58d5912640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58d00b3320 0x7f58d013da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.137+0000 7f58d5912640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58d00b3320 0x7f58d013da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55860/0 (socket says 172.21.15.29:55860) 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.137+0000 7f58d5912640 1 -- 172.21.15.29:0/729717060 learned_addr learned my addr 172.21.15.29:0/729717060 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58d5111640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d00b44b0 0x7f58d01ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58d6113640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f58d00b5f50 0x7f58d01de780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58d5912640 1 -- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f58d00b5f50 msgr2=0x7f58d01de780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58d5912640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f58d00b5f50 0x7f58d01de780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58d5912640 1 -- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d00b44b0 msgr2=0x7f58d01ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58d5912640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d00b44b0 0x7f58d01ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58d5912640 1 -- 172.21.15.29:0/729717060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc0094d0 con 0x7f58d00b3320 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58d5111640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d00b44b0 0x7f58d01ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58d5912640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58d00b3320 0x7f58d013da70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009870 tx=0x7f58cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58c67fc640 1 -- 172.21.15.29:0/729717060 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc030b00 con 0x7f58d00b3320 2024-09-13T18:50:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58c67fc640 1 -- 172.21.15.29:0/729717060 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc030c60 con 0x7f58d00b3320 2024-09-13T18:50:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58d7b76640 1 -- 172.21.15.29:0/729717060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d01cd3a0 con 0x7f58d00b3320 2024-09-13T18:50:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58c67fc640 1 -- 172.21.15.29:0/729717060 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc03b400 con 0x7f58d00b3320 2024-09-13T18:50:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.138+0000 7f58d7b76640 1 -- 172.21.15.29:0/729717060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d01cfd00 con 0x7f58d00b3320 2024-09-13T18:50:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.139+0000 7f58d7b76640 1 -- 172.21.15.29:0/729717060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d01cd8c0 con 0x7f58d00b3320 2024-09-13T18:50:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.140+0000 7f58c67fc640 1 -- 172.21.15.29:0/729717060 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f58cc039040 con 0x7f58d00b3320 2024-09-13T18:50:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.140+0000 7f58c67fc640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f58b406ac00 0x7f58b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.140+0000 7f58c67fc640 1 -- 172.21.15.29:0/729717060 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f58cc0aa040 con 0x7f58d00b3320 2024-09-13T18:50:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.140+0000 7f58d5111640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f58b406ac00 0x7f58b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.141+0000 7f58d5111640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f58b406ac00 0x7f58b406d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f58d013e230 tx=0x7f58c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:38.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.144+0000 7f58c67fc640 1 -- 172.21.15.29:0/729717060 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f58d01cd8c0 con 0x7f58d00b3320 2024-09-13T18:50:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.317+0000 7f58d7b76640 1 -- 172.21.15.29:0/729717060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f58d01462e0 con 0x7f58d00b3320 2024-09-13T18:50:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.317+0000 7f58c67fc640 1 -- 172.21.15.29:0/729717060 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f58cc04c0a0 con 0x7f58d00b3320 2024-09-13T18:50:38.320 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-13T18:50:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.319+0000 7f58d7b76640 1 -- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f58b406ac00 msgr2=0x7f58b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.319+0000 7f58d7b76640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f58b406ac00 0x7f58b406d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f58d013e230 tx=0x7f58c0008040 comp rx=0 tx=0).stop 2024-09-13T18:50:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.319+0000 7f58d7b76640 1 -- 172.21.15.29:0/729717060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58d00b3320 msgr2=0x7f58d013da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.319+0000 7f58d7b76640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58d00b3320 0x7f58d013da70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009870 tx=0x7f58cc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.319+0000 7f58d7b76640 1 -- 172.21.15.29:0/729717060 shutdown_connections 2024-09-13T18:50:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.319+0000 7f58d7b76640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f58b406ac00 0x7f58b406d0c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.319+0000 7f58d7b76640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f58d00b5f50 0x7f58d01de780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.319+0000 7f58d7b76640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58d00b44b0 0x7f58d01ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.319+0000 7f58d7b76640 1 --2- 172.21.15.29:0/729717060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58d00b3320 0x7f58d013da70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.319+0000 7f58d7b76640 1 -- 172.21.15.29:0/729717060 >> 172.21.15.29:0/729717060 conn(0x7f58d00b8050 msgr2=0x7f58d01425d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:38.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.319+0000 7f58d7b76640 1 -- 172.21.15.29:0/729717060 shutdown_connections 2024-09-13T18:50:38.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.319+0000 7f58d7b76640 1 -- 172.21.15.29:0/729717060 wait complete. 2024-09-13T18:50:38.333 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:50:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.433+0000 7faf4322b640 1 Processor -- start 2024-09-13T18:50:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.433+0000 7faf4322b640 1 -- start start 2024-09-13T18:50:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf4322b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf3c0b2120 0x7faf3c098a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf4322b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faf3c0b34d0 0x7faf3c149090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf4322b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c0acc30 con 0x7faf3c1495d0 2024-09-13T18:50:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf4322b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c072570 con 0x7faf3c0b34d0 2024-09-13T18:50:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf4322b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0ac9c0 con 0x7faf3c0b2120 2024-09-13T18:50:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf3bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faf3c0b34d0 0x7faf3c149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf417c8640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7faf3c1495d0 0x7faf3c0ad3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41070/0 (socket says 172.21.15.29:41070) 2024-09-13T18:50:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf3bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faf3c0b34d0 0x7faf3c149090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55870/0 (socket says 172.21.15.29:55870) 2024-09-13T18:50:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf417c8640 1 -- 172.21.15.29:0/3397587175 learned_addr learned my addr 172.21.15.29:0/3397587175 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf40fc7640 1 --2- 172.21.15.29:0/3397587175 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf3c0b2120 0x7faf3c098a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:38.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf3bfff640 1 -- 172.21.15.29:0/3397587175 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf3c0b2120 msgr2=0x7faf3c098a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:38.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf3bfff640 1 --2- 172.21.15.29:0/3397587175 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf3c0b2120 0x7faf3c098a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf3bfff640 1 -- 172.21.15.29:0/3397587175 >> v1:172.21.15.29:6789/0 conn(0x7faf3c1495d0 legacy=0x7faf3c0ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:38.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf3b7fe640 1 -- 172.21.15.29:0/3397587175 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663682772 0 0) 0x7faf3c0acc30 con 0x7faf3c1495d0 2024-09-13T18:50:38.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf3bfff640 1 -- 172.21.15.29:0/3397587175 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0b3910 con 0x7faf3c0b34d0 2024-09-13T18:50:38.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.434+0000 7faf40fc7640 1 --2- 172.21.15.29:0/3397587175 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf3c0b2120 0x7faf3c098a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:38.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.435+0000 7faf3bfff640 1 --2- 172.21.15.29:0/3397587175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf3c0b34d0 0x7faf3c149090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0726b0 tx=0x7faf2802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff65c074e4e958ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:38.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.435+0000 7faf3b7fe640 1 -- 172.21.15.29:0/3397587175 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2802ae50 con 0x7faf3c0b34d0 2024-09-13T18:50:38.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.435+0000 7faf3b7fe640 1 -- 172.21.15.29:0/3397587175 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf28032440 con 0x7faf3c0b34d0 2024-09-13T18:50:38.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.435+0000 7faf3b7fe640 1 -- 172.21.15.29:0/3397587175 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280327d0 con 0x7faf3c0b34d0 2024-09-13T18:50:38.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.436+0000 7faf4322b640 1 -- 172.21.15.29:0/3397587175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf3c0b34d0 msgr2=0x7faf3c149090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:38.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.436+0000 7faf4322b640 1 --2- 172.21.15.29:0/3397587175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf3c0b34d0 0x7faf3c149090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0726b0 tx=0x7faf2802a100 comp rx=0 tx=0).stop 2024-09-13T18:50:38.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.436+0000 7faf4322b640 1 -- 172.21.15.29:0/3397587175 shutdown_connections 2024-09-13T18:50:38.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.436+0000 7faf4322b640 1 --2- 172.21.15.29:0/3397587175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf3c0b34d0 0x7faf3c149090 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.436+0000 7faf4322b640 1 --2- 172.21.15.29:0/3397587175 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf3c0b2120 0x7faf3c098a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.436+0000 7faf4322b640 1 -- 172.21.15.29:0/3397587175 >> 172.21.15.29:0/3397587175 conn(0x7faf3c0b3fb0 msgr2=0x7faf3c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.436+0000 7faf4322b640 1 -- 172.21.15.29:0/3397587175 shutdown_connections 2024-09-13T18:50:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.436+0000 7faf4322b640 1 -- 172.21.15.29:0/3397587175 wait complete. 2024-09-13T18:50:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.437+0000 7faf4322b640 1 Processor -- start 2024-09-13T18:50:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.437+0000 7faf4322b640 1 -- start start 2024-09-13T18:50:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.437+0000 7faf4322b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf3c0b2120 0x7faf3c0b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:38.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.437+0000 7faf4322b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf3c0b34d0 0x7faf3c0b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:38.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.437+0000 7faf4322b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf3c1495d0 0x7faf3c13b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:38.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.437+0000 7faf4322b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0b59a0 con 0x7faf3c0b34d0 2024-09-13T18:50:38.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.437+0000 7faf4322b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c13d3c0 con 0x7faf3c0b2120 2024-09-13T18:50:38.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.437+0000 7faf4322b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c13d630 con 0x7faf3c1495d0 2024-09-13T18:50:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf3bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf3c0b34d0 0x7faf3c0b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf3bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf3c0b34d0 0x7faf3c0b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55878/0 (socket says 172.21.15.29:55878) 2024-09-13T18:50:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf3bfff640 1 -- 172.21.15.29:0/3163486583 learned_addr learned my addr 172.21.15.29:0/3163486583 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf40fc7640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf3c0b2120 0x7faf3c0b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf417c8640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf3c1495d0 0x7faf3c13b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf3bfff640 1 -- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf3c1495d0 msgr2=0x7faf3c13b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:38.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf3bfff640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf3c1495d0 0x7faf3c13b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf3bfff640 1 -- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf3c0b2120 msgr2=0x7faf3c0b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:38.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf3bfff640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf3c0b2120 0x7faf3c0b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf3bfff640 1 -- 172.21.15.29:0/3163486583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf28009400 con 0x7faf3c0b34d0 2024-09-13T18:50:38.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf40fc7640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf3c0b2120 0x7faf3c0b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf3bfff640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf3c0b34d0 0x7faf3c0b6370 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faf28009890 tx=0x7faf280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf397fa640 1 -- 172.21.15.29:0/3163486583 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2803d910 con 0x7faf3c0b34d0 2024-09-13T18:50:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf397fa640 1 -- 172.21.15.29:0/3163486583 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2803da90 con 0x7faf3c0b34d0 2024-09-13T18:50:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf4322b640 1 -- 172.21.15.29:0/3163486583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c0b5350 con 0x7faf3c0b34d0 2024-09-13T18:50:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf397fa640 1 -- 172.21.15.29:0/3163486583 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2803de40 con 0x7faf3c0b34d0 2024-09-13T18:50:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.438+0000 7faf4322b640 1 -- 172.21.15.29:0/3163486583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c13bb60 con 0x7faf3c0b34d0 2024-09-13T18:50:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.439+0000 7faf4322b640 1 -- 172.21.15.29:0/3163486583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c0b5b50 con 0x7faf3c0b34d0 2024-09-13T18:50:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.440+0000 7faf397fa640 1 -- 172.21.15.29:0/3163486583 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faf28039040 con 0x7faf3c0b34d0 2024-09-13T18:50:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.440+0000 7faf397fa640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7faf2006ac30 0x7faf2006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.440+0000 7faf397fa640 1 -- 172.21.15.29:0/3163486583 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf280a9f90 con 0x7faf3c0b34d0 2024-09-13T18:50:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.440+0000 7faf40fc7640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7faf2006ac30 0x7faf2006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:38.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.441+0000 7faf40fc7640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7faf2006ac30 0x7faf2006d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faf30006fd0 tx=0x7faf30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:38.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.444+0000 7faf397fa640 1 -- 172.21.15.29:0/3163486583 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faf280dd9c0 con 0x7faf3c0b34d0 2024-09-13T18:50:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.626+0000 7faf4322b640 1 -- 172.21.15.29:0/3163486583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faf3c09d800 con 0x7faf3c0b34d0 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.626+0000 7faf397fa640 1 -- 172.21.15.29:0/3163486583 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7faf28074e40 con 0x7faf3c0b34d0 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.628+0000 7faf4322b640 1 -- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7faf2006ac30 msgr2=0x7faf2006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.628+0000 7faf4322b640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7faf2006ac30 0x7faf2006d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faf30006fd0 tx=0x7faf30008040 comp rx=0 tx=0).stop 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.628+0000 7faf4322b640 1 -- 172.21.15.29:0/3163486583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf3c0b34d0 msgr2=0x7faf3c0b6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.628+0000 7faf4322b640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf3c0b34d0 0x7faf3c0b6370 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faf28009890 tx=0x7faf280046c0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.628+0000 7faf4322b640 1 -- 172.21.15.29:0/3163486583 shutdown_connections 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.628+0000 7faf4322b640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7faf2006ac30 0x7faf2006d0f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.628+0000 7faf4322b640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf3c1495d0 0x7faf3c13b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.628+0000 7faf4322b640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf3c0b34d0 0x7faf3c0b6370 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.628+0000 7faf4322b640 1 --2- 172.21.15.29:0/3163486583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf3c0b2120 0x7faf3c0b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.628+0000 7faf4322b640 1 -- 172.21.15.29:0/3163486583 >> 172.21.15.29:0/3163486583 conn(0x7faf3c0b3fb0 msgr2=0x7faf3c099860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.628+0000 7faf4322b640 1 -- 172.21.15.29:0/3163486583 shutdown_connections 2024-09-13T18:50:38.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:38.628+0000 7faf4322b640 1 -- 172.21.15.29:0/3163486583 wait complete. 2024-09-13T18:50:38.642 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-09-13T18:50:38.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:38.643 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:50:38.676 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[45126]: fuse finished with error 0 and tester_r 0 2024-09-13T18:50:38.678 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:50:38.747 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:50:38.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:38.747 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:50:38.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:38.773 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-09-13T18:50:38.882 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:50:38.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:38.882 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:50:38.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:38.909 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-09-13T18:50:39.014 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T18:50:39.023 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:50:39.023 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:50:39.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.126+0000 7fbc0e412640 1 Processor -- start 2024-09-13T18:50:39.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.126+0000 7fbc0e412640 1 -- start start 2024-09-13T18:50:39.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc0e412640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbc0806b150 0x7fbc080712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc0e412640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbc080717e0 0x7fbc0813f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc0e412640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc08070b30 con 0x7fbc080aeb00 2024-09-13T18:50:39.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc0e412640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc080b4160 con 0x7fbc0806b150 2024-09-13T18:50:39.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc0e412640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0806f780 con 0x7fbc080717e0 2024-09-13T18:50:39.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc07fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbc0806b150 0x7fbc080712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc0c9af640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbc080aeb00 0x7fbc08148ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41080/0 (socket says 172.21.15.29:41080) 2024-09-13T18:50:39.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc0c9af640 1 -- 172.21.15.29:0/3973965898 learned_addr learned my addr 172.21.15.29:0/3973965898 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:39.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc077fe640 1 --2- 172.21.15.29:0/3973965898 >> v2:172.21.15.96:3300/0 conn(0x7fbc080717e0 0x7fbc0813f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc07fff640 1 -- 172.21.15.29:0/3973965898 >> v2:172.21.15.96:3300/0 conn(0x7fbc080717e0 msgr2=0x7fbc0813f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:39.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc07fff640 1 --2- 172.21.15.29:0/3973965898 >> v2:172.21.15.96:3300/0 conn(0x7fbc080717e0 0x7fbc0813f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc07fff640 1 -- 172.21.15.29:0/3973965898 >> v1:172.21.15.29:6789/0 conn(0x7fbc080aeb00 legacy=0x7fbc08148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.127+0000 7fbc07fff640 1 -- 172.21.15.29:0/3973965898 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc080b4440 con 0x7fbc0806b150 2024-09-13T18:50:39.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.128+0000 7fbc07fff640 1 --2- 172.21.15.29:0/3973965898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc0806b150 0x7fbc080712a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80097a0 tx=0x7fbbf802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c68838e31895814 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.128+0000 7fbc06ffd640 1 -- 172.21.15.29:0/3973965898 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf802adc0 con 0x7fbc0806b150 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.128+0000 7fbc06ffd640 1 -- 172.21.15.29:0/3973965898 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf8032440 con 0x7fbc0806b150 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.128+0000 7fbc06ffd640 1 -- 172.21.15.29:0/3973965898 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf80327d0 con 0x7fbc0806b150 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.129+0000 7fbc0e412640 1 -- 172.21.15.29:0/3973965898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc0806b150 msgr2=0x7fbc080712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.129+0000 7fbc0e412640 1 --2- 172.21.15.29:0/3973965898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc0806b150 0x7fbc080712a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80097a0 tx=0x7fbbf802a0b0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.129+0000 7fbc0e412640 1 -- 172.21.15.29:0/3973965898 shutdown_connections 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.129+0000 7fbc0e412640 1 --2- 172.21.15.29:0/3973965898 >> v2:172.21.15.96:3300/0 conn(0x7fbc080717e0 0x7fbc0813f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.129+0000 7fbc0e412640 1 --2- 172.21.15.29:0/3973965898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc0806b150 0x7fbc080712a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.129+0000 7fbc0e412640 1 -- 172.21.15.29:0/3973965898 >> 172.21.15.29:0/3973965898 conn(0x7fbc080b4780 msgr2=0x7fbc080b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.129+0000 7fbc0e412640 1 -- 172.21.15.29:0/3973965898 shutdown_connections 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.129+0000 7fbc0e412640 1 -- 172.21.15.29:0/3973965898 wait complete. 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.130+0000 7fbc0e412640 1 Processor -- start 2024-09-13T18:50:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.130+0000 7fbc0e412640 1 -- start start 2024-09-13T18:50:39.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.130+0000 7fbc0e412640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc0806b150 0x7fbc08140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0e412640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc080717e0 0x7fbc080b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0e412640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc080aeb00 0x7fbc081dea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0e412640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc081402a0 con 0x7fbc080aeb00 2024-09-13T18:50:39.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0e412640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc081418d0 con 0x7fbc080717e0 2024-09-13T18:50:39.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0e412640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08141bb0 con 0x7fbc0806b150 2024-09-13T18:50:39.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0c9af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc080aeb00 0x7fbc081dea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0c9af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc080aeb00 0x7fbc081dea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55894/0 (socket says 172.21.15.29:55894) 2024-09-13T18:50:39.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0c9af640 1 -- 172.21.15.29:0/2549472503 learned_addr learned my addr 172.21.15.29:0/2549472503 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:39.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc077fe640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc080717e0 0x7fbc080b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc07fff640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc0806b150 0x7fbc08140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0c9af640 1 -- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc0806b150 msgr2=0x7fbc08140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0c9af640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc0806b150 0x7fbc08140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0c9af640 1 -- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc080717e0 msgr2=0x7fbc080b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0c9af640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc080717e0 0x7fbc080b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0c9af640 1 -- 172.21.15.29:0/2549472503 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8009400 con 0x7fbc080aeb00 2024-09-13T18:50:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0c9af640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc080aeb00 0x7fbc081dea80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000ca80 tx=0x7fbc0000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc04ff9640 1 -- 172.21.15.29:0/2549472503 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000ac30 con 0x7fbc080aeb00 2024-09-13T18:50:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc04ff9640 1 -- 172.21.15.29:0/2549472503 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0000ad90 con 0x7fbc080aeb00 2024-09-13T18:50:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0e412640 1 -- 172.21.15.29:0/2549472503 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0806fe20 con 0x7fbc080aeb00 2024-09-13T18:50:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc04ff9640 1 -- 172.21.15.29:0/2549472503 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00012600 con 0x7fbc080aeb00 2024-09-13T18:50:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.131+0000 7fbc0e412640 1 -- 172.21.15.29:0/2549472503 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc08149b00 con 0x7fbc080aeb00 2024-09-13T18:50:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.132+0000 7fbc0e412640 1 -- 172.21.15.29:0/2549472503 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc08067300 con 0x7fbc080aeb00 2024-09-13T18:50:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.133+0000 7fbc04ff9640 1 -- 172.21.15.29:0/2549472503 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc00007070 con 0x7fbc080aeb00 2024-09-13T18:50:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.134+0000 7fbc04ff9640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbbf406ac00 0x7fbbf406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.134+0000 7fbc04ff9640 1 -- 172.21.15.29:0/2549472503 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbc00089420 con 0x7fbc080aeb00 2024-09-13T18:50:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.134+0000 7fbc07fff640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbbf406ac00 0x7fbbf406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.135+0000 7fbc07fff640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbbf406ac00 0x7fbbf406d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8034000 tx=0x7fbbf802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:39.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.138+0000 7fbc04ff9640 1 -- 172.21.15.29:0/2549472503 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbc00054380 con 0x7fbc080aeb00 2024-09-13T18:50:39.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.308+0000 7fbc0e412640 1 -- 172.21.15.29:0/2549472503 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc0806fca0 con 0x7fbbf406ac00 2024-09-13T18:50:39.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.319+0000 7fbc04ff9640 1 -- 172.21.15.29:0/2549472503 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370430 (secure 0 0 0) 0x7fbbf8032630 con 0x7fbbf406ac00 2024-09-13T18:50:39.326 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:50:39.328 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-13T18:50:39.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.322+0000 7fbc0e412640 1 -- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbbf406ac00 msgr2=0x7fbbf406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.322+0000 7fbc0e412640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbbf406ac00 0x7fbbf406d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8034000 tx=0x7fbbf802e000 comp rx=0 tx=0).stop 2024-09-13T18:50:39.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.322+0000 7fbc0e412640 1 -- 172.21.15.29:0/2549472503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc080aeb00 msgr2=0x7fbc081dea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.322+0000 7fbc0e412640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc080aeb00 0x7fbc081dea80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000ca80 tx=0x7fbc0000cf40 comp rx=0 tx=0).stop 2024-09-13T18:50:39.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.322+0000 7fbc0e412640 1 -- 172.21.15.29:0/2549472503 shutdown_connections 2024-09-13T18:50:39.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.322+0000 7fbc0e412640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fbbf406ac00 0x7fbbf406d0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.322+0000 7fbc0e412640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc080aeb00 0x7fbc081dea80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.322+0000 7fbc0e412640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc080717e0 0x7fbc080b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.322+0000 7fbc0e412640 1 --2- 172.21.15.29:0/2549472503 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc0806b150 0x7fbc08140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.322+0000 7fbc0e412640 1 -- 172.21.15.29:0/2549472503 >> 172.21.15.29:0/2549472503 conn(0x7fbc080b4780 msgr2=0x7fbc08145960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:39.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.322+0000 7fbc0e412640 1 -- 172.21.15.29:0/2549472503 shutdown_connections 2024-09-13T18:50:39.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.322+0000 7fbc0e412640 1 -- 172.21.15.29:0/2549472503 wait complete. 2024-09-13T18:50:39.336 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-13T18:50:37.670108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1541942,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":155,"num_read_kb":139,"num_write":430,"num_write_kb":3494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":454,"ondisk_log_size":454,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235612,"kb_used_data":3100,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739108,"statfs":{"total":773094113280,"available":772852846592,"internally_reserved":0,"allocated":3174400,"data_stored":3985440,"data_compressed":310028,"data_compressed_allocated":385024,"data_compressed_original":2588672,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28651,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":17,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003077"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.613132+0000","last_change":"2024-09-13T18:45:21.668274+0000","last_active":"2024-09-13T18:47:26.613132+0000","last_peered":"2024-09-13T18:47:26.613132+0000","last_clean":"2024-09-13T18:47:26.613132+0000","last_became_active":"2024-09-13T18:45:21.667985+0000","last_became_peered":"2024-09-13T18:45:21.667985+0000","last_unstale":"2024-09-13T18:47:26.613132+0000","last_undegraded":"2024-09-13T18:47:26.613132+0000","last_fullsized":"2024-09-13T18:47:26.613132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:45.703424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.614178+0000","last_change":"2024-09-13T18:45:22.034389+0000","last_active":"2024-09-13T18:47:26.614178+0000","last_peered":"2024-09-13T18:47:26.614178+0000","last_clean":"2024-09-13T18:47:26.614178+0000","last_became_active":"2024-09-13T18:45:22.034125+0000","last_became_peered":"2024-09-13T18:45:22.034125+0000","last_unstale":"2024-09-13T18:47:26.614178+0000","last_undegraded":"2024-09-13T18:47:26.614178+0000","last_fullsized":"2024-09-13T18:47:26.614178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617386+0000","last_change":"2024-09-13T18:45:26.253118+0000","last_active":"2024-09-13T18:47:51.617386+0000","last_peered":"2024-09-13T18:47:51.617386+0000","last_clean":"2024-09-13T18:47:51.617386+0000","last_became_active":"2024-09-13T18:45:26.252747+0000","last_became_peered":"2024-09-13T18:45:26.252747+0000","last_unstale":"2024-09-13T18:47:51.617386+0000","last_undegraded":"2024-09-13T18:47:51.617386+0000","last_fullsized":"2024-09-13T18:47:51.617386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:11.065130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.089694+0000","last_change":"2024-09-13T18:45:21.666664+0000","last_active":"2024-09-13T18:47:47.089694+0000","last_peered":"2024-09-13T18:47:47.089694+0000","last_clean":"2024-09-13T18:47:47.089694+0000","last_became_active":"2024-09-13T18:45:21.666398+0000","last_became_peered":"2024-09-13T18:45:21.666398+0000","last_unstale":"2024-09-13T18:47:47.089694+0000","last_undegraded":"2024-09-13T18:47:47.089694+0000","last_fullsized":"2024-09-13T18:47:47.089694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:06.210838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.613875+0000","last_change":"2024-09-13T18:45:22.024774+0000","last_active":"2024-09-13T18:47:31.613875+0000","last_peered":"2024-09-13T18:47:31.613875+0000","last_clean":"2024-09-13T18:47:31.613875+0000","last_became_active":"2024-09-13T18:45:22.024424+0000","last_became_peered":"2024-09-13T18:45:22.024424+0000","last_unstale":"2024-09-13T18:47:31.613875+0000","last_undegraded":"2024-09-13T18:47:31.613875+0000","last_fullsized":"2024-09-13T18:47:31.613875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616742+0000","last_change":"2024-09-13T18:45:26.050411+0000","last_active":"2024-09-13T18:47:51.616742+0000","last_peered":"2024-09-13T18:47:51.616742+0000","last_clean":"2024-09-13T18:47:51.616742+0000","last_became_active":"2024-09-13T18:45:26.049414+0000","last_became_peered":"2024-09-13T18:45:26.049414+0000","last_unstale":"2024-09-13T18:47:51.616742+0000","last_undegraded":"2024-09-13T18:47:51.616742+0000","last_fullsized":"2024-09-13T18:47:51.616742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616880+0000","last_change":"2024-09-13T18:45:21.667928+0000","last_active":"2024-09-13T18:47:51.616880+0000","last_peered":"2024-09-13T18:47:51.616880+0000","last_clean":"2024-09-13T18:47:51.616880+0000","last_became_active":"2024-09-13T18:45:21.667602+0000","last_became_peered":"2024-09-13T18:45:21.667602+0000","last_unstale":"2024-09-13T18:47:51.616880+0000","last_undegraded":"2024-09-13T18:47:51.616880+0000","last_fullsized":"2024-09-13T18:47:51.616880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:53.936326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617756+0000","last_change":"2024-09-13T18:45:22.036952+0000","last_active":"2024-09-13T18:47:56.617756+0000","last_peered":"2024-09-13T18:47:56.617756+0000","last_clean":"2024-09-13T18:47:56.617756+0000","last_became_active":"2024-09-13T18:45:22.035790+0000","last_became_peered":"2024-09-13T18:45:22.035790+0000","last_unstale":"2024-09-13T18:47:56.617756+0000","last_undegraded":"2024-09-13T18:47:56.617756+0000","last_fullsized":"2024-09-13T18:47:56.617756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617541+0000","last_change":"2024-09-13T18:45:26.052333+0000","last_active":"2024-09-13T18:47:56.617541+0000","last_peered":"2024-09-13T18:47:56.617541+0000","last_clean":"2024-09-13T18:47:56.617541+0000","last_became_active":"2024-09-13T18:45:26.051873+0000","last_became_peered":"2024-09-13T18:45:26.051873+0000","last_unstale":"2024-09-13T18:47:56.617541+0000","last_undegraded":"2024-09-13T18:47:56.617541+0000","last_fullsized":"2024-09-13T18:47:56.617541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:03.925946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:37.145855+0000","last_change":"2024-09-13T18:45:21.669914+0000","last_active":"2024-09-13T18:49:37.145855+0000","last_peered":"2024-09-13T18:49:37.145855+0000","last_clean":"2024-09-13T18:49:37.145855+0000","last_became_active":"2024-09-13T18:45:21.669622+0000","last_became_peered":"2024-09-13T18:45:21.669622+0000","last_unstale":"2024-09-13T18:49:37.145855+0000","last_undegraded":"2024-09-13T18:49:37.145855+0000","last_fullsized":"2024-09-13T18:49:37.145855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.765670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617780+0000","last_change":"2024-09-13T18:45:22.035675+0000","last_active":"2024-09-13T18:47:56.617780+0000","last_peered":"2024-09-13T18:47:56.617780+0000","last_clean":"2024-09-13T18:47:56.617780+0000","last_became_active":"2024-09-13T18:45:22.034431+0000","last_became_peered":"2024-09-13T18:45:22.034431+0000","last_unstale":"2024-09-13T18:47:56.617780+0000","last_undegraded":"2024-09-13T18:47:56.617780+0000","last_fullsized":"2024-09-13T18:47:56.617780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617499+0000","last_change":"2024-09-13T18:45:26.052892+0000","last_active":"2024-09-13T18:47:56.617499+0000","last_peered":"2024-09-13T18:47:56.617499+0000","last_clean":"2024-09-13T18:47:56.617499+0000","last_became_active":"2024-09-13T18:45:26.052441+0000","last_became_peered":"2024-09-13T18:45:26.052441+0000","last_unstale":"2024-09-13T18:47:56.617499+0000","last_undegraded":"2024-09-13T18:47:56.617499+0000","last_fullsized":"2024-09-13T18:47:56.617499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:26.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.616424+0000","last_change":"2024-09-13T18:45:22.017741+0000","last_active":"2024-09-13T18:47:36.616424+0000","last_peered":"2024-09-13T18:47:36.616424+0000","last_clean":"2024-09-13T18:47:36.616424+0000","last_became_active":"2024-09-13T18:45:22.015758+0000","last_became_peered":"2024-09-13T18:45:22.015758+0000","last_unstale":"2024-09-13T18:47:36.616424+0000","last_undegraded":"2024-09-13T18:47:36.616424+0000","last_fullsized":"2024-09-13T18:47:36.616424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.103891+0000","last_change":"2024-09-13T18:45:21.672627+0000","last_active":"2024-09-13T18:48:12.103891+0000","last_peered":"2024-09-13T18:48:12.103891+0000","last_clean":"2024-09-13T18:48:12.103891+0000","last_became_active":"2024-09-13T18:45:21.672388+0000","last_became_peered":"2024-09-13T18:45:21.672388+0000","last_unstale":"2024-09-13T18:48:12.103891+0000","last_undegraded":"2024-09-13T18:48:12.103891+0000","last_fullsized":"2024-09-13T18:48:12.103891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615702+0000","last_change":"2024-09-13T18:46:11.150163+0000","last_active":"2024-09-13T18:47:41.615702+0000","last_peered":"2024-09-13T18:47:41.615702+0000","last_clean":"2024-09-13T18:47:41.615702+0000","last_became_active":"2024-09-13T18:46:11.149623+0000","last_became_peered":"2024-09-13T18:46:11.149623+0000","last_unstale":"2024-09-13T18:47:41.615702+0000","last_undegraded":"2024-09-13T18:47:41.615702+0000","last_fullsized":"2024-09-13T18:47:41.615702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:18.721386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.616049+0000","last_change":"2024-09-13T18:45:22.028858+0000","last_active":"2024-09-13T18:47:41.616049+0000","last_peered":"2024-09-13T18:47:41.616049+0000","last_clean":"2024-09-13T18:47:41.616049+0000","last_became_active":"2024-09-13T18:45:22.028336+0000","last_became_peered":"2024-09-13T18:45:22.028336+0000","last_unstale":"2024-09-13T18:47:41.616049+0000","last_undegraded":"2024-09-13T18:47:41.616049+0000","last_fullsized":"2024-09-13T18:47:41.616049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.618669+0000","last_change":"2024-09-13T18:45:21.667983+0000","last_active":"2024-09-13T18:47:31.618669+0000","last_peered":"2024-09-13T18:47:31.618669+0000","last_clean":"2024-09-13T18:47:31.618669+0000","last_became_active":"2024-09-13T18:45:21.667625+0000","last_became_peered":"2024-09-13T18:45:21.667625+0000","last_unstale":"2024-09-13T18:47:31.618669+0000","last_undegraded":"2024-09-13T18:47:31.618669+0000","last_fullsized":"2024-09-13T18:47:31.618669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615662+0000","last_change":"2024-09-13T18:45:26.050576+0000","last_active":"2024-09-13T18:47:41.615662+0000","last_peered":"2024-09-13T18:47:41.615662+0000","last_clean":"2024-09-13T18:47:41.615662+0000","last_became_active":"2024-09-13T18:45:26.049129+0000","last_became_peered":"2024-09-13T18:45:26.049129+0000","last_unstale":"2024-09-13T18:47:41.615662+0000","last_undegraded":"2024-09-13T18:47:41.615662+0000","last_fullsized":"2024-09-13T18:47:41.615662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:21.620581+0000","last_change":"2024-09-13T18:46:11.149400+0000","last_active":"2024-09-13T18:48:21.620581+0000","last_peered":"2024-09-13T18:48:21.620581+0000","last_clean":"2024-09-13T18:48:21.620581+0000","last_became_active":"2024-09-13T18:46:11.149036+0000","last_became_peered":"2024-09-13T18:46:11.149036+0000","last_unstale":"2024-09-13T18:48:21.620581+0000","last_undegraded":"2024-09-13T18:48:21.620581+0000","last_fullsized":"2024-09-13T18:48:21.620581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:06.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.104292+0000","last_change":"2024-09-13T18:45:21.668525+0000","last_active":"2024-09-13T18:48:12.104292+0000","last_peered":"2024-09-13T18:48:12.104292+0000","last_clean":"2024-09-13T18:48:12.104292+0000","last_became_active":"2024-09-13T18:45:21.668242+0000","last_became_peered":"2024-09-13T18:45:21.668242+0000","last_unstale":"2024-09-13T18:48:12.104292+0000","last_undegraded":"2024-09-13T18:48:12.104292+0000","last_fullsized":"2024-09-13T18:48:12.104292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.620048+0000","last_change":"2024-09-13T18:45:26.255263+0000","last_active":"2024-09-13T18:47:41.620048+0000","last_peered":"2024-09-13T18:47:41.620048+0000","last_clean":"2024-09-13T18:47:41.620048+0000","last_became_active":"2024-09-13T18:45:26.254886+0000","last_became_peered":"2024-09-13T18:45:26.254886+0000","last_unstale":"2024-09-13T18:47:41.620048+0000","last_undegraded":"2024-09-13T18:47:41.620048+0000","last_fullsized":"2024-09-13T18:47:41.620048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614954+0000","last_change":"2024-09-13T18:45:22.029624+0000","last_active":"2024-09-13T18:47:36.614954+0000","last_peered":"2024-09-13T18:47:36.614954+0000","last_clean":"2024-09-13T18:47:36.614954+0000","last_became_active":"2024-09-13T18:45:22.027835+0000","last_became_peered":"2024-09-13T18:45:22.027835+0000","last_unstale":"2024-09-13T18:47:36.614954+0000","last_undegraded":"2024-09-13T18:47:36.614954+0000","last_fullsized":"2024-09-13T18:47:36.614954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:16.317986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.107659+0000","last_change":"2024-09-13T18:45:21.669073+0000","last_active":"2024-09-13T18:48:17.107659+0000","last_peered":"2024-09-13T18:48:17.107659+0000","last_clean":"2024-09-13T18:48:17.107659+0000","last_became_active":"2024-09-13T18:45:21.668765+0000","last_became_peered":"2024-09-13T18:45:21.668765+0000","last_unstale":"2024-09-13T18:48:17.107659+0000","last_undegraded":"2024-09-13T18:48:17.107659+0000","last_fullsized":"2024-09-13T18:48:17.107659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615720+0000","last_change":"2024-09-13T18:45:26.050623+0000","last_active":"2024-09-13T18:47:41.615720+0000","last_peered":"2024-09-13T18:47:41.615720+0000","last_clean":"2024-09-13T18:47:41.615720+0000","last_became_active":"2024-09-13T18:45:26.049408+0000","last_became_peered":"2024-09-13T18:45:26.049408+0000","last_unstale":"2024-09-13T18:47:41.615720+0000","last_undegraded":"2024-09-13T18:47:41.615720+0000","last_fullsized":"2024-09-13T18:47:41.615720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:14.574386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614490+0000","last_change":"2024-09-13T18:45:22.022220+0000","last_active":"2024-09-13T18:47:36.614490+0000","last_peered":"2024-09-13T18:47:36.614490+0000","last_clean":"2024-09-13T18:47:36.614490+0000","last_became_active":"2024-09-13T18:45:22.021976+0000","last_became_peered":"2024-09-13T18:45:22.021976+0000","last_unstale":"2024-09-13T18:47:36.614490+0000","last_undegraded":"2024-09-13T18:47:36.614490+0000","last_fullsized":"2024-09-13T18:47:36.614490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:32.113775+0000","last_change":"2024-09-13T18:45:21.667931+0000","last_active":"2024-09-13T18:48:32.113775+0000","last_peered":"2024-09-13T18:48:32.113775+0000","last_clean":"2024-09-13T18:48:32.113775+0000","last_became_active":"2024-09-13T18:45:21.667680+0000","last_became_peered":"2024-09-13T18:45:21.667680+0000","last_unstale":"2024-09-13T18:48:32.113775+0000","last_undegraded":"2024-09-13T18:48:32.113775+0000","last_fullsized":"2024-09-13T18:48:32.113775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614135+0000","last_change":"2024-09-13T18:45:26.255088+0000","last_active":"2024-09-13T18:47:31.614135+0000","last_peered":"2024-09-13T18:47:31.614135+0000","last_clean":"2024-09-13T18:47:31.614135+0000","last_became_active":"2024-09-13T18:45:26.254662+0000","last_became_peered":"2024-09-13T18:45:26.254662+0000","last_unstale":"2024-09-13T18:47:31.614135+0000","last_undegraded":"2024-09-13T18:47:31.614135+0000","last_fullsized":"2024-09-13T18:47:31.614135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615555+0000","last_change":"2024-09-13T18:45:22.026678+0000","last_active":"2024-09-13T18:47:36.615555+0000","last_peered":"2024-09-13T18:47:36.615555+0000","last_clean":"2024-09-13T18:47:36.615555+0000","last_became_active":"2024-09-13T18:45:22.026419+0000","last_became_peered":"2024-09-13T18:45:22.026419+0000","last_unstale":"2024-09-13T18:47:36.615555+0000","last_undegraded":"2024-09-13T18:47:36.615555+0000","last_fullsized":"2024-09-13T18:47:36.615555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'36","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:35.985799+0000","last_change":"2024-09-13T18:45:21.664622+0000","last_active":"2024-09-13T18:50:35.985799+0000","last_peered":"2024-09-13T18:50:35.985799+0000","last_clean":"2024-09-13T18:50:35.985799+0000","last_became_active":"2024-09-13T18:45:21.664066+0000","last_became_peered":"2024-09-13T18:45:21.664066+0000","last_unstale":"2024-09-13T18:50:35.985799+0000","last_undegraded":"2024-09-13T18:50:35.985799+0000","last_fullsized":"2024-09-13T18:50:35.985799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.614068+0000","last_change":"2024-09-13T18:45:26.253888+0000","last_active":"2024-09-13T18:47:26.614068+0000","last_peered":"2024-09-13T18:47:26.614068+0000","last_clean":"2024-09-13T18:47:26.614068+0000","last_became_active":"2024-09-13T18:45:26.253488+0000","last_became_peered":"2024-09-13T18:45:26.253488+0000","last_unstale":"2024-09-13T18:47:26.614068+0000","last_undegraded":"2024-09-13T18:47:26.614068+0000","last_fullsized":"2024-09-13T18:47:26.614068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:44.826493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:36.633429+0000","last_change":"2024-09-13T18:45:22.022940+0000","last_active":"2024-09-13T18:49:36.633429+0000","last_peered":"2024-09-13T18:49:36.633429+0000","last_clean":"2024-09-13T18:49:36.633429+0000","last_became_active":"2024-09-13T18:45:22.022628+0000","last_became_peered":"2024-09-13T18:45:22.022628+0000","last_unstale":"2024-09-13T18:49:36.633429+0000","last_undegraded":"2024-09-13T18:49:36.633429+0000","last_fullsized":"2024-09-13T18:49:36.633429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.085981+0000","last_change":"2024-09-13T18:45:21.668903+0000","last_active":"2024-09-13T18:47:42.085981+0000","last_peered":"2024-09-13T18:47:42.085981+0000","last_clean":"2024-09-13T18:47:42.085981+0000","last_became_active":"2024-09-13T18:45:21.668645+0000","last_became_peered":"2024-09-13T18:45:21.668645+0000","last_unstale":"2024-09-13T18:47:42.085981+0000","last_undegraded":"2024-09-13T18:47:42.085981+0000","last_fullsized":"2024-09-13T18:47:42.085981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:33.143804+0000","last_change":"2024-09-13T18:46:11.658745+0000","last_active":"2024-09-13T18:49:33.143804+0000","last_peered":"2024-09-13T18:49:33.143804+0000","last_clean":"2024-09-13T18:49:33.143804+0000","last_became_active":"2024-09-13T18:46:11.658190+0000","last_became_peered":"2024-09-13T18:46:11.658190+0000","last_unstale":"2024-09-13T18:49:33.143804+0000","last_undegraded":"2024-09-13T18:49:33.143804+0000","last_fullsized":"2024-09-13T18:49:33.143804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:44.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:16.619888+0000","last_change":"2024-09-13T18:46:11.145972+0000","last_active":"2024-09-13T18:48:16.619888+0000","last_peered":"2024-09-13T18:48:16.619888+0000","last_clean":"2024-09-13T18:48:16.619888+0000","last_became_active":"2024-09-13T18:46:11.145524+0000","last_became_peered":"2024-09-13T18:46:11.145524+0000","last_unstale":"2024-09-13T18:48:16.619888+0000","last_undegraded":"2024-09-13T18:48:16.619888+0000","last_fullsized":"2024-09-13T18:48:16.619888+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:45.878704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.617963+0000","last_change":"2024-09-13T18:45:21.661117+0000","last_active":"2024-09-13T18:47:26.617963+0000","last_peered":"2024-09-13T18:47:26.617963+0000","last_clean":"2024-09-13T18:47:26.617963+0000","last_became_active":"2024-09-13T18:45:21.660577+0000","last_became_peered":"2024-09-13T18:45:21.660577+0000","last_unstale":"2024-09-13T18:47:26.617963+0000","last_undegraded":"2024-09-13T18:47:26.617963+0000","last_fullsized":"2024-09-13T18:47:26.617963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.618646+0000","last_change":"2024-09-13T18:45:26.056021+0000","last_active":"2024-09-13T18:47:31.618646+0000","last_peered":"2024-09-13T18:47:31.618646+0000","last_clean":"2024-09-13T18:47:31.618646+0000","last_became_active":"2024-09-13T18:45:26.053877+0000","last_became_peered":"2024-09-13T18:45:26.053877+0000","last_unstale":"2024-09-13T18:47:31.618646+0000","last_undegraded":"2024-09-13T18:47:31.618646+0000","last_fullsized":"2024-09-13T18:47:31.618646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:51.489422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:33.143704+0000","last_change":"2024-09-13T18:45:22.029936+0000","last_active":"2024-09-13T18:49:33.143704+0000","last_peered":"2024-09-13T18:49:33.143704+0000","last_clean":"2024-09-13T18:49:33.143704+0000","last_became_active":"2024-09-13T18:45:22.028714+0000","last_became_peered":"2024-09-13T18:45:22.028714+0000","last_unstale":"2024-09-13T18:49:33.143704+0000","last_undegraded":"2024-09-13T18:49:33.143704+0000","last_fullsized":"2024-09-13T18:49:33.143704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:35.746368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:52.092714+0000","last_change":"2024-09-13T18:45:21.667926+0000","last_active":"2024-09-13T18:47:52.092714+0000","last_peered":"2024-09-13T18:47:52.092714+0000","last_clean":"2024-09-13T18:47:52.092714+0000","last_became_active":"2024-09-13T18:45:21.667320+0000","last_became_peered":"2024-09-13T18:45:21.667320+0000","last_unstale":"2024-09-13T18:47:52.092714+0000","last_undegraded":"2024-09-13T18:47:52.092714+0000","last_fullsized":"2024-09-13T18:47:52.092714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:33.926106+0000","last_change":"2024-09-13T18:46:11.148369+0000","last_active":"2024-09-13T18:50:33.926106+0000","last_peered":"2024-09-13T18:50:33.926106+0000","last_clean":"2024-09-13T18:50:33.926106+0000","last_became_active":"2024-09-13T18:46:11.147801+0000","last_became_peered":"2024-09-13T18:46:11.147801+0000","last_unstale":"2024-09-13T18:50:33.926106+0000","last_undegraded":"2024-09-13T18:50:33.926106+0000","last_fullsized":"2024-09-13T18:50:33.926106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:54.923780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.617879+0000","last_change":"2024-09-13T18:45:22.023623+0000","last_active":"2024-09-13T18:47:26.617879+0000","last_peered":"2024-09-13T18:47:26.617879+0000","last_clean":"2024-09-13T18:47:26.617879+0000","last_became_active":"2024-09-13T18:45:22.023357+0000","last_became_peered":"2024-09-13T18:45:22.023357+0000","last_unstale":"2024-09-13T18:47:26.617879+0000","last_undegraded":"2024-09-13T18:47:26.617879+0000","last_fullsized":"2024-09-13T18:47:26.617879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'45","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:36.172250+0000","last_change":"2024-09-13T18:45:21.668065+0000","last_active":"2024-09-13T18:50:36.172250+0000","last_peered":"2024-09-13T18:50:36.172250+0000","last_clean":"2024-09-13T18:50:36.172250+0000","last_became_active":"2024-09-13T18:45:21.667768+0000","last_became_peered":"2024-09-13T18:45:21.667768+0000","last_unstale":"2024-09-13T18:50:36.172250+0000","last_undegraded":"2024-09-13T18:50:36.172250+0000","last_fullsized":"2024-09-13T18:50:36.172250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10924,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":39,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.619282+0000","last_change":"2024-09-13T18:45:26.057274+0000","last_active":"2024-09-13T18:47:36.619282+0000","last_peered":"2024-09-13T18:47:36.619282+0000","last_clean":"2024-09-13T18:47:36.619282+0000","last_became_active":"2024-09-13T18:45:26.056850+0000","last_became_peered":"2024-09-13T18:45:26.056850+0000","last_unstale":"2024-09-13T18:47:36.619282+0000","last_undegraded":"2024-09-13T18:47:36.619282+0000","last_fullsized":"2024-09-13T18:47:36.619282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.971516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.613727+0000","last_change":"2024-09-13T18:45:22.020577+0000","last_active":"2024-09-13T18:47:31.613727+0000","last_peered":"2024-09-13T18:47:31.613727+0000","last_clean":"2024-09-13T18:47:31.613727+0000","last_became_active":"2024-09-13T18:45:22.020317+0000","last_became_peered":"2024-09-13T18:45:22.020317+0000","last_unstale":"2024-09-13T18:47:31.613727+0000","last_undegraded":"2024-09-13T18:47:31.613727+0000","last_fullsized":"2024-09-13T18:47:31.613727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112381+0000","last_change":"2024-09-13T18:45:21.667753+0000","last_active":"2024-09-13T18:48:27.112381+0000","last_peered":"2024-09-13T18:48:27.112381+0000","last_clean":"2024-09-13T18:48:27.112381+0000","last_became_active":"2024-09-13T18:45:21.667483+0000","last_became_peered":"2024-09-13T18:45:21.667483+0000","last_unstale":"2024-09-13T18:48:27.112381+0000","last_undegraded":"2024-09-13T18:48:27.112381+0000","last_fullsized":"2024-09-13T18:48:27.112381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:22.171336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614460+0000","last_change":"2024-09-13T18:45:26.254703+0000","last_active":"2024-09-13T18:47:36.614460+0000","last_peered":"2024-09-13T18:47:36.614460+0000","last_clean":"2024-09-13T18:47:36.614460+0000","last_became_active":"2024-09-13T18:45:26.253533+0000","last_became_peered":"2024-09-13T18:45:26.253533+0000","last_unstale":"2024-09-13T18:47:36.614460+0000","last_undegraded":"2024-09-13T18:47:36.614460+0000","last_fullsized":"2024-09-13T18:47:36.614460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614845+0000","last_change":"2024-09-13T18:45:22.032365+0000","last_active":"2024-09-13T18:47:31.614845+0000","last_peered":"2024-09-13T18:47:31.614845+0000","last_clean":"2024-09-13T18:47:31.614845+0000","last_became_active":"2024-09-13T18:45:22.032109+0000","last_became_peered":"2024-09-13T18:45:22.032109+0000","last_unstale":"2024-09-13T18:47:31.614845+0000","last_undegraded":"2024-09-13T18:47:31.614845+0000","last_fullsized":"2024-09-13T18:47:31.614845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.110221+0000","last_change":"2024-09-13T18:45:21.662636+0000","last_active":"2024-09-13T18:48:22.110221+0000","last_peered":"2024-09-13T18:48:22.110221+0000","last_clean":"2024-09-13T18:48:22.110221+0000","last_became_active":"2024-09-13T18:45:21.662344+0000","last_became_peered":"2024-09-13T18:45:21.662344+0000","last_unstale":"2024-09-13T18:48:22.110221+0000","last_undegraded":"2024-09-13T18:48:22.110221+0000","last_fullsized":"2024-09-13T18:48:22.110221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:21.613035+0000","last_change":"2024-09-13T18:45:19.778048+0000","last_active":"2024-09-13T18:47:21.613035+0000","last_peered":"2024-09-13T18:47:21.613035+0000","last_clean":"2024-09-13T18:47:21.613035+0000","last_became_active":"2024-09-13T18:45:19.777172+0000","last_became_peered":"2024-09-13T18:45:19.777172+0000","last_unstale":"2024-09-13T18:47:21.613035+0000","last_undegraded":"2024-09-13T18:47:21.613035+0000","last_fullsized":"2024-09-13T18:47:21.613035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_clean_scrub_stamp":"2024-09-13T18:45:17.981407+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:51.905955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615939+0000","last_change":"2024-09-13T18:45:26.253260+0000","last_active":"2024-09-13T18:47:31.615939+0000","last_peered":"2024-09-13T18:47:31.615939+0000","last_clean":"2024-09-13T18:47:31.615939+0000","last_became_active":"2024-09-13T18:45:26.252890+0000","last_became_peered":"2024-09-13T18:45:26.252890+0000","last_unstale":"2024-09-13T18:47:31.615939+0000","last_undegraded":"2024-09-13T18:47:31.615939+0000","last_fullsized":"2024-09-13T18:47:31.615939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615655+0000","last_change":"2024-09-13T18:45:22.036446+0000","last_active":"2024-09-13T18:47:41.615655+0000","last_peered":"2024-09-13T18:47:41.615655+0000","last_clean":"2024-09-13T18:47:41.615655+0000","last_became_active":"2024-09-13T18:45:22.036153+0000","last_became_peered":"2024-09-13T18:45:22.036153+0000","last_unstale":"2024-09-13T18:47:41.615655+0000","last_undegraded":"2024-09-13T18:47:41.615655+0000","last_fullsized":"2024-09-13T18:47:41.615655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:51.629396+0000","last_change":"2024-09-13T18:45:21.665847+0000","last_active":"2024-09-13T18:49:51.629396+0000","last_peered":"2024-09-13T18:49:51.629396+0000","last_clean":"2024-09-13T18:49:51.629396+0000","last_became_active":"2024-09-13T18:45:21.665582+0000","last_became_peered":"2024-09-13T18:45:21.665582+0000","last_unstale":"2024-09-13T18:49:51.629396+0000","last_undegraded":"2024-09-13T18:49:51.629396+0000","last_fullsized":"2024-09-13T18:49:51.629396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.616410+0000","last_change":"2024-09-13T18:45:26.250391+0000","last_active":"2024-09-13T18:47:36.616410+0000","last_peered":"2024-09-13T18:47:36.616410+0000","last_clean":"2024-09-13T18:47:36.616410+0000","last_became_active":"2024-09-13T18:45:26.249986+0000","last_became_peered":"2024-09-13T18:45:26.249986+0000","last_unstale":"2024-09-13T18:47:36.616410+0000","last_undegraded":"2024-09-13T18:47:36.616410+0000","last_fullsized":"2024-09-13T18:47:36.616410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.616039+0000","last_change":"2024-09-13T18:45:22.037142+0000","last_active":"2024-09-13T18:47:41.616039+0000","last_peered":"2024-09-13T18:47:41.616039+0000","last_clean":"2024-09-13T18:47:41.616039+0000","last_became_active":"2024-09-13T18:45:22.036523+0000","last_became_peered":"2024-09-13T18:45:22.036523+0000","last_unstale":"2024-09-13T18:47:41.616039+0000","last_undegraded":"2024-09-13T18:47:41.616039+0000","last_fullsized":"2024-09-13T18:47:41.616039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.109845+0000","last_change":"2024-09-13T18:45:21.662924+0000","last_active":"2024-09-13T18:48:22.109845+0000","last_peered":"2024-09-13T18:48:22.109845+0000","last_clean":"2024-09-13T18:48:22.109845+0000","last_became_active":"2024-09-13T18:45:21.662405+0000","last_became_peered":"2024-09-13T18:45:21.662405+0000","last_unstale":"2024-09-13T18:48:22.109845+0000","last_undegraded":"2024-09-13T18:48:22.109845+0000","last_fullsized":"2024-09-13T18:48:22.109845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615002+0000","last_change":"2024-09-13T18:45:26.055309+0000","last_active":"2024-09-13T18:47:41.615002+0000","last_peered":"2024-09-13T18:47:41.615002+0000","last_clean":"2024-09-13T18:47:41.615002+0000","last_became_active":"2024-09-13T18:45:26.054449+0000","last_became_peered":"2024-09-13T18:45:26.054449+0000","last_unstale":"2024-09-13T18:47:41.615002+0000","last_undegraded":"2024-09-13T18:47:41.615002+0000","last_fullsized":"2024-09-13T18:47:41.615002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:46:11.610070+0000","last_change":"2024-09-13T18:46:11.150958+0000","last_active":"2024-09-13T18:46:11.610070+0000","last_peered":"2024-09-13T18:46:11.610070+0000","last_clean":"2024-09-13T18:46:11.610070+0000","last_became_active":"2024-09-13T18:46:11.150605+0000","last_became_peered":"2024-09-13T18:46:11.150605+0000","last_unstale":"2024-09-13T18:46:11.610070+0000","last_undegraded":"2024-09-13T18:46:11.610070+0000","last_fullsized":"2024-09-13T18:46:11.610070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:51.536838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.107379+0000","last_change":"2024-09-13T18:45:21.667622+0000","last_active":"2024-09-13T18:48:17.107379+0000","last_peered":"2024-09-13T18:48:17.107379+0000","last_clean":"2024-09-13T18:48:17.107379+0000","last_became_active":"2024-09-13T18:45:21.667340+0000","last_became_peered":"2024-09-13T18:45:21.667340+0000","last_unstale":"2024-09-13T18:48:17.107379+0000","last_undegraded":"2024-09-13T18:48:17.107379+0000","last_fullsized":"2024-09-13T18:48:17.107379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615280+0000","last_change":"2024-09-13T18:45:26.250450+0000","last_active":"2024-09-13T18:47:36.615280+0000","last_peered":"2024-09-13T18:47:36.615280+0000","last_clean":"2024-09-13T18:47:36.615280+0000","last_became_active":"2024-09-13T18:45:26.250020+0000","last_became_peered":"2024-09-13T18:45:26.250020+0000","last_unstale":"2024-09-13T18:47:36.615280+0000","last_undegraded":"2024-09-13T18:47:36.615280+0000","last_fullsized":"2024-09-13T18:47:36.615280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:46.567482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615721+0000","last_change":"2024-09-13T18:45:22.030584+0000","last_active":"2024-09-13T18:47:41.615721+0000","last_peered":"2024-09-13T18:47:41.615721+0000","last_clean":"2024-09-13T18:47:41.615721+0000","last_became_active":"2024-09-13T18:45:22.030275+0000","last_became_peered":"2024-09-13T18:45:22.030275+0000","last_unstale":"2024-09-13T18:47:41.615721+0000","last_undegraded":"2024-09-13T18:47:41.615721+0000","last_fullsized":"2024-09-13T18:47:41.615721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112091+0000","last_change":"2024-09-13T18:45:21.662490+0000","last_active":"2024-09-13T18:48:27.112091+0000","last_peered":"2024-09-13T18:48:27.112091+0000","last_clean":"2024-09-13T18:48:27.112091+0000","last_became_active":"2024-09-13T18:45:21.662210+0000","last_became_peered":"2024-09-13T18:45:21.662210+0000","last_unstale":"2024-09-13T18:48:27.112091+0000","last_undegraded":"2024-09-13T18:48:27.112091+0000","last_fullsized":"2024-09-13T18:48:27.112091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614925+0000","last_change":"2024-09-13T18:45:26.053575+0000","last_active":"2024-09-13T18:47:36.614925+0000","last_peered":"2024-09-13T18:47:36.614925+0000","last_clean":"2024-09-13T18:47:36.614925+0000","last_became_active":"2024-09-13T18:45:26.053195+0000","last_became_peered":"2024-09-13T18:45:26.053195+0000","last_unstale":"2024-09-13T18:47:36.614925+0000","last_undegraded":"2024-09-13T18:47:36.614925+0000","last_fullsized":"2024-09-13T18:47:36.614925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:28.745002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616177+0000","last_change":"2024-09-13T18:45:22.031817+0000","last_active":"2024-09-13T18:47:46.616177+0000","last_peered":"2024-09-13T18:47:46.616177+0000","last_clean":"2024-09-13T18:47:46.616177+0000","last_became_active":"2024-09-13T18:45:22.031312+0000","last_became_peered":"2024-09-13T18:45:22.031312+0000","last_unstale":"2024-09-13T18:47:46.616177+0000","last_undegraded":"2024-09-13T18:47:46.616177+0000","last_fullsized":"2024-09-13T18:47:46.616177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'11","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.111725+0000","last_change":"2024-09-13T18:45:21.655353+0000","last_active":"2024-09-13T18:48:27.111725+0000","last_peered":"2024-09-13T18:48:27.111725+0000","last_clean":"2024-09-13T18:48:27.111725+0000","last_became_active":"2024-09-13T18:45:21.654844+0000","last_became_peered":"2024-09-13T18:45:21.654844+0000","last_unstale":"2024-09-13T18:48:27.111725+0000","last_undegraded":"2024-09-13T18:48:27.111725+0000","last_fullsized":"2024-09-13T18:48:27.111725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616249+0000","last_change":"2024-09-13T18:45:26.056440+0000","last_active":"2024-09-13T18:47:51.616249+0000","last_peered":"2024-09-13T18:47:51.616249+0000","last_clean":"2024-09-13T18:47:51.616249+0000","last_became_active":"2024-09-13T18:45:26.055955+0000","last_became_peered":"2024-09-13T18:45:26.055955+0000","last_unstale":"2024-09-13T18:47:51.616249+0000","last_undegraded":"2024-09-13T18:47:51.616249+0000","last_fullsized":"2024-09-13T18:47:51.616249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:38.309349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.617402+0000","last_change":"2024-09-13T18:45:22.027821+0000","last_active":"2024-09-13T18:47:46.617402+0000","last_peered":"2024-09-13T18:47:46.617402+0000","last_clean":"2024-09-13T18:47:46.617402+0000","last_became_active":"2024-09-13T18:45:22.027172+0000","last_became_peered":"2024-09-13T18:45:22.027172+0000","last_unstale":"2024-09-13T18:47:46.617402+0000","last_undegraded":"2024-09-13T18:47:46.617402+0000","last_fullsized":"2024-09-13T18:47:46.617402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.107256+0000","last_change":"2024-09-13T18:45:21.664084+0000","last_active":"2024-09-13T18:48:17.107256+0000","last_peered":"2024-09-13T18:48:17.107256+0000","last_clean":"2024-09-13T18:48:17.107256+0000","last_became_active":"2024-09-13T18:45:21.663746+0000","last_became_peered":"2024-09-13T18:45:21.663746+0000","last_unstale":"2024-09-13T18:48:17.107256+0000","last_undegraded":"2024-09-13T18:48:17.107256+0000","last_fullsized":"2024-09-13T18:48:17.107256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617500+0000","last_change":"2024-09-13T18:45:26.253221+0000","last_active":"2024-09-13T18:47:51.617500+0000","last_peered":"2024-09-13T18:47:51.617500+0000","last_clean":"2024-09-13T18:47:51.617500+0000","last_became_active":"2024-09-13T18:45:26.252841+0000","last_became_peered":"2024-09-13T18:45:26.252841+0000","last_unstale":"2024-09-13T18:47:51.617500+0000","last_undegraded":"2024-09-13T18:47:51.617500+0000","last_fullsized":"2024-09-13T18:47:51.617500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:26.396713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616212+0000","last_change":"2024-09-13T18:45:22.033554+0000","last_active":"2024-09-13T18:47:46.616212+0000","last_peered":"2024-09-13T18:47:46.616212+0000","last_clean":"2024-09-13T18:47:46.616212+0000","last_became_active":"2024-09-13T18:45:22.032862+0000","last_became_peered":"2024-09-13T18:45:22.032862+0000","last_unstale":"2024-09-13T18:47:46.616212+0000","last_undegraded":"2024-09-13T18:47:46.616212+0000","last_fullsized":"2024-09-13T18:47:46.616212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'8","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112563+0000","last_change":"2024-09-13T18:45:21.668025+0000","last_active":"2024-09-13T18:48:27.112563+0000","last_peered":"2024-09-13T18:48:27.112563+0000","last_clean":"2024-09-13T18:48:27.112563+0000","last_became_active":"2024-09-13T18:45:21.667457+0000","last_became_peered":"2024-09-13T18:45:21.667457+0000","last_unstale":"2024-09-13T18:48:27.112563+0000","last_undegraded":"2024-09-13T18:48:27.112563+0000","last_fullsized":"2024-09-13T18:48:27.112563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616601+0000","last_change":"2024-09-13T18:45:26.250464+0000","last_active":"2024-09-13T18:47:46.616601+0000","last_peered":"2024-09-13T18:47:46.616601+0000","last_clean":"2024-09-13T18:47:46.616601+0000","last_became_active":"2024-09-13T18:45:26.250041+0000","last_became_peered":"2024-09-13T18:45:26.250041+0000","last_unstale":"2024-09-13T18:47:46.616601+0000","last_undegraded":"2024-09-13T18:47:46.616601+0000","last_fullsized":"2024-09-13T18:47:46.616601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:20.013806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.615471+0000","last_change":"2024-09-13T18:45:22.024133+0000","last_active":"2024-09-13T18:47:46.615471+0000","last_peered":"2024-09-13T18:47:46.615471+0000","last_clean":"2024-09-13T18:47:46.615471+0000","last_became_active":"2024-09-13T18:45:22.023882+0000","last_became_peered":"2024-09-13T18:45:22.023882+0000","last_unstale":"2024-09-13T18:47:46.615471+0000","last_undegraded":"2024-09-13T18:47:46.615471+0000","last_fullsized":"2024-09-13T18:47:46.615471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615027+0000","last_change":"2024-09-13T18:45:21.663297+0000","last_active":"2024-09-13T18:47:41.615027+0000","last_peered":"2024-09-13T18:47:41.615027+0000","last_clean":"2024-09-13T18:47:41.615027+0000","last_became_active":"2024-09-13T18:45:21.662980+0000","last_became_peered":"2024-09-13T18:45:21.662980+0000","last_unstale":"2024-09-13T18:47:41.615027+0000","last_undegraded":"2024-09-13T18:47:41.615027+0000","last_fullsized":"2024-09-13T18:47:41.615027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617186+0000","last_change":"2024-09-13T18:45:26.253184+0000","last_active":"2024-09-13T18:47:51.617186+0000","last_peered":"2024-09-13T18:47:51.617186+0000","last_clean":"2024-09-13T18:47:51.617186+0000","last_became_active":"2024-09-13T18:45:26.252786+0000","last_became_peered":"2024-09-13T18:45:26.252786+0000","last_unstale":"2024-09-13T18:47:51.617186+0000","last_undegraded":"2024-09-13T18:47:51.617186+0000","last_fullsized":"2024-09-13T18:47:51.617186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616847+0000","last_change":"2024-09-13T18:45:22.035052+0000","last_active":"2024-09-13T18:47:51.616847+0000","last_peered":"2024-09-13T18:47:51.616847+0000","last_clean":"2024-09-13T18:47:51.616847+0000","last_became_active":"2024-09-13T18:45:22.034765+0000","last_became_peered":"2024-09-13T18:45:22.034765+0000","last_unstale":"2024-09-13T18:47:51.616847+0000","last_undegraded":"2024-09-13T18:47:51.616847+0000","last_fullsized":"2024-09-13T18:47:51.616847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:28.674827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'99","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:35.986207+0000","last_change":"2024-09-13T18:45:21.668054+0000","last_active":"2024-09-13T18:50:35.986207+0000","last_peered":"2024-09-13T18:50:35.986207+0000","last_clean":"2024-09-13T18:50:35.986207+0000","last_became_active":"2024-09-13T18:45:21.667587+0000","last_became_peered":"2024-09-13T18:45:21.667587+0000","last_unstale":"2024-09-13T18:50:35.986207+0000","last_undegraded":"2024-09-13T18:50:35.986207+0000","last_fullsized":"2024-09-13T18:50:35.986207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":939852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.620478+0000","last_change":"2024-09-13T18:45:26.052997+0000","last_active":"2024-09-13T18:47:46.620478+0000","last_peered":"2024-09-13T18:47:46.620478+0000","last_clean":"2024-09-13T18:47:46.620478+0000","last_became_active":"2024-09-13T18:45:26.052614+0000","last_became_peered":"2024-09-13T18:45:26.052614+0000","last_unstale":"2024-09-13T18:47:46.620478+0000","last_undegraded":"2024-09-13T18:47:46.620478+0000","last_fullsized":"2024-09-13T18:47:46.620478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616204+0000","last_change":"2024-09-13T18:45:22.020754+0000","last_active":"2024-09-13T18:47:46.616204+0000","last_peered":"2024-09-13T18:47:46.616204+0000","last_clean":"2024-09-13T18:47:46.616204+0000","last_became_active":"2024-09-13T18:45:22.020461+0000","last_became_peered":"2024-09-13T18:45:22.020461+0000","last_unstale":"2024-09-13T18:47:46.616204+0000","last_undegraded":"2024-09-13T18:47:46.616204+0000","last_fullsized":"2024-09-13T18:47:46.616204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'28","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:35.178728+0000","last_change":"2024-09-13T18:45:21.664387+0000","last_active":"2024-09-13T18:50:35.178728+0000","last_peered":"2024-09-13T18:50:35.178728+0000","last_clean":"2024-09-13T18:50:35.178728+0000","last_became_active":"2024-09-13T18:45:21.663941+0000","last_became_peered":"2024-09-13T18:45:21.663941+0000","last_unstale":"2024-09-13T18:50:35.178728+0000","last_undegraded":"2024-09-13T18:50:35.178728+0000","last_fullsized":"2024-09-13T18:50:35.178728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616153+0000","last_change":"2024-09-13T18:45:26.051227+0000","last_active":"2024-09-13T18:47:46.616153+0000","last_peered":"2024-09-13T18:47:46.616153+0000","last_clean":"2024-09-13T18:47:46.616153+0000","last_became_active":"2024-09-13T18:45:26.050757+0000","last_became_peered":"2024-09-13T18:45:26.050757+0000","last_unstale":"2024-09-13T18:47:46.616153+0000","last_undegraded":"2024-09-13T18:47:46.616153+0000","last_fullsized":"2024-09-13T18:47:46.616153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:59.045390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616282+0000","last_change":"2024-09-13T18:45:22.025223+0000","last_active":"2024-09-13T18:47:51.616282+0000","last_peered":"2024-09-13T18:47:51.616282+0000","last_clean":"2024-09-13T18:47:51.616282+0000","last_became_active":"2024-09-13T18:45:22.024972+0000","last_became_peered":"2024-09-13T18:45:22.024972+0000","last_unstale":"2024-09-13T18:47:51.616282+0000","last_undegraded":"2024-09-13T18:47:51.616282+0000","last_fullsized":"2024-09-13T18:47:51.616282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'7","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.104828+0000","last_change":"2024-09-13T18:45:21.666814+0000","last_active":"2024-09-13T18:48:12.104828+0000","last_peered":"2024-09-13T18:48:12.104828+0000","last_clean":"2024-09-13T18:48:12.104828+0000","last_became_active":"2024-09-13T18:45:21.666516+0000","last_became_peered":"2024-09-13T18:45:21.666516+0000","last_unstale":"2024-09-13T18:48:12.104828+0000","last_undegraded":"2024-09-13T18:48:12.104828+0000","last_fullsized":"2024-09-13T18:48:12.104828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616514+0000","last_change":"2024-09-13T18:45:26.057746+0000","last_active":"2024-09-13T18:47:46.616514+0000","last_peered":"2024-09-13T18:47:46.616514+0000","last_clean":"2024-09-13T18:47:46.616514+0000","last_became_active":"2024-09-13T18:45:26.057285+0000","last_became_peered":"2024-09-13T18:45:26.057285+0000","last_unstale":"2024-09-13T18:47:46.616514+0000","last_undegraded":"2024-09-13T18:47:46.616514+0000","last_fullsized":"2024-09-13T18:47:46.616514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617206+0000","last_change":"2024-09-13T18:45:22.031653+0000","last_active":"2024-09-13T18:47:51.617206+0000","last_peered":"2024-09-13T18:47:51.617206+0000","last_clean":"2024-09-13T18:47:51.617206+0000","last_became_active":"2024-09-13T18:45:22.031341+0000","last_became_peered":"2024-09-13T18:45:22.031341+0000","last_unstale":"2024-09-13T18:47:51.617206+0000","last_undegraded":"2024-09-13T18:47:51.617206+0000","last_fullsized":"2024-09-13T18:47:51.617206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112682+0000","last_change":"2024-09-13T18:45:21.664695+0000","last_active":"2024-09-13T18:48:27.112682+0000","last_peered":"2024-09-13T18:48:27.112682+0000","last_clean":"2024-09-13T18:48:27.112682+0000","last_became_active":"2024-09-13T18:45:21.664401+0000","last_became_peered":"2024-09-13T18:45:21.664401+0000","last_unstale":"2024-09-13T18:48:27.112682+0000","last_undegraded":"2024-09-13T18:48:27.112682+0000","last_fullsized":"2024-09-13T18:48:27.112682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616542+0000","last_change":"2024-09-13T18:45:26.254041+0000","last_active":"2024-09-13T18:47:46.616542+0000","last_peered":"2024-09-13T18:47:46.616542+0000","last_clean":"2024-09-13T18:47:46.616542+0000","last_became_active":"2024-09-13T18:45:26.253579+0000","last_became_peered":"2024-09-13T18:45:26.253579+0000","last_unstale":"2024-09-13T18:47:46.616542+0000","last_undegraded":"2024-09-13T18:47:46.616542+0000","last_fullsized":"2024-09-13T18:47:46.616542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:19.171737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.613048+0000","last_change":"2024-09-13T18:45:26.253962+0000","last_active":"2024-09-13T18:47:26.613048+0000","last_peered":"2024-09-13T18:47:26.613048+0000","last_clean":"2024-09-13T18:47:26.613048+0000","last_became_active":"2024-09-13T18:45:26.252979+0000","last_became_peered":"2024-09-13T18:45:26.252979+0000","last_unstale":"2024-09-13T18:47:26.613048+0000","last_undegraded":"2024-09-13T18:47:26.613048+0000","last_fullsized":"2024-09-13T18:47:26.613048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.621059+0000","last_change":"2024-09-13T18:45:22.030919+0000","last_active":"2024-09-13T18:47:51.621059+0000","last_peered":"2024-09-13T18:47:51.621059+0000","last_clean":"2024-09-13T18:47:51.621059+0000","last_became_active":"2024-09-13T18:45:22.030453+0000","last_became_peered":"2024-09-13T18:45:22.030453+0000","last_unstale":"2024-09-13T18:47:51.621059+0000","last_undegraded":"2024-09-13T18:47:51.621059+0000","last_fullsized":"2024-09-13T18:47:51.621059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112562+0000","last_change":"2024-09-13T18:45:21.664824+0000","last_active":"2024-09-13T18:48:27.112562+0000","last_peered":"2024-09-13T18:48:27.112562+0000","last_clean":"2024-09-13T18:48:27.112562+0000","last_became_active":"2024-09-13T18:45:21.664571+0000","last_became_peered":"2024-09-13T18:45:21.664571+0000","last_unstale":"2024-09-13T18:48:27.112562+0000","last_undegraded":"2024-09-13T18:48:27.112562+0000","last_fullsized":"2024-09-13T18:48:27.112562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615970+0000","last_change":"2024-09-13T18:45:26.054920+0000","last_active":"2024-09-13T18:47:31.615970+0000","last_peered":"2024-09-13T18:47:31.615970+0000","last_clean":"2024-09-13T18:47:31.615970+0000","last_became_active":"2024-09-13T18:45:26.054510+0000","last_became_peered":"2024-09-13T18:45:26.054510+0000","last_unstale":"2024-09-13T18:47:31.615970+0000","last_undegraded":"2024-09-13T18:47:31.615970+0000","last_fullsized":"2024-09-13T18:47:31.615970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:32.061769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617366+0000","last_change":"2024-09-13T18:45:22.028321+0000","last_active":"2024-09-13T18:47:51.617366+0000","last_peered":"2024-09-13T18:47:51.617366+0000","last_clean":"2024-09-13T18:47:51.617366+0000","last_became_active":"2024-09-13T18:45:22.028062+0000","last_became_peered":"2024-09-13T18:45:22.028062+0000","last_unstale":"2024-09-13T18:47:51.617366+0000","last_undegraded":"2024-09-13T18:47:51.617366+0000","last_fullsized":"2024-09-13T18:47:51.617366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.109768+0000","last_change":"2024-09-13T18:45:21.672763+0000","last_active":"2024-09-13T18:48:22.109768+0000","last_peered":"2024-09-13T18:48:22.109768+0000","last_clean":"2024-09-13T18:48:22.109768+0000","last_became_active":"2024-09-13T18:45:21.672470+0000","last_became_peered":"2024-09-13T18:45:21.672470+0000","last_unstale":"2024-09-13T18:48:22.109768+0000","last_undegraded":"2024-09-13T18:48:22.109768+0000","last_fullsized":"2024-09-13T18:48:22.109768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.098429+0000","last_change":"2024-09-13T18:45:21.660195+0000","last_active":"2024-09-13T18:48:02.098429+0000","last_peered":"2024-09-13T18:48:02.098429+0000","last_clean":"2024-09-13T18:48:02.098429+0000","last_became_active":"2024-09-13T18:45:21.659912+0000","last_became_peered":"2024-09-13T18:45:21.659912+0000","last_unstale":"2024-09-13T18:48:02.098429+0000","last_undegraded":"2024-09-13T18:48:02.098429+0000","last_fullsized":"2024-09-13T18:48:02.098429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.616788+0000","last_change":"2024-09-13T18:45:22.024571+0000","last_active":"2024-09-13T18:47:56.616788+0000","last_peered":"2024-09-13T18:47:56.616788+0000","last_clean":"2024-09-13T18:47:56.616788+0000","last_became_active":"2024-09-13T18:45:22.024305+0000","last_became_peered":"2024-09-13T18:45:22.024305+0000","last_unstale":"2024-09-13T18:47:56.616788+0000","last_undegraded":"2024-09-13T18:47:56.616788+0000","last_fullsized":"2024-09-13T18:47:56.616788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617977+0000","last_change":"2024-09-13T18:45:26.056207+0000","last_active":"2024-09-13T18:47:56.617977+0000","last_peered":"2024-09-13T18:47:56.617977+0000","last_clean":"2024-09-13T18:47:56.617977+0000","last_became_active":"2024-09-13T18:45:26.055794+0000","last_became_peered":"2024-09-13T18:45:26.055794+0000","last_unstale":"2024-09-13T18:47:56.617977+0000","last_undegraded":"2024-09-13T18:47:56.617977+0000","last_fullsized":"2024-09-13T18:47:56.617977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:29.520825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617441+0000","last_change":"2024-09-13T18:45:21.670376+0000","last_active":"2024-09-13T18:47:51.617441+0000","last_peered":"2024-09-13T18:47:51.617441+0000","last_clean":"2024-09-13T18:47:51.617441+0000","last_became_active":"2024-09-13T18:45:21.670083+0000","last_became_peered":"2024-09-13T18:45:21.670083+0000","last_unstale":"2024-09-13T18:47:51.617441+0000","last_undegraded":"2024-09-13T18:47:51.617441+0000","last_fullsized":"2024-09-13T18:47:51.617441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617522+0000","last_change":"2024-09-13T18:45:22.021774+0000","last_active":"2024-09-13T18:47:56.617522+0000","last_peered":"2024-09-13T18:47:56.617522+0000","last_clean":"2024-09-13T18:47:56.617522+0000","last_became_active":"2024-09-13T18:45:22.021496+0000","last_became_peered":"2024-09-13T18:45:22.021496+0000","last_unstale":"2024-09-13T18:47:56.617522+0000","last_undegraded":"2024-09-13T18:47:56.617522+0000","last_fullsized":"2024-09-13T18:47:56.617522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:44.234639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.618047+0000","last_change":"2024-09-13T18:45:26.050478+0000","last_active":"2024-09-13T18:47:56.618047+0000","last_peered":"2024-09-13T18:47:56.618047+0000","last_clean":"2024-09-13T18:47:56.618047+0000","last_became_active":"2024-09-13T18:45:26.050095+0000","last_became_peered":"2024-09-13T18:45:26.050095+0000","last_unstale":"2024-09-13T18:47:56.618047+0000","last_undegraded":"2024-09-13T18:47:56.618047+0000","last_fullsized":"2024-09-13T18:47:56.618047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:28.276515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615874+0000","last_change":"2024-09-13T18:45:22.028025+0000","last_active":"2024-09-13T18:47:31.615874+0000","last_peered":"2024-09-13T18:47:31.615874+0000","last_clean":"2024-09-13T18:47:31.615874+0000","last_became_active":"2024-09-13T18:45:22.027528+0000","last_became_peered":"2024-09-13T18:45:22.027528+0000","last_unstale":"2024-09-13T18:47:31.615874+0000","last_undegraded":"2024-09-13T18:47:31.615874+0000","last_fullsized":"2024-09-13T18:47:31.615874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615332+0000","last_change":"2024-09-13T18:45:22.024615+0000","last_active":"2024-09-13T18:47:31.615332+0000","last_peered":"2024-09-13T18:47:31.615332+0000","last_clean":"2024-09-13T18:47:31.615332+0000","last_became_active":"2024-09-13T18:45:22.024369+0000","last_became_peered":"2024-09-13T18:45:22.024369+0000","last_unstale":"2024-09-13T18:47:31.615332+0000","last_undegraded":"2024-09-13T18:47:31.615332+0000","last_fullsized":"2024-09-13T18:47:31.615332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614768+0000","last_change":"2024-09-13T18:45:22.035861+0000","last_active":"2024-09-13T18:47:31.614768+0000","last_peered":"2024-09-13T18:47:31.614768+0000","last_clean":"2024-09-13T18:47:31.614768+0000","last_became_active":"2024-09-13T18:45:22.034318+0000","last_became_peered":"2024-09-13T18:45:22.034318+0000","last_unstale":"2024-09-13T18:47:31.614768+0000","last_undegraded":"2024-09-13T18:47:31.614768+0000","last_fullsized":"2024-09-13T18:47:31.614768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.613791+0000","last_change":"2024-09-13T18:45:22.033266+0000","last_active":"2024-09-13T18:47:31.613791+0000","last_peered":"2024-09-13T18:47:31.613791+0000","last_clean":"2024-09-13T18:47:31.613791+0000","last_became_active":"2024-09-13T18:45:22.032851+0000","last_became_peered":"2024-09-13T18:45:22.032851+0000","last_unstale":"2024-09-13T18:47:31.613791+0000","last_undegraded":"2024-09-13T18:47:31.613791+0000","last_fullsized":"2024-09-13T18:47:31.613791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615463+0000","last_change":"2024-09-13T18:45:22.033500+0000","last_active":"2024-09-13T18:47:36.615463+0000","last_peered":"2024-09-13T18:47:36.615463+0000","last_clean":"2024-09-13T18:47:36.615463+0000","last_became_active":"2024-09-13T18:45:22.033156+0000","last_became_peered":"2024-09-13T18:45:22.033156+0000","last_unstale":"2024-09-13T18:47:36.615463+0000","last_undegraded":"2024-09-13T18:47:36.615463+0000","last_fullsized":"2024-09-13T18:47:36.615463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.619224+0000","last_change":"2024-09-13T18:45:22.029906+0000","last_active":"2024-09-13T18:47:36.619224+0000","last_peered":"2024-09-13T18:47:36.619224+0000","last_clean":"2024-09-13T18:47:36.619224+0000","last_became_active":"2024-09-13T18:45:22.029654+0000","last_became_peered":"2024-09-13T18:45:22.029654+0000","last_unstale":"2024-09-13T18:47:36.619224+0000","last_undegraded":"2024-09-13T18:47:36.619224+0000","last_fullsized":"2024-09-13T18:47:36.619224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.616491+0000","last_change":"2024-09-13T18:45:22.028396+0000","last_active":"2024-09-13T18:47:36.616491+0000","last_peered":"2024-09-13T18:47:36.616491+0000","last_clean":"2024-09-13T18:47:36.616491+0000","last_became_active":"2024-09-13T18:45:22.028031+0000","last_became_peered":"2024-09-13T18:45:22.028031+0000","last_unstale":"2024-09-13T18:47:36.616491+0000","last_undegraded":"2024-09-13T18:47:36.616491+0000","last_fullsized":"2024-09-13T18:47:36.616491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615534+0000","last_change":"2024-09-13T18:45:22.032816+0000","last_active":"2024-09-13T18:47:36.615534+0000","last_peered":"2024-09-13T18:47:36.615534+0000","last_clean":"2024-09-13T18:47:36.615534+0000","last_became_active":"2024-09-13T18:45:22.032561+0000","last_became_peered":"2024-09-13T18:45:22.032561+0000","last_unstale":"2024-09-13T18:47:36.615534+0000","last_undegraded":"2024-09-13T18:47:36.615534+0000","last_fullsized":"2024-09-13T18:47:36.615534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615296+0000","last_change":"2024-09-13T18:45:22.036615+0000","last_active":"2024-09-13T18:47:36.615296+0000","last_peered":"2024-09-13T18:47:36.615296+0000","last_clean":"2024-09-13T18:47:36.615296+0000","last_became_active":"2024-09-13T18:45:22.036380+0000","last_became_peered":"2024-09-13T18:45:22.036380+0000","last_unstale":"2024-09-13T18:47:36.615296+0000","last_undegraded":"2024-09-13T18:47:36.615296+0000","last_fullsized":"2024-09-13T18:47:36.615296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.616019+0000","last_change":"2024-09-13T18:45:22.035082+0000","last_active":"2024-09-13T18:47:41.616019+0000","last_peered":"2024-09-13T18:47:41.616019+0000","last_clean":"2024-09-13T18:47:41.616019+0000","last_became_active":"2024-09-13T18:45:22.034646+0000","last_became_peered":"2024-09-13T18:45:22.034646+0000","last_unstale":"2024-09-13T18:47:41.616019+0000","last_undegraded":"2024-09-13T18:47:41.616019+0000","last_fullsized":"2024-09-13T18:47:41.616019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615955+0000","last_change":"2024-09-13T18:45:22.029195+0000","last_active":"2024-09-13T18:47:41.615955+0000","last_peered":"2024-09-13T18:47:41.615955+0000","last_clean":"2024-09-13T18:47:41.615955+0000","last_became_active":"2024-09-13T18:45:22.028430+0000","last_became_peered":"2024-09-13T18:45:22.028430+0000","last_unstale":"2024-09-13T18:47:41.615955+0000","last_undegraded":"2024-09-13T18:47:41.615955+0000","last_fullsized":"2024-09-13T18:47:41.615955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.614982+0000","last_change":"2024-09-13T18:45:22.019974+0000","last_active":"2024-09-13T18:47:41.614982+0000","last_peered":"2024-09-13T18:47:41.614982+0000","last_clean":"2024-09-13T18:47:41.614982+0000","last_became_active":"2024-09-13T18:45:22.019733+0000","last_became_peered":"2024-09-13T18:45:22.019733+0000","last_unstale":"2024-09-13T18:47:41.614982+0000","last_undegraded":"2024-09-13T18:47:41.614982+0000","last_fullsized":"2024-09-13T18:47:41.614982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.616976+0000","last_change":"2024-09-13T18:45:22.016110+0000","last_active":"2024-09-13T18:47:41.616976+0000","last_peered":"2024-09-13T18:47:41.616976+0000","last_clean":"2024-09-13T18:47:41.616976+0000","last_became_active":"2024-09-13T18:45:22.015868+0000","last_became_peered":"2024-09-13T18:45:22.015868+0000","last_unstale":"2024-09-13T18:47:41.616976+0000","last_undegraded":"2024-09-13T18:47:41.616976+0000","last_fullsized":"2024-09-13T18:47:41.616976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615690+0000","last_change":"2024-09-13T18:45:22.034477+0000","last_active":"2024-09-13T18:47:41.615690+0000","last_peered":"2024-09-13T18:47:41.615690+0000","last_clean":"2024-09-13T18:47:41.615690+0000","last_became_active":"2024-09-13T18:45:22.034019+0000","last_became_peered":"2024-09-13T18:45:22.034019+0000","last_unstale":"2024-09-13T18:47:41.615690+0000","last_undegraded":"2024-09-13T18:47:41.615690+0000","last_fullsized":"2024-09-13T18:47:41.615690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616852+0000","last_change":"2024-09-13T18:45:22.021787+0000","last_active":"2024-09-13T18:47:46.616852+0000","last_peered":"2024-09-13T18:47:46.616852+0000","last_clean":"2024-09-13T18:47:46.616852+0000","last_became_active":"2024-09-13T18:45:22.020415+0000","last_became_peered":"2024-09-13T18:45:22.020415+0000","last_unstale":"2024-09-13T18:47:46.616852+0000","last_undegraded":"2024-09-13T18:47:46.616852+0000","last_fullsized":"2024-09-13T18:47:46.616852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616670+0000","last_change":"2024-09-13T18:45:22.035941+0000","last_active":"2024-09-13T18:47:46.616670+0000","last_peered":"2024-09-13T18:47:46.616670+0000","last_clean":"2024-09-13T18:47:46.616670+0000","last_became_active":"2024-09-13T18:45:22.035491+0000","last_became_peered":"2024-09-13T18:45:22.035491+0000","last_unstale":"2024-09-13T18:47:46.616670+0000","last_undegraded":"2024-09-13T18:47:46.616670+0000","last_fullsized":"2024-09-13T18:47:46.616670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:46:11.607690+0000","last_change":"2024-09-13T18:46:11.147145+0000","last_active":"2024-09-13T18:46:11.607690+0000","last_peered":"2024-09-13T18:46:11.607690+0000","last_clean":"2024-09-13T18:46:11.607690+0000","last_became_active":"2024-09-13T18:46:11.146859+0000","last_became_peered":"2024-09-13T18:46:11.146859+0000","last_unstale":"2024-09-13T18:46:11.607690+0000","last_undegraded":"2024-09-13T18:46:11.607690+0000","last_fullsized":"2024-09-13T18:46:11.607690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:36.388621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.620452+0000","last_change":"2024-09-13T18:45:22.021298+0000","last_active":"2024-09-13T18:47:46.620452+0000","last_peered":"2024-09-13T18:47:46.620452+0000","last_clean":"2024-09-13T18:47:46.620452+0000","last_became_active":"2024-09-13T18:45:22.021042+0000","last_became_peered":"2024-09-13T18:45:22.021042+0000","last_unstale":"2024-09-13T18:47:46.620452+0000","last_undegraded":"2024-09-13T18:47:46.620452+0000","last_fullsized":"2024-09-13T18:47:46.620452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.615452+0000","last_change":"2024-09-13T18:45:22.021628+0000","last_active":"2024-09-13T18:47:46.615452+0000","last_peered":"2024-09-13T18:47:46.615452+0000","last_clean":"2024-09-13T18:47:46.615452+0000","last_became_active":"2024-09-13T18:45:22.021366+0000","last_became_peered":"2024-09-13T18:45:22.021366+0000","last_unstale":"2024-09-13T18:47:46.615452+0000","last_undegraded":"2024-09-13T18:47:46.615452+0000","last_fullsized":"2024-09-13T18:47:46.615452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617423+0000","last_change":"2024-09-13T18:45:22.029051+0000","last_active":"2024-09-13T18:47:51.617423+0000","last_peered":"2024-09-13T18:47:51.617423+0000","last_clean":"2024-09-13T18:47:51.617423+0000","last_became_active":"2024-09-13T18:45:22.028594+0000","last_became_peered":"2024-09-13T18:45:22.028594+0000","last_unstale":"2024-09-13T18:47:51.617423+0000","last_undegraded":"2024-09-13T18:47:51.617423+0000","last_fullsized":"2024-09-13T18:47:51.617423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616896+0000","last_change":"2024-09-13T18:45:22.016996+0000","last_active":"2024-09-13T18:47:51.616896+0000","last_peered":"2024-09-13T18:47:51.616896+0000","last_clean":"2024-09-13T18:47:51.616896+0000","last_became_active":"2024-09-13T18:45:22.016731+0000","last_became_peered":"2024-09-13T18:45:22.016731+0000","last_unstale":"2024-09-13T18:47:51.616896+0000","last_undegraded":"2024-09-13T18:47:51.616896+0000","last_fullsized":"2024-09-13T18:47:51.616896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617981+0000","last_change":"2024-09-13T18:45:22.028649+0000","last_active":"2024-09-13T18:47:51.617981+0000","last_peered":"2024-09-13T18:47:51.617981+0000","last_clean":"2024-09-13T18:47:51.617981+0000","last_became_active":"2024-09-13T18:45:22.027899+0000","last_became_peered":"2024-09-13T18:45:22.027899+0000","last_unstale":"2024-09-13T18:47:51.617981+0000","last_undegraded":"2024-09-13T18:47:51.617981+0000","last_fullsized":"2024-09-13T18:47:51.617981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617999+0000","last_change":"2024-09-13T18:45:22.024291+0000","last_active":"2024-09-13T18:47:51.617999+0000","last_peered":"2024-09-13T18:47:51.617999+0000","last_clean":"2024-09-13T18:47:51.617999+0000","last_became_active":"2024-09-13T18:45:22.024014+0000","last_became_peered":"2024-09-13T18:45:22.024014+0000","last_unstale":"2024-09-13T18:47:51.617999+0000","last_undegraded":"2024-09-13T18:47:51.617999+0000","last_fullsized":"2024-09-13T18:47:51.617999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616937+0000","last_change":"2024-09-13T18:45:22.036551+0000","last_active":"2024-09-13T18:47:51.616937+0000","last_peered":"2024-09-13T18:47:51.616937+0000","last_clean":"2024-09-13T18:47:51.616937+0000","last_became_active":"2024-09-13T18:45:22.036269+0000","last_became_peered":"2024-09-13T18:45:22.036269+0000","last_unstale":"2024-09-13T18:47:51.616937+0000","last_undegraded":"2024-09-13T18:47:51.616937+0000","last_fullsized":"2024-09-13T18:47:51.616937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617957+0000","last_change":"2024-09-13T18:45:22.032392+0000","last_active":"2024-09-13T18:47:56.617957+0000","last_peered":"2024-09-13T18:47:56.617957+0000","last_clean":"2024-09-13T18:47:56.617957+0000","last_became_active":"2024-09-13T18:45:22.027605+0000","last_became_peered":"2024-09-13T18:45:22.027605+0000","last_unstale":"2024-09-13T18:47:56.617957+0000","last_undegraded":"2024-09-13T18:47:56.617957+0000","last_fullsized":"2024-09-13T18:47:56.617957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617446+0000","last_change":"2024-09-13T18:45:22.029307+0000","last_active":"2024-09-13T18:47:56.617446+0000","last_peered":"2024-09-13T18:47:56.617446+0000","last_clean":"2024-09-13T18:47:56.617446+0000","last_became_active":"2024-09-13T18:45:22.029018+0000","last_became_peered":"2024-09-13T18:45:22.029018+0000","last_unstale":"2024-09-13T18:47:56.617446+0000","last_undegraded":"2024-09-13T18:47:56.617446+0000","last_fullsized":"2024-09-13T18:47:56.617446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617701+0000","last_change":"2024-09-13T18:45:22.029061+0000","last_active":"2024-09-13T18:47:56.617701+0000","last_peered":"2024-09-13T18:47:56.617701+0000","last_clean":"2024-09-13T18:47:56.617701+0000","last_became_active":"2024-09-13T18:45:22.028758+0000","last_became_peered":"2024-09-13T18:45:22.028758+0000","last_unstale":"2024-09-13T18:47:56.617701+0000","last_undegraded":"2024-09-13T18:47:56.617701+0000","last_fullsized":"2024-09-13T18:47:56.617701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617479+0000","last_change":"2024-09-13T18:45:22.029690+0000","last_active":"2024-09-13T18:47:56.617479+0000","last_peered":"2024-09-13T18:47:56.617479+0000","last_clean":"2024-09-13T18:47:56.617479+0000","last_became_active":"2024-09-13T18:45:22.029403+0000","last_became_peered":"2024-09-13T18:45:22.029403+0000","last_unstale":"2024-09-13T18:47:56.617479+0000","last_undegraded":"2024-09-13T18:47:56.617479+0000","last_fullsized":"2024-09-13T18:47:56.617479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.614237+0000","last_change":"2024-09-13T18:45:22.038483+0000","last_active":"2024-09-13T18:47:26.614237+0000","last_peered":"2024-09-13T18:47:26.614237+0000","last_clean":"2024-09-13T18:47:26.614237+0000","last_became_active":"2024-09-13T18:45:22.036877+0000","last_became_peered":"2024-09-13T18:45:22.036877+0000","last_unstale":"2024-09-13T18:47:26.614237+0000","last_undegraded":"2024-09-13T18:47:26.614237+0000","last_fullsized":"2024-09-13T18:47:26.614237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.613815+0000","last_change":"2024-09-13T18:45:22.022846+0000","last_active":"2024-09-13T18:47:31.613815+0000","last_peered":"2024-09-13T18:47:31.613815+0000","last_clean":"2024-09-13T18:47:31.613815+0000","last_became_active":"2024-09-13T18:45:22.022618+0000","last_became_peered":"2024-09-13T18:45:22.022618+0000","last_unstale":"2024-09-13T18:47:31.613815+0000","last_undegraded":"2024-09-13T18:47:31.613815+0000","last_fullsized":"2024-09-13T18:47:31.613815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.618716+0000","last_change":"2024-09-13T18:45:22.028545+0000","last_active":"2024-09-13T18:47:31.618716+0000","last_peered":"2024-09-13T18:47:31.618716+0000","last_clean":"2024-09-13T18:47:31.618716+0000","last_became_active":"2024-09-13T18:45:22.028291+0000","last_became_peered":"2024-09-13T18:45:22.028291+0000","last_unstale":"2024-09-13T18:47:31.618716+0000","last_undegraded":"2024-09-13T18:47:31.618716+0000","last_fullsized":"2024-09-13T18:47:31.618716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614388+0000","last_change":"2024-09-13T18:45:22.034460+0000","last_active":"2024-09-13T18:47:31.614388+0000","last_peered":"2024-09-13T18:47:31.614388+0000","last_clean":"2024-09-13T18:47:31.614388+0000","last_became_active":"2024-09-13T18:45:22.033974+0000","last_became_peered":"2024-09-13T18:45:22.033974+0000","last_unstale":"2024-09-13T18:47:31.614388+0000","last_undegraded":"2024-09-13T18:47:31.614388+0000","last_fullsized":"2024-09-13T18:47:31.614388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":951574,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":265,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":1903148,"data_compressed":245052,"data_compressed_allocated":294912,"data_compressed_original":1441792,"omap_allocated":0,"internal_metadata":0},"log_size":328,"ondisk_log_size":328,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":704313,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.42399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.754},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.46999999999999997},"min":{"1min":0.36199999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.65400000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49099999999999999,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70799999999999996,"5min":0.749,"15min":0.749},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.432,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67300000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66200000000000003,"5min":0.755,"15min":0.755},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.48099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.47099999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47299999999999998,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60399999999999998,"5min":0.748,"15min":0.748},"last":0.629}]},{"osd":5,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.52100000000000002},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.54300000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73099999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.57199999999999995},"min":{"1min":0.41199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":655360,"data_stored":1053215,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.67600000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.746,"15min":0.746},"last":0.437},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67700000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70699999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47299999999999998},"min":{"1min":0.33100000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63600000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.42799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.34200000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.41399999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.40000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.36499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":113453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.32600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.626,"5min":0.87,"15min":0.87},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78700000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67600000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54000000000000004,"15min":0.56299999999999994},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.375},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.55200000000000005},"min":{"1min":0.36899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76100000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.33000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33800000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59999999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71999999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.40200000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.39400000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68600000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.443},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.39900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.42099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":113489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.377,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.67400000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.309},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.499,"15min":0.499},"min":{"1min":0.35099999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.255,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66500000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.56200000000000006},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.435,"5min":0.25,"15min":0.25},"max":{"1min":0.747,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.41199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.40400000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59099999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47599999999999998,"15min":0.497},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.434}]},{"osd":6,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72299999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":1.075,"15min":1.075},"last":0.60999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":663552,"data_stored":1058791,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.63600000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.375,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.498,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.28799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.40600000000000003},"min":{"1min":0.251,"5min":0.223,"15min":0.223},"max":{"1min":0.753,"5min":1.121,"15min":1.121},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67200000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.27500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.46800000000000003},"min":{"1min":0.314,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.30199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61299999999999999,"15min":0.58999999999999997},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59699999999999998,"15min":0.623},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81000000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.497}]},{"osd":7,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73199999999999998,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63,"15min":0.67300000000000004},"min":{"1min":0.41899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.50700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":290816,"data_stored":124287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.35899999999999999},"min":{"1min":0.20899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70899999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.375}]},{"osd":1,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40600000000000003,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54300000000000004,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.432,"15min":0.41199999999999998},"min":{"1min":0.27400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.437},"min":{"1min":0.33000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.437},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.438},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70499999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77100000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.627},"min":{"1min":0.46500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.82899999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76700000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.82099999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.621}]},{"osd":6,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.45600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.995,"15min":0.995},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63400000000000001,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83699999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.45100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83299999999999996,"5min":0.874,"15min":0.874},"last":0.70999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":113523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.23599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.56200000000000006,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36399999999999999,"15min":0.34799999999999998},"min":{"1min":0.23499999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.22500000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.52900000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.435,"15min":0.42299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.57499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.38800000000000001},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.308}]},{"osd":4,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.74299999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.375},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79700000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72499999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74199999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77000000000000002,"5min":0.872,"15min":0.872},"last":0.41799999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80200000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":356352,"data_stored":704369,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39900000000000002,"15min":0.42299999999999999},"min":{"1min":0.23300000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.629,"5min":1.496,"15min":1.496},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.40300000000000002},"min":{"1min":0.252,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56699999999999995,"5min":1.024,"15min":1.024},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.26900000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.76300000000000001,"5min":1.518,"15min":1.518},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.29399999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83699999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":1.294,"15min":1.294},"last":0.38},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.64800000000000002},"min":{"1min":0.439,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91500000000000004,"5min":1.198,"15min":1.198},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73899999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.69399999999999995},"min":{"1min":0.42499999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.501},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61699999999999999,"15min":0.64800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96899999999999997,"5min":1.143,"15min":1.143},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60799999999999998,"15min":0.65100000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.72699999999999998,"5min":1.391,"15min":1.391},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66100000000000003,"15min":0.72899999999999998},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84999999999999998,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67900000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.629},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63,"15min":0.68000000000000005},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.82099999999999995,"5min":1.363,"15min":1.363},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":950776,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":939852,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:50:39.343 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:50:39.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.476+0000 7f5f60f08640 1 Processor -- start 2024-09-13T18:50:39.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.476+0000 7f5f60f08640 1 -- start start 2024-09-13T18:50:39.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.477+0000 7f5f60f08640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f5c0b0cd0 0x7f5f5c070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.477+0000 7f5f60f08640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5c06eab0 con 0x7f5f5c13dc00 2024-09-13T18:50:39.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.477+0000 7f5f60f08640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5c0b10b0 con 0x7f5f5c071900 2024-09-13T18:50:39.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.477+0000 7f5f60f08640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5c06f3c0 con 0x7f5f5c0b0cd0 2024-09-13T18:50:39.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.477+0000 7f5f5a59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f5c0b0cd0 0x7f5f5c070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.477+0000 7f5f5ad9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5f5c13dc00 0x7f5f5c14e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41094/0 (socket says 172.21.15.29:41094) 2024-09-13T18:50:39.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.477+0000 7f5f5ad9d640 1 -- 172.21.15.29:0/2057236479 learned_addr learned my addr 172.21.15.29:0/2057236479 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:39.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.477+0000 7f5f5a59c640 1 -- 172.21.15.29:0/2057236479 >> v1:172.21.15.96:6789/0 conn(0x7f5f5c071900 legacy=0x7f5f5c13d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.477+0000 7f5f5a59c640 1 -- 172.21.15.29:0/2057236479 >> v1:172.21.15.29:6789/0 conn(0x7f5f5c13dc00 legacy=0x7f5f5c14e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.477+0000 7f5f5a59c640 1 -- 172.21.15.29:0/2057236479 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c0702d0 con 0x7f5f5c0b0cd0 2024-09-13T18:50:39.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.478+0000 7f5f5a59c640 1 --2- 172.21.15.29:0/2057236479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5c0b0cd0 0x7f5f5c070bb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009d90 tx=0x7f5f4c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc814ef0e8c99756 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:39.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.478+0000 7f5f5959a640 1 -- 172.21.15.29:0/2057236479 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c007740 con 0x7f5f5c0b0cd0 2024-09-13T18:50:39.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.478+0000 7f5f5959a640 1 -- 172.21.15.29:0/2057236479 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c02d050 con 0x7f5f5c0b0cd0 2024-09-13T18:50:39.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.478+0000 7f5f5959a640 1 -- 172.21.15.29:0/2057236479 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c007ac0 con 0x7f5f5c0b0cd0 2024-09-13T18:50:39.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.479+0000 7f5f60f08640 1 -- 172.21.15.29:0/2057236479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5c0b0cd0 msgr2=0x7f5f5c070bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.479+0000 7f5f60f08640 1 --2- 172.21.15.29:0/2057236479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5c0b0cd0 0x7f5f5c070bb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009d90 tx=0x7f5f4c02a660 comp rx=0 tx=0).stop 2024-09-13T18:50:39.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.479+0000 7f5f60f08640 1 -- 172.21.15.29:0/2057236479 shutdown_connections 2024-09-13T18:50:39.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.479+0000 7f5f60f08640 1 --2- 172.21.15.29:0/2057236479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5c0b0cd0 0x7f5f5c070bb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.479+0000 7f5f60f08640 1 -- 172.21.15.29:0/2057236479 >> 172.21.15.29:0/2057236479 conn(0x7f5f5c06a890 msgr2=0x7f5f5c0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:39.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.479+0000 7f5f60f08640 1 -- 172.21.15.29:0/2057236479 shutdown_connections 2024-09-13T18:50:39.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.479+0000 7f5f60f08640 1 -- 172.21.15.29:0/2057236479 wait complete. 2024-09-13T18:50:39.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.480+0000 7f5f60f08640 1 Processor -- start 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.480+0000 7f5f60f08640 1 -- start start 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f60f08640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5c071900 0x7f5f5c1dc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f60f08640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f5c0b0cd0 0x7f5f5c13e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f60f08640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f5c13dc00 0x7f5f5c13b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f60f08640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c0ae620 con 0x7f5f5c071900 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f60f08640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c1dce50 con 0x7f5f5c13dc00 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f60f08640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c1dd5f0 con 0x7f5f5c0b0cd0 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f5a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5c071900 0x7f5f5c1dc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f5a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5c071900 0x7f5f5c1dc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55898/0 (socket says 172.21.15.29:55898) 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f5a59c640 1 -- 172.21.15.29:0/26926815 learned_addr learned my addr 172.21.15.29:0/26926815 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f5ad9d640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f5c13dc00 0x7f5f5c13b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f59d9b640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f5c0b0cd0 0x7f5f5c13e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f5a59c640 1 -- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f5c0b0cd0 msgr2=0x7f5f5c13e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f5a59c640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f5c0b0cd0 0x7f5f5c13e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f5a59c640 1 -- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f5c13dc00 msgr2=0x7f5f5c13b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f5a59c640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f5c13dc00 0x7f5f5c13b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f5a59c640 1 -- 172.21.15.29:0/26926815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c009a70 con 0x7f5f5c071900 2024-09-13T18:50:39.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.481+0000 7f5f59d9b640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f5c0b0cd0 0x7f5f5c13e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:39.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.482+0000 7f5f5a59c640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5c071900 0x7f5f5c1dc910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009eb0 tx=0x7f5f4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:39.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.482+0000 7f5f4affd640 1 -- 172.21.15.29:0/26926815 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c031990 con 0x7f5f5c071900 2024-09-13T18:50:39.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.482+0000 7f5f4affd640 1 -- 172.21.15.29:0/26926815 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c031af0 con 0x7f5f5c071900 2024-09-13T18:50:39.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.482+0000 7f5f60f08640 1 -- 172.21.15.29:0/26926815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5c140f10 con 0x7f5f5c071900 2024-09-13T18:50:39.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.482+0000 7f5f4affd640 1 -- 172.21.15.29:0/26926815 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c031e80 con 0x7f5f5c071900 2024-09-13T18:50:39.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.482+0000 7f5f60f08640 1 -- 172.21.15.29:0/26926815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5c142570 con 0x7f5f5c071900 2024-09-13T18:50:39.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.483+0000 7f5f60f08640 1 -- 172.21.15.29:0/26926815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5c070bb0 con 0x7f5f5c071900 2024-09-13T18:50:39.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.483+0000 7f5f4affd640 1 -- 172.21.15.29:0/26926815 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f4c03c420 con 0x7f5f5c071900 2024-09-13T18:50:39.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.484+0000 7f5f4affd640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f3c06ac00 0x7f5f3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.484+0000 7f5f4affd640 1 -- 172.21.15.29:0/26926815 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5f4c0ab390 con 0x7f5f5c071900 2024-09-13T18:50:39.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.484+0000 7f5f59d9b640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f3c06ac00 0x7f5f3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.484+0000 7f5f59d9b640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f3c06ac00 0x7f5f3c06d0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5f50001700 tx=0x7f5f50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:39.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.488+0000 7f5f4affd640 1 -- 172.21.15.29:0/26926815 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5f4c076360 con 0x7f5f5c071900 2024-09-13T18:50:39.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.658+0000 7f5f60f08640 1 -- 172.21.15.29:0/26926815 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f5c06efe0 con 0x7f5f3c06ac00 2024-09-13T18:50:39.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.667+0000 7f5f4affd640 1 -- 172.21.15.29:0/26926815 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370430 (secure 0 0 0) 0x7f5f50001340 con 0x7f5f3c06ac00 2024-09-13T18:50:39.675 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:50:39.677 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-13T18:50:39.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.671+0000 7f5f60f08640 1 -- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f3c06ac00 msgr2=0x7f5f3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.671+0000 7f5f60f08640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f3c06ac00 0x7f5f3c06d0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5f50001700 tx=0x7f5f50009040 comp rx=0 tx=0).stop 2024-09-13T18:50:39.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.671+0000 7f5f60f08640 1 -- 172.21.15.29:0/26926815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5c071900 msgr2=0x7f5f5c1dc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.671+0000 7f5f60f08640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5c071900 0x7f5f5c1dc910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009eb0 tx=0x7f5f4c004a40 comp rx=0 tx=0).stop 2024-09-13T18:50:39.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.671+0000 7f5f60f08640 1 -- 172.21.15.29:0/26926815 shutdown_connections 2024-09-13T18:50:39.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.671+0000 7f5f60f08640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5f3c06ac00 0x7f5f3c06d0c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.671+0000 7f5f60f08640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f5c13dc00 0x7f5f5c13b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.671+0000 7f5f60f08640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f5c0b0cd0 0x7f5f5c13e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.671+0000 7f5f60f08640 1 --2- 172.21.15.29:0/26926815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5c071900 0x7f5f5c1dc910 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.671+0000 7f5f60f08640 1 -- 172.21.15.29:0/26926815 >> 172.21.15.29:0/26926815 conn(0x7f5f5c06a890 msgr2=0x7f5f5c073120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:39.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.671+0000 7f5f60f08640 1 -- 172.21.15.29:0/26926815 shutdown_connections 2024-09-13T18:50:39.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.671+0000 7f5f60f08640 1 -- 172.21.15.29:0/26926815 wait complete. 2024-09-13T18:50:39.685 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-13T18:50:37.670108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1541942,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":155,"num_read_kb":139,"num_write":430,"num_write_kb":3494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":454,"ondisk_log_size":454,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235612,"kb_used_data":3100,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739108,"statfs":{"total":773094113280,"available":772852846592,"internally_reserved":0,"allocated":3174400,"data_stored":3985440,"data_compressed":310028,"data_compressed_allocated":385024,"data_compressed_original":2588672,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28651,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":17,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003077"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.613132+0000","last_change":"2024-09-13T18:45:21.668274+0000","last_active":"2024-09-13T18:47:26.613132+0000","last_peered":"2024-09-13T18:47:26.613132+0000","last_clean":"2024-09-13T18:47:26.613132+0000","last_became_active":"2024-09-13T18:45:21.667985+0000","last_became_peered":"2024-09-13T18:45:21.667985+0000","last_unstale":"2024-09-13T18:47:26.613132+0000","last_undegraded":"2024-09-13T18:47:26.613132+0000","last_fullsized":"2024-09-13T18:47:26.613132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:45.703424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.614178+0000","last_change":"2024-09-13T18:45:22.034389+0000","last_active":"2024-09-13T18:47:26.614178+0000","last_peered":"2024-09-13T18:47:26.614178+0000","last_clean":"2024-09-13T18:47:26.614178+0000","last_became_active":"2024-09-13T18:45:22.034125+0000","last_became_peered":"2024-09-13T18:45:22.034125+0000","last_unstale":"2024-09-13T18:47:26.614178+0000","last_undegraded":"2024-09-13T18:47:26.614178+0000","last_fullsized":"2024-09-13T18:47:26.614178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617386+0000","last_change":"2024-09-13T18:45:26.253118+0000","last_active":"2024-09-13T18:47:51.617386+0000","last_peered":"2024-09-13T18:47:51.617386+0000","last_clean":"2024-09-13T18:47:51.617386+0000","last_became_active":"2024-09-13T18:45:26.252747+0000","last_became_peered":"2024-09-13T18:45:26.252747+0000","last_unstale":"2024-09-13T18:47:51.617386+0000","last_undegraded":"2024-09-13T18:47:51.617386+0000","last_fullsized":"2024-09-13T18:47:51.617386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:11.065130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.089694+0000","last_change":"2024-09-13T18:45:21.666664+0000","last_active":"2024-09-13T18:47:47.089694+0000","last_peered":"2024-09-13T18:47:47.089694+0000","last_clean":"2024-09-13T18:47:47.089694+0000","last_became_active":"2024-09-13T18:45:21.666398+0000","last_became_peered":"2024-09-13T18:45:21.666398+0000","last_unstale":"2024-09-13T18:47:47.089694+0000","last_undegraded":"2024-09-13T18:47:47.089694+0000","last_fullsized":"2024-09-13T18:47:47.089694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:06.210838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.613875+0000","last_change":"2024-09-13T18:45:22.024774+0000","last_active":"2024-09-13T18:47:31.613875+0000","last_peered":"2024-09-13T18:47:31.613875+0000","last_clean":"2024-09-13T18:47:31.613875+0000","last_became_active":"2024-09-13T18:45:22.024424+0000","last_became_peered":"2024-09-13T18:45:22.024424+0000","last_unstale":"2024-09-13T18:47:31.613875+0000","last_undegraded":"2024-09-13T18:47:31.613875+0000","last_fullsized":"2024-09-13T18:47:31.613875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616742+0000","last_change":"2024-09-13T18:45:26.050411+0000","last_active":"2024-09-13T18:47:51.616742+0000","last_peered":"2024-09-13T18:47:51.616742+0000","last_clean":"2024-09-13T18:47:51.616742+0000","last_became_active":"2024-09-13T18:45:26.049414+0000","last_became_peered":"2024-09-13T18:45:26.049414+0000","last_unstale":"2024-09-13T18:47:51.616742+0000","last_undegraded":"2024-09-13T18:47:51.616742+0000","last_fullsized":"2024-09-13T18:47:51.616742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616880+0000","last_change":"2024-09-13T18:45:21.667928+0000","last_active":"2024-09-13T18:47:51.616880+0000","last_peered":"2024-09-13T18:47:51.616880+0000","last_clean":"2024-09-13T18:47:51.616880+0000","last_became_active":"2024-09-13T18:45:21.667602+0000","last_became_peered":"2024-09-13T18:45:21.667602+0000","last_unstale":"2024-09-13T18:47:51.616880+0000","last_undegraded":"2024-09-13T18:47:51.616880+0000","last_fullsized":"2024-09-13T18:47:51.616880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:53.936326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617756+0000","last_change":"2024-09-13T18:45:22.036952+0000","last_active":"2024-09-13T18:47:56.617756+0000","last_peered":"2024-09-13T18:47:56.617756+0000","last_clean":"2024-09-13T18:47:56.617756+0000","last_became_active":"2024-09-13T18:45:22.035790+0000","last_became_peered":"2024-09-13T18:45:22.035790+0000","last_unstale":"2024-09-13T18:47:56.617756+0000","last_undegraded":"2024-09-13T18:47:56.617756+0000","last_fullsized":"2024-09-13T18:47:56.617756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617541+0000","last_change":"2024-09-13T18:45:26.052333+0000","last_active":"2024-09-13T18:47:56.617541+0000","last_peered":"2024-09-13T18:47:56.617541+0000","last_clean":"2024-09-13T18:47:56.617541+0000","last_became_active":"2024-09-13T18:45:26.051873+0000","last_became_peered":"2024-09-13T18:45:26.051873+0000","last_unstale":"2024-09-13T18:47:56.617541+0000","last_undegraded":"2024-09-13T18:47:56.617541+0000","last_fullsized":"2024-09-13T18:47:56.617541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:03.925946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:37.145855+0000","last_change":"2024-09-13T18:45:21.669914+0000","last_active":"2024-09-13T18:49:37.145855+0000","last_peered":"2024-09-13T18:49:37.145855+0000","last_clean":"2024-09-13T18:49:37.145855+0000","last_became_active":"2024-09-13T18:45:21.669622+0000","last_became_peered":"2024-09-13T18:45:21.669622+0000","last_unstale":"2024-09-13T18:49:37.145855+0000","last_undegraded":"2024-09-13T18:49:37.145855+0000","last_fullsized":"2024-09-13T18:49:37.145855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.765670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617780+0000","last_change":"2024-09-13T18:45:22.035675+0000","last_active":"2024-09-13T18:47:56.617780+0000","last_peered":"2024-09-13T18:47:56.617780+0000","last_clean":"2024-09-13T18:47:56.617780+0000","last_became_active":"2024-09-13T18:45:22.034431+0000","last_became_peered":"2024-09-13T18:45:22.034431+0000","last_unstale":"2024-09-13T18:47:56.617780+0000","last_undegraded":"2024-09-13T18:47:56.617780+0000","last_fullsized":"2024-09-13T18:47:56.617780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617499+0000","last_change":"2024-09-13T18:45:26.052892+0000","last_active":"2024-09-13T18:47:56.617499+0000","last_peered":"2024-09-13T18:47:56.617499+0000","last_clean":"2024-09-13T18:47:56.617499+0000","last_became_active":"2024-09-13T18:45:26.052441+0000","last_became_peered":"2024-09-13T18:45:26.052441+0000","last_unstale":"2024-09-13T18:47:56.617499+0000","last_undegraded":"2024-09-13T18:47:56.617499+0000","last_fullsized":"2024-09-13T18:47:56.617499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:26.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.616424+0000","last_change":"2024-09-13T18:45:22.017741+0000","last_active":"2024-09-13T18:47:36.616424+0000","last_peered":"2024-09-13T18:47:36.616424+0000","last_clean":"2024-09-13T18:47:36.616424+0000","last_became_active":"2024-09-13T18:45:22.015758+0000","last_became_peered":"2024-09-13T18:45:22.015758+0000","last_unstale":"2024-09-13T18:47:36.616424+0000","last_undegraded":"2024-09-13T18:47:36.616424+0000","last_fullsized":"2024-09-13T18:47:36.616424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.103891+0000","last_change":"2024-09-13T18:45:21.672627+0000","last_active":"2024-09-13T18:48:12.103891+0000","last_peered":"2024-09-13T18:48:12.103891+0000","last_clean":"2024-09-13T18:48:12.103891+0000","last_became_active":"2024-09-13T18:45:21.672388+0000","last_became_peered":"2024-09-13T18:45:21.672388+0000","last_unstale":"2024-09-13T18:48:12.103891+0000","last_undegraded":"2024-09-13T18:48:12.103891+0000","last_fullsized":"2024-09-13T18:48:12.103891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615702+0000","last_change":"2024-09-13T18:46:11.150163+0000","last_active":"2024-09-13T18:47:41.615702+0000","last_peered":"2024-09-13T18:47:41.615702+0000","last_clean":"2024-09-13T18:47:41.615702+0000","last_became_active":"2024-09-13T18:46:11.149623+0000","last_became_peered":"2024-09-13T18:46:11.149623+0000","last_unstale":"2024-09-13T18:47:41.615702+0000","last_undegraded":"2024-09-13T18:47:41.615702+0000","last_fullsized":"2024-09-13T18:47:41.615702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:18.721386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.616049+0000","last_change":"2024-09-13T18:45:22.028858+0000","last_active":"2024-09-13T18:47:41.616049+0000","last_peered":"2024-09-13T18:47:41.616049+0000","last_clean":"2024-09-13T18:47:41.616049+0000","last_became_active":"2024-09-13T18:45:22.028336+0000","last_became_peered":"2024-09-13T18:45:22.028336+0000","last_unstale":"2024-09-13T18:47:41.616049+0000","last_undegraded":"2024-09-13T18:47:41.616049+0000","last_fullsized":"2024-09-13T18:47:41.616049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.618669+0000","last_change":"2024-09-13T18:45:21.667983+0000","last_active":"2024-09-13T18:47:31.618669+0000","last_peered":"2024-09-13T18:47:31.618669+0000","last_clean":"2024-09-13T18:47:31.618669+0000","last_became_active":"2024-09-13T18:45:21.667625+0000","last_became_peered":"2024-09-13T18:45:21.667625+0000","last_unstale":"2024-09-13T18:47:31.618669+0000","last_undegraded":"2024-09-13T18:47:31.618669+0000","last_fullsized":"2024-09-13T18:47:31.618669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615662+0000","last_change":"2024-09-13T18:45:26.050576+0000","last_active":"2024-09-13T18:47:41.615662+0000","last_peered":"2024-09-13T18:47:41.615662+0000","last_clean":"2024-09-13T18:47:41.615662+0000","last_became_active":"2024-09-13T18:45:26.049129+0000","last_became_peered":"2024-09-13T18:45:26.049129+0000","last_unstale":"2024-09-13T18:47:41.615662+0000","last_undegraded":"2024-09-13T18:47:41.615662+0000","last_fullsized":"2024-09-13T18:47:41.615662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:21.620581+0000","last_change":"2024-09-13T18:46:11.149400+0000","last_active":"2024-09-13T18:48:21.620581+0000","last_peered":"2024-09-13T18:48:21.620581+0000","last_clean":"2024-09-13T18:48:21.620581+0000","last_became_active":"2024-09-13T18:46:11.149036+0000","last_became_peered":"2024-09-13T18:46:11.149036+0000","last_unstale":"2024-09-13T18:48:21.620581+0000","last_undegraded":"2024-09-13T18:48:21.620581+0000","last_fullsized":"2024-09-13T18:48:21.620581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:06.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.104292+0000","last_change":"2024-09-13T18:45:21.668525+0000","last_active":"2024-09-13T18:48:12.104292+0000","last_peered":"2024-09-13T18:48:12.104292+0000","last_clean":"2024-09-13T18:48:12.104292+0000","last_became_active":"2024-09-13T18:45:21.668242+0000","last_became_peered":"2024-09-13T18:45:21.668242+0000","last_unstale":"2024-09-13T18:48:12.104292+0000","last_undegraded":"2024-09-13T18:48:12.104292+0000","last_fullsized":"2024-09-13T18:48:12.104292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.620048+0000","last_change":"2024-09-13T18:45:26.255263+0000","last_active":"2024-09-13T18:47:41.620048+0000","last_peered":"2024-09-13T18:47:41.620048+0000","last_clean":"2024-09-13T18:47:41.620048+0000","last_became_active":"2024-09-13T18:45:26.254886+0000","last_became_peered":"2024-09-13T18:45:26.254886+0000","last_unstale":"2024-09-13T18:47:41.620048+0000","last_undegraded":"2024-09-13T18:47:41.620048+0000","last_fullsized":"2024-09-13T18:47:41.620048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614954+0000","last_change":"2024-09-13T18:45:22.029624+0000","last_active":"2024-09-13T18:47:36.614954+0000","last_peered":"2024-09-13T18:47:36.614954+0000","last_clean":"2024-09-13T18:47:36.614954+0000","last_became_active":"2024-09-13T18:45:22.027835+0000","last_became_peered":"2024-09-13T18:45:22.027835+0000","last_unstale":"2024-09-13T18:47:36.614954+0000","last_undegraded":"2024-09-13T18:47:36.614954+0000","last_fullsized":"2024-09-13T18:47:36.614954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:16.317986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.107659+0000","last_change":"2024-09-13T18:45:21.669073+0000","last_active":"2024-09-13T18:48:17.107659+0000","last_peered":"2024-09-13T18:48:17.107659+0000","last_clean":"2024-09-13T18:48:17.107659+0000","last_became_active":"2024-09-13T18:45:21.668765+0000","last_became_peered":"2024-09-13T18:45:21.668765+0000","last_unstale":"2024-09-13T18:48:17.107659+0000","last_undegraded":"2024-09-13T18:48:17.107659+0000","last_fullsized":"2024-09-13T18:48:17.107659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615720+0000","last_change":"2024-09-13T18:45:26.050623+0000","last_active":"2024-09-13T18:47:41.615720+0000","last_peered":"2024-09-13T18:47:41.615720+0000","last_clean":"2024-09-13T18:47:41.615720+0000","last_became_active":"2024-09-13T18:45:26.049408+0000","last_became_peered":"2024-09-13T18:45:26.049408+0000","last_unstale":"2024-09-13T18:47:41.615720+0000","last_undegraded":"2024-09-13T18:47:41.615720+0000","last_fullsized":"2024-09-13T18:47:41.615720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:14.574386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614490+0000","last_change":"2024-09-13T18:45:22.022220+0000","last_active":"2024-09-13T18:47:36.614490+0000","last_peered":"2024-09-13T18:47:36.614490+0000","last_clean":"2024-09-13T18:47:36.614490+0000","last_became_active":"2024-09-13T18:45:22.021976+0000","last_became_peered":"2024-09-13T18:45:22.021976+0000","last_unstale":"2024-09-13T18:47:36.614490+0000","last_undegraded":"2024-09-13T18:47:36.614490+0000","last_fullsized":"2024-09-13T18:47:36.614490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:32.113775+0000","last_change":"2024-09-13T18:45:21.667931+0000","last_active":"2024-09-13T18:48:32.113775+0000","last_peered":"2024-09-13T18:48:32.113775+0000","last_clean":"2024-09-13T18:48:32.113775+0000","last_became_active":"2024-09-13T18:45:21.667680+0000","last_became_peered":"2024-09-13T18:45:21.667680+0000","last_unstale":"2024-09-13T18:48:32.113775+0000","last_undegraded":"2024-09-13T18:48:32.113775+0000","last_fullsized":"2024-09-13T18:48:32.113775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614135+0000","last_change":"2024-09-13T18:45:26.255088+0000","last_active":"2024-09-13T18:47:31.614135+0000","last_peered":"2024-09-13T18:47:31.614135+0000","last_clean":"2024-09-13T18:47:31.614135+0000","last_became_active":"2024-09-13T18:45:26.254662+0000","last_became_peered":"2024-09-13T18:45:26.254662+0000","last_unstale":"2024-09-13T18:47:31.614135+0000","last_undegraded":"2024-09-13T18:47:31.614135+0000","last_fullsized":"2024-09-13T18:47:31.614135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615555+0000","last_change":"2024-09-13T18:45:22.026678+0000","last_active":"2024-09-13T18:47:36.615555+0000","last_peered":"2024-09-13T18:47:36.615555+0000","last_clean":"2024-09-13T18:47:36.615555+0000","last_became_active":"2024-09-13T18:45:22.026419+0000","last_became_peered":"2024-09-13T18:45:22.026419+0000","last_unstale":"2024-09-13T18:47:36.615555+0000","last_undegraded":"2024-09-13T18:47:36.615555+0000","last_fullsized":"2024-09-13T18:47:36.615555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'36","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:35.985799+0000","last_change":"2024-09-13T18:45:21.664622+0000","last_active":"2024-09-13T18:50:35.985799+0000","last_peered":"2024-09-13T18:50:35.985799+0000","last_clean":"2024-09-13T18:50:35.985799+0000","last_became_active":"2024-09-13T18:45:21.664066+0000","last_became_peered":"2024-09-13T18:45:21.664066+0000","last_unstale":"2024-09-13T18:50:35.985799+0000","last_undegraded":"2024-09-13T18:50:35.985799+0000","last_fullsized":"2024-09-13T18:50:35.985799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.614068+0000","last_change":"2024-09-13T18:45:26.253888+0000","last_active":"2024-09-13T18:47:26.614068+0000","last_peered":"2024-09-13T18:47:26.614068+0000","last_clean":"2024-09-13T18:47:26.614068+0000","last_became_active":"2024-09-13T18:45:26.253488+0000","last_became_peered":"2024-09-13T18:45:26.253488+0000","last_unstale":"2024-09-13T18:47:26.614068+0000","last_undegraded":"2024-09-13T18:47:26.614068+0000","last_fullsized":"2024-09-13T18:47:26.614068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:44.826493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:36.633429+0000","last_change":"2024-09-13T18:45:22.022940+0000","last_active":"2024-09-13T18:49:36.633429+0000","last_peered":"2024-09-13T18:49:36.633429+0000","last_clean":"2024-09-13T18:49:36.633429+0000","last_became_active":"2024-09-13T18:45:22.022628+0000","last_became_peered":"2024-09-13T18:45:22.022628+0000","last_unstale":"2024-09-13T18:49:36.633429+0000","last_undegraded":"2024-09-13T18:49:36.633429+0000","last_fullsized":"2024-09-13T18:49:36.633429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.085981+0000","last_change":"2024-09-13T18:45:21.668903+0000","last_active":"2024-09-13T18:47:42.085981+0000","last_peered":"2024-09-13T18:47:42.085981+0000","last_clean":"2024-09-13T18:47:42.085981+0000","last_became_active":"2024-09-13T18:45:21.668645+0000","last_became_peered":"2024-09-13T18:45:21.668645+0000","last_unstale":"2024-09-13T18:47:42.085981+0000","last_undegraded":"2024-09-13T18:47:42.085981+0000","last_fullsized":"2024-09-13T18:47:42.085981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:33.143804+0000","last_change":"2024-09-13T18:46:11.658745+0000","last_active":"2024-09-13T18:49:33.143804+0000","last_peered":"2024-09-13T18:49:33.143804+0000","last_clean":"2024-09-13T18:49:33.143804+0000","last_became_active":"2024-09-13T18:46:11.658190+0000","last_became_peered":"2024-09-13T18:46:11.658190+0000","last_unstale":"2024-09-13T18:49:33.143804+0000","last_undegraded":"2024-09-13T18:49:33.143804+0000","last_fullsized":"2024-09-13T18:49:33.143804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:44.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:16.619888+0000","last_change":"2024-09-13T18:46:11.145972+0000","last_active":"2024-09-13T18:48:16.619888+0000","last_peered":"2024-09-13T18:48:16.619888+0000","last_clean":"2024-09-13T18:48:16.619888+0000","last_became_active":"2024-09-13T18:46:11.145524+0000","last_became_peered":"2024-09-13T18:46:11.145524+0000","last_unstale":"2024-09-13T18:48:16.619888+0000","last_undegraded":"2024-09-13T18:48:16.619888+0000","last_fullsized":"2024-09-13T18:48:16.619888+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:45.878704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.617963+0000","last_change":"2024-09-13T18:45:21.661117+0000","last_active":"2024-09-13T18:47:26.617963+0000","last_peered":"2024-09-13T18:47:26.617963+0000","last_clean":"2024-09-13T18:47:26.617963+0000","last_became_active":"2024-09-13T18:45:21.660577+0000","last_became_peered":"2024-09-13T18:45:21.660577+0000","last_unstale":"2024-09-13T18:47:26.617963+0000","last_undegraded":"2024-09-13T18:47:26.617963+0000","last_fullsized":"2024-09-13T18:47:26.617963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.618646+0000","last_change":"2024-09-13T18:45:26.056021+0000","last_active":"2024-09-13T18:47:31.618646+0000","last_peered":"2024-09-13T18:47:31.618646+0000","last_clean":"2024-09-13T18:47:31.618646+0000","last_became_active":"2024-09-13T18:45:26.053877+0000","last_became_peered":"2024-09-13T18:45:26.053877+0000","last_unstale":"2024-09-13T18:47:31.618646+0000","last_undegraded":"2024-09-13T18:47:31.618646+0000","last_fullsized":"2024-09-13T18:47:31.618646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:51.489422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:33.143704+0000","last_change":"2024-09-13T18:45:22.029936+0000","last_active":"2024-09-13T18:49:33.143704+0000","last_peered":"2024-09-13T18:49:33.143704+0000","last_clean":"2024-09-13T18:49:33.143704+0000","last_became_active":"2024-09-13T18:45:22.028714+0000","last_became_peered":"2024-09-13T18:45:22.028714+0000","last_unstale":"2024-09-13T18:49:33.143704+0000","last_undegraded":"2024-09-13T18:49:33.143704+0000","last_fullsized":"2024-09-13T18:49:33.143704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:35.746368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:52.092714+0000","last_change":"2024-09-13T18:45:21.667926+0000","last_active":"2024-09-13T18:47:52.092714+0000","last_peered":"2024-09-13T18:47:52.092714+0000","last_clean":"2024-09-13T18:47:52.092714+0000","last_became_active":"2024-09-13T18:45:21.667320+0000","last_became_peered":"2024-09-13T18:45:21.667320+0000","last_unstale":"2024-09-13T18:47:52.092714+0000","last_undegraded":"2024-09-13T18:47:52.092714+0000","last_fullsized":"2024-09-13T18:47:52.092714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:33.926106+0000","last_change":"2024-09-13T18:46:11.148369+0000","last_active":"2024-09-13T18:50:33.926106+0000","last_peered":"2024-09-13T18:50:33.926106+0000","last_clean":"2024-09-13T18:50:33.926106+0000","last_became_active":"2024-09-13T18:46:11.147801+0000","last_became_peered":"2024-09-13T18:46:11.147801+0000","last_unstale":"2024-09-13T18:50:33.926106+0000","last_undegraded":"2024-09-13T18:50:33.926106+0000","last_fullsized":"2024-09-13T18:50:33.926106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:54.923780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.617879+0000","last_change":"2024-09-13T18:45:22.023623+0000","last_active":"2024-09-13T18:47:26.617879+0000","last_peered":"2024-09-13T18:47:26.617879+0000","last_clean":"2024-09-13T18:47:26.617879+0000","last_became_active":"2024-09-13T18:45:22.023357+0000","last_became_peered":"2024-09-13T18:45:22.023357+0000","last_unstale":"2024-09-13T18:47:26.617879+0000","last_undegraded":"2024-09-13T18:47:26.617879+0000","last_fullsized":"2024-09-13T18:47:26.617879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'45","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:36.172250+0000","last_change":"2024-09-13T18:45:21.668065+0000","last_active":"2024-09-13T18:50:36.172250+0000","last_peered":"2024-09-13T18:50:36.172250+0000","last_clean":"2024-09-13T18:50:36.172250+0000","last_became_active":"2024-09-13T18:45:21.667768+0000","last_became_peered":"2024-09-13T18:45:21.667768+0000","last_unstale":"2024-09-13T18:50:36.172250+0000","last_undegraded":"2024-09-13T18:50:36.172250+0000","last_fullsized":"2024-09-13T18:50:36.172250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10924,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":39,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.619282+0000","last_change":"2024-09-13T18:45:26.057274+0000","last_active":"2024-09-13T18:47:36.619282+0000","last_peered":"2024-09-13T18:47:36.619282+0000","last_clean":"2024-09-13T18:47:36.619282+0000","last_became_active":"2024-09-13T18:45:26.056850+0000","last_became_peered":"2024-09-13T18:45:26.056850+0000","last_unstale":"2024-09-13T18:47:36.619282+0000","last_undegraded":"2024-09-13T18:47:36.619282+0000","last_fullsized":"2024-09-13T18:47:36.619282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.971516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.613727+0000","last_change":"2024-09-13T18:45:22.020577+0000","last_active":"2024-09-13T18:47:31.613727+0000","last_peered":"2024-09-13T18:47:31.613727+0000","last_clean":"2024-09-13T18:47:31.613727+0000","last_became_active":"2024-09-13T18:45:22.020317+0000","last_became_peered":"2024-09-13T18:45:22.020317+0000","last_unstale":"2024-09-13T18:47:31.613727+0000","last_undegraded":"2024-09-13T18:47:31.613727+0000","last_fullsized":"2024-09-13T18:47:31.613727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112381+0000","last_change":"2024-09-13T18:45:21.667753+0000","last_active":"2024-09-13T18:48:27.112381+0000","last_peered":"2024-09-13T18:48:27.112381+0000","last_clean":"2024-09-13T18:48:27.112381+0000","last_became_active":"2024-09-13T18:45:21.667483+0000","last_became_peered":"2024-09-13T18:45:21.667483+0000","last_unstale":"2024-09-13T18:48:27.112381+0000","last_undegraded":"2024-09-13T18:48:27.112381+0000","last_fullsized":"2024-09-13T18:48:27.112381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:22.171336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614460+0000","last_change":"2024-09-13T18:45:26.254703+0000","last_active":"2024-09-13T18:47:36.614460+0000","last_peered":"2024-09-13T18:47:36.614460+0000","last_clean":"2024-09-13T18:47:36.614460+0000","last_became_active":"2024-09-13T18:45:26.253533+0000","last_became_peered":"2024-09-13T18:45:26.253533+0000","last_unstale":"2024-09-13T18:47:36.614460+0000","last_undegraded":"2024-09-13T18:47:36.614460+0000","last_fullsized":"2024-09-13T18:47:36.614460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614845+0000","last_change":"2024-09-13T18:45:22.032365+0000","last_active":"2024-09-13T18:47:31.614845+0000","last_peered":"2024-09-13T18:47:31.614845+0000","last_clean":"2024-09-13T18:47:31.614845+0000","last_became_active":"2024-09-13T18:45:22.032109+0000","last_became_peered":"2024-09-13T18:45:22.032109+0000","last_unstale":"2024-09-13T18:47:31.614845+0000","last_undegraded":"2024-09-13T18:47:31.614845+0000","last_fullsized":"2024-09-13T18:47:31.614845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.110221+0000","last_change":"2024-09-13T18:45:21.662636+0000","last_active":"2024-09-13T18:48:22.110221+0000","last_peered":"2024-09-13T18:48:22.110221+0000","last_clean":"2024-09-13T18:48:22.110221+0000","last_became_active":"2024-09-13T18:45:21.662344+0000","last_became_peered":"2024-09-13T18:45:21.662344+0000","last_unstale":"2024-09-13T18:48:22.110221+0000","last_undegraded":"2024-09-13T18:48:22.110221+0000","last_fullsized":"2024-09-13T18:48:22.110221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:21.613035+0000","last_change":"2024-09-13T18:45:19.778048+0000","last_active":"2024-09-13T18:47:21.613035+0000","last_peered":"2024-09-13T18:47:21.613035+0000","last_clean":"2024-09-13T18:47:21.613035+0000","last_became_active":"2024-09-13T18:45:19.777172+0000","last_became_peered":"2024-09-13T18:45:19.777172+0000","last_unstale":"2024-09-13T18:47:21.613035+0000","last_undegraded":"2024-09-13T18:47:21.613035+0000","last_fullsized":"2024-09-13T18:47:21.613035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_clean_scrub_stamp":"2024-09-13T18:45:17.981407+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:51.905955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615939+0000","last_change":"2024-09-13T18:45:26.253260+0000","last_active":"2024-09-13T18:47:31.615939+0000","last_peered":"2024-09-13T18:47:31.615939+0000","last_clean":"2024-09-13T18:47:31.615939+0000","last_became_active":"2024-09-13T18:45:26.252890+0000","last_became_peered":"2024-09-13T18:45:26.252890+0000","last_unstale":"2024-09-13T18:47:31.615939+0000","last_undegraded":"2024-09-13T18:47:31.615939+0000","last_fullsized":"2024-09-13T18:47:31.615939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615655+0000","last_change":"2024-09-13T18:45:22.036446+0000","last_active":"2024-09-13T18:47:41.615655+0000","last_peered":"2024-09-13T18:47:41.615655+0000","last_clean":"2024-09-13T18:47:41.615655+0000","last_became_active":"2024-09-13T18:45:22.036153+0000","last_became_peered":"2024-09-13T18:45:22.036153+0000","last_unstale":"2024-09-13T18:47:41.615655+0000","last_undegraded":"2024-09-13T18:47:41.615655+0000","last_fullsized":"2024-09-13T18:47:41.615655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:51.629396+0000","last_change":"2024-09-13T18:45:21.665847+0000","last_active":"2024-09-13T18:49:51.629396+0000","last_peered":"2024-09-13T18:49:51.629396+0000","last_clean":"2024-09-13T18:49:51.629396+0000","last_became_active":"2024-09-13T18:45:21.665582+0000","last_became_peered":"2024-09-13T18:45:21.665582+0000","last_unstale":"2024-09-13T18:49:51.629396+0000","last_undegraded":"2024-09-13T18:49:51.629396+0000","last_fullsized":"2024-09-13T18:49:51.629396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.616410+0000","last_change":"2024-09-13T18:45:26.250391+0000","last_active":"2024-09-13T18:47:36.616410+0000","last_peered":"2024-09-13T18:47:36.616410+0000","last_clean":"2024-09-13T18:47:36.616410+0000","last_became_active":"2024-09-13T18:45:26.249986+0000","last_became_peered":"2024-09-13T18:45:26.249986+0000","last_unstale":"2024-09-13T18:47:36.616410+0000","last_undegraded":"2024-09-13T18:47:36.616410+0000","last_fullsized":"2024-09-13T18:47:36.616410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.616039+0000","last_change":"2024-09-13T18:45:22.037142+0000","last_active":"2024-09-13T18:47:41.616039+0000","last_peered":"2024-09-13T18:47:41.616039+0000","last_clean":"2024-09-13T18:47:41.616039+0000","last_became_active":"2024-09-13T18:45:22.036523+0000","last_became_peered":"2024-09-13T18:45:22.036523+0000","last_unstale":"2024-09-13T18:47:41.616039+0000","last_undegraded":"2024-09-13T18:47:41.616039+0000","last_fullsized":"2024-09-13T18:47:41.616039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.109845+0000","last_change":"2024-09-13T18:45:21.662924+0000","last_active":"2024-09-13T18:48:22.109845+0000","last_peered":"2024-09-13T18:48:22.109845+0000","last_clean":"2024-09-13T18:48:22.109845+0000","last_became_active":"2024-09-13T18:45:21.662405+0000","last_became_peered":"2024-09-13T18:45:21.662405+0000","last_unstale":"2024-09-13T18:48:22.109845+0000","last_undegraded":"2024-09-13T18:48:22.109845+0000","last_fullsized":"2024-09-13T18:48:22.109845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615002+0000","last_change":"2024-09-13T18:45:26.055309+0000","last_active":"2024-09-13T18:47:41.615002+0000","last_peered":"2024-09-13T18:47:41.615002+0000","last_clean":"2024-09-13T18:47:41.615002+0000","last_became_active":"2024-09-13T18:45:26.054449+0000","last_became_peered":"2024-09-13T18:45:26.054449+0000","last_unstale":"2024-09-13T18:47:41.615002+0000","last_undegraded":"2024-09-13T18:47:41.615002+0000","last_fullsized":"2024-09-13T18:47:41.615002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:46:11.610070+0000","last_change":"2024-09-13T18:46:11.150958+0000","last_active":"2024-09-13T18:46:11.610070+0000","last_peered":"2024-09-13T18:46:11.610070+0000","last_clean":"2024-09-13T18:46:11.610070+0000","last_became_active":"2024-09-13T18:46:11.150605+0000","last_became_peered":"2024-09-13T18:46:11.150605+0000","last_unstale":"2024-09-13T18:46:11.610070+0000","last_undegraded":"2024-09-13T18:46:11.610070+0000","last_fullsized":"2024-09-13T18:46:11.610070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:51.536838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.107379+0000","last_change":"2024-09-13T18:45:21.667622+0000","last_active":"2024-09-13T18:48:17.107379+0000","last_peered":"2024-09-13T18:48:17.107379+0000","last_clean":"2024-09-13T18:48:17.107379+0000","last_became_active":"2024-09-13T18:45:21.667340+0000","last_became_peered":"2024-09-13T18:45:21.667340+0000","last_unstale":"2024-09-13T18:48:17.107379+0000","last_undegraded":"2024-09-13T18:48:17.107379+0000","last_fullsized":"2024-09-13T18:48:17.107379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615280+0000","last_change":"2024-09-13T18:45:26.250450+0000","last_active":"2024-09-13T18:47:36.615280+0000","last_peered":"2024-09-13T18:47:36.615280+0000","last_clean":"2024-09-13T18:47:36.615280+0000","last_became_active":"2024-09-13T18:45:26.250020+0000","last_became_peered":"2024-09-13T18:45:26.250020+0000","last_unstale":"2024-09-13T18:47:36.615280+0000","last_undegraded":"2024-09-13T18:47:36.615280+0000","last_fullsized":"2024-09-13T18:47:36.615280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:46.567482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615721+0000","last_change":"2024-09-13T18:45:22.030584+0000","last_active":"2024-09-13T18:47:41.615721+0000","last_peered":"2024-09-13T18:47:41.615721+0000","last_clean":"2024-09-13T18:47:41.615721+0000","last_became_active":"2024-09-13T18:45:22.030275+0000","last_became_peered":"2024-09-13T18:45:22.030275+0000","last_unstale":"2024-09-13T18:47:41.615721+0000","last_undegraded":"2024-09-13T18:47:41.615721+0000","last_fullsized":"2024-09-13T18:47:41.615721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112091+0000","last_change":"2024-09-13T18:45:21.662490+0000","last_active":"2024-09-13T18:48:27.112091+0000","last_peered":"2024-09-13T18:48:27.112091+0000","last_clean":"2024-09-13T18:48:27.112091+0000","last_became_active":"2024-09-13T18:45:21.662210+0000","last_became_peered":"2024-09-13T18:45:21.662210+0000","last_unstale":"2024-09-13T18:48:27.112091+0000","last_undegraded":"2024-09-13T18:48:27.112091+0000","last_fullsized":"2024-09-13T18:48:27.112091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614925+0000","last_change":"2024-09-13T18:45:26.053575+0000","last_active":"2024-09-13T18:47:36.614925+0000","last_peered":"2024-09-13T18:47:36.614925+0000","last_clean":"2024-09-13T18:47:36.614925+0000","last_became_active":"2024-09-13T18:45:26.053195+0000","last_became_peered":"2024-09-13T18:45:26.053195+0000","last_unstale":"2024-09-13T18:47:36.614925+0000","last_undegraded":"2024-09-13T18:47:36.614925+0000","last_fullsized":"2024-09-13T18:47:36.614925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:28.745002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616177+0000","last_change":"2024-09-13T18:45:22.031817+0000","last_active":"2024-09-13T18:47:46.616177+0000","last_peered":"2024-09-13T18:47:46.616177+0000","last_clean":"2024-09-13T18:47:46.616177+0000","last_became_active":"2024-09-13T18:45:22.031312+0000","last_became_peered":"2024-09-13T18:45:22.031312+0000","last_unstale":"2024-09-13T18:47:46.616177+0000","last_undegraded":"2024-09-13T18:47:46.616177+0000","last_fullsized":"2024-09-13T18:47:46.616177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'11","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.111725+0000","last_change":"2024-09-13T18:45:21.655353+0000","last_active":"2024-09-13T18:48:27.111725+0000","last_peered":"2024-09-13T18:48:27.111725+0000","last_clean":"2024-09-13T18:48:27.111725+0000","last_became_active":"2024-09-13T18:45:21.654844+0000","last_became_peered":"2024-09-13T18:45:21.654844+0000","last_unstale":"2024-09-13T18:48:27.111725+0000","last_undegraded":"2024-09-13T18:48:27.111725+0000","last_fullsized":"2024-09-13T18:48:27.111725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616249+0000","last_change":"2024-09-13T18:45:26.056440+0000","last_active":"2024-09-13T18:47:51.616249+0000","last_peered":"2024-09-13T18:47:51.616249+0000","last_clean":"2024-09-13T18:47:51.616249+0000","last_became_active":"2024-09-13T18:45:26.055955+0000","last_became_peered":"2024-09-13T18:45:26.055955+0000","last_unstale":"2024-09-13T18:47:51.616249+0000","last_undegraded":"2024-09-13T18:47:51.616249+0000","last_fullsized":"2024-09-13T18:47:51.616249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:38.309349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.617402+0000","last_change":"2024-09-13T18:45:22.027821+0000","last_active":"2024-09-13T18:47:46.617402+0000","last_peered":"2024-09-13T18:47:46.617402+0000","last_clean":"2024-09-13T18:47:46.617402+0000","last_became_active":"2024-09-13T18:45:22.027172+0000","last_became_peered":"2024-09-13T18:45:22.027172+0000","last_unstale":"2024-09-13T18:47:46.617402+0000","last_undegraded":"2024-09-13T18:47:46.617402+0000","last_fullsized":"2024-09-13T18:47:46.617402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.107256+0000","last_change":"2024-09-13T18:45:21.664084+0000","last_active":"2024-09-13T18:48:17.107256+0000","last_peered":"2024-09-13T18:48:17.107256+0000","last_clean":"2024-09-13T18:48:17.107256+0000","last_became_active":"2024-09-13T18:45:21.663746+0000","last_became_peered":"2024-09-13T18:45:21.663746+0000","last_unstale":"2024-09-13T18:48:17.107256+0000","last_undegraded":"2024-09-13T18:48:17.107256+0000","last_fullsized":"2024-09-13T18:48:17.107256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617500+0000","last_change":"2024-09-13T18:45:26.253221+0000","last_active":"2024-09-13T18:47:51.617500+0000","last_peered":"2024-09-13T18:47:51.617500+0000","last_clean":"2024-09-13T18:47:51.617500+0000","last_became_active":"2024-09-13T18:45:26.252841+0000","last_became_peered":"2024-09-13T18:45:26.252841+0000","last_unstale":"2024-09-13T18:47:51.617500+0000","last_undegraded":"2024-09-13T18:47:51.617500+0000","last_fullsized":"2024-09-13T18:47:51.617500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:26.396713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616212+0000","last_change":"2024-09-13T18:45:22.033554+0000","last_active":"2024-09-13T18:47:46.616212+0000","last_peered":"2024-09-13T18:47:46.616212+0000","last_clean":"2024-09-13T18:47:46.616212+0000","last_became_active":"2024-09-13T18:45:22.032862+0000","last_became_peered":"2024-09-13T18:45:22.032862+0000","last_unstale":"2024-09-13T18:47:46.616212+0000","last_undegraded":"2024-09-13T18:47:46.616212+0000","last_fullsized":"2024-09-13T18:47:46.616212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'8","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112563+0000","last_change":"2024-09-13T18:45:21.668025+0000","last_active":"2024-09-13T18:48:27.112563+0000","last_peered":"2024-09-13T18:48:27.112563+0000","last_clean":"2024-09-13T18:48:27.112563+0000","last_became_active":"2024-09-13T18:45:21.667457+0000","last_became_peered":"2024-09-13T18:45:21.667457+0000","last_unstale":"2024-09-13T18:48:27.112563+0000","last_undegraded":"2024-09-13T18:48:27.112563+0000","last_fullsized":"2024-09-13T18:48:27.112563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616601+0000","last_change":"2024-09-13T18:45:26.250464+0000","last_active":"2024-09-13T18:47:46.616601+0000","last_peered":"2024-09-13T18:47:46.616601+0000","last_clean":"2024-09-13T18:47:46.616601+0000","last_became_active":"2024-09-13T18:45:26.250041+0000","last_became_peered":"2024-09-13T18:45:26.250041+0000","last_unstale":"2024-09-13T18:47:46.616601+0000","last_undegraded":"2024-09-13T18:47:46.616601+0000","last_fullsized":"2024-09-13T18:47:46.616601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:20.013806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.615471+0000","last_change":"2024-09-13T18:45:22.024133+0000","last_active":"2024-09-13T18:47:46.615471+0000","last_peered":"2024-09-13T18:47:46.615471+0000","last_clean":"2024-09-13T18:47:46.615471+0000","last_became_active":"2024-09-13T18:45:22.023882+0000","last_became_peered":"2024-09-13T18:45:22.023882+0000","last_unstale":"2024-09-13T18:47:46.615471+0000","last_undegraded":"2024-09-13T18:47:46.615471+0000","last_fullsized":"2024-09-13T18:47:46.615471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615027+0000","last_change":"2024-09-13T18:45:21.663297+0000","last_active":"2024-09-13T18:47:41.615027+0000","last_peered":"2024-09-13T18:47:41.615027+0000","last_clean":"2024-09-13T18:47:41.615027+0000","last_became_active":"2024-09-13T18:45:21.662980+0000","last_became_peered":"2024-09-13T18:45:21.662980+0000","last_unstale":"2024-09-13T18:47:41.615027+0000","last_undegraded":"2024-09-13T18:47:41.615027+0000","last_fullsized":"2024-09-13T18:47:41.615027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617186+0000","last_change":"2024-09-13T18:45:26.253184+0000","last_active":"2024-09-13T18:47:51.617186+0000","last_peered":"2024-09-13T18:47:51.617186+0000","last_clean":"2024-09-13T18:47:51.617186+0000","last_became_active":"2024-09-13T18:45:26.252786+0000","last_became_peered":"2024-09-13T18:45:26.252786+0000","last_unstale":"2024-09-13T18:47:51.617186+0000","last_undegraded":"2024-09-13T18:47:51.617186+0000","last_fullsized":"2024-09-13T18:47:51.617186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616847+0000","last_change":"2024-09-13T18:45:22.035052+0000","last_active":"2024-09-13T18:47:51.616847+0000","last_peered":"2024-09-13T18:47:51.616847+0000","last_clean":"2024-09-13T18:47:51.616847+0000","last_became_active":"2024-09-13T18:45:22.034765+0000","last_became_peered":"2024-09-13T18:45:22.034765+0000","last_unstale":"2024-09-13T18:47:51.616847+0000","last_undegraded":"2024-09-13T18:47:51.616847+0000","last_fullsized":"2024-09-13T18:47:51.616847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:28.674827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'99","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:35.986207+0000","last_change":"2024-09-13T18:45:21.668054+0000","last_active":"2024-09-13T18:50:35.986207+0000","last_peered":"2024-09-13T18:50:35.986207+0000","last_clean":"2024-09-13T18:50:35.986207+0000","last_became_active":"2024-09-13T18:45:21.667587+0000","last_became_peered":"2024-09-13T18:45:21.667587+0000","last_unstale":"2024-09-13T18:50:35.986207+0000","last_undegraded":"2024-09-13T18:50:35.986207+0000","last_fullsized":"2024-09-13T18:50:35.986207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":939852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.620478+0000","last_change":"2024-09-13T18:45:26.052997+0000","last_active":"2024-09-13T18:47:46.620478+0000","last_peered":"2024-09-13T18:47:46.620478+0000","last_clean":"2024-09-13T18:47:46.620478+0000","last_became_active":"2024-09-13T18:45:26.052614+0000","last_became_peered":"2024-09-13T18:45:26.052614+0000","last_unstale":"2024-09-13T18:47:46.620478+0000","last_undegraded":"2024-09-13T18:47:46.620478+0000","last_fullsized":"2024-09-13T18:47:46.620478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616204+0000","last_change":"2024-09-13T18:45:22.020754+0000","last_active":"2024-09-13T18:47:46.616204+0000","last_peered":"2024-09-13T18:47:46.616204+0000","last_clean":"2024-09-13T18:47:46.616204+0000","last_became_active":"2024-09-13T18:45:22.020461+0000","last_became_peered":"2024-09-13T18:45:22.020461+0000","last_unstale":"2024-09-13T18:47:46.616204+0000","last_undegraded":"2024-09-13T18:47:46.616204+0000","last_fullsized":"2024-09-13T18:47:46.616204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'28","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:35.178728+0000","last_change":"2024-09-13T18:45:21.664387+0000","last_active":"2024-09-13T18:50:35.178728+0000","last_peered":"2024-09-13T18:50:35.178728+0000","last_clean":"2024-09-13T18:50:35.178728+0000","last_became_active":"2024-09-13T18:45:21.663941+0000","last_became_peered":"2024-09-13T18:45:21.663941+0000","last_unstale":"2024-09-13T18:50:35.178728+0000","last_undegraded":"2024-09-13T18:50:35.178728+0000","last_fullsized":"2024-09-13T18:50:35.178728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616153+0000","last_change":"2024-09-13T18:45:26.051227+0000","last_active":"2024-09-13T18:47:46.616153+0000","last_peered":"2024-09-13T18:47:46.616153+0000","last_clean":"2024-09-13T18:47:46.616153+0000","last_became_active":"2024-09-13T18:45:26.050757+0000","last_became_peered":"2024-09-13T18:45:26.050757+0000","last_unstale":"2024-09-13T18:47:46.616153+0000","last_undegraded":"2024-09-13T18:47:46.616153+0000","last_fullsized":"2024-09-13T18:47:46.616153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:59.045390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616282+0000","last_change":"2024-09-13T18:45:22.025223+0000","last_active":"2024-09-13T18:47:51.616282+0000","last_peered":"2024-09-13T18:47:51.616282+0000","last_clean":"2024-09-13T18:47:51.616282+0000","last_became_active":"2024-09-13T18:45:22.024972+0000","last_became_peered":"2024-09-13T18:45:22.024972+0000","last_unstale":"2024-09-13T18:47:51.616282+0000","last_undegraded":"2024-09-13T18:47:51.616282+0000","last_fullsized":"2024-09-13T18:47:51.616282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'7","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.104828+0000","last_change":"2024-09-13T18:45:21.666814+0000","last_active":"2024-09-13T18:48:12.104828+0000","last_peered":"2024-09-13T18:48:12.104828+0000","last_clean":"2024-09-13T18:48:12.104828+0000","last_became_active":"2024-09-13T18:45:21.666516+0000","last_became_peered":"2024-09-13T18:45:21.666516+0000","last_unstale":"2024-09-13T18:48:12.104828+0000","last_undegraded":"2024-09-13T18:48:12.104828+0000","last_fullsized":"2024-09-13T18:48:12.104828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616514+0000","last_change":"2024-09-13T18:45:26.057746+0000","last_active":"2024-09-13T18:47:46.616514+0000","last_peered":"2024-09-13T18:47:46.616514+0000","last_clean":"2024-09-13T18:47:46.616514+0000","last_became_active":"2024-09-13T18:45:26.057285+0000","last_became_peered":"2024-09-13T18:45:26.057285+0000","last_unstale":"2024-09-13T18:47:46.616514+0000","last_undegraded":"2024-09-13T18:47:46.616514+0000","last_fullsized":"2024-09-13T18:47:46.616514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617206+0000","last_change":"2024-09-13T18:45:22.031653+0000","last_active":"2024-09-13T18:47:51.617206+0000","last_peered":"2024-09-13T18:47:51.617206+0000","last_clean":"2024-09-13T18:47:51.617206+0000","last_became_active":"2024-09-13T18:45:22.031341+0000","last_became_peered":"2024-09-13T18:45:22.031341+0000","last_unstale":"2024-09-13T18:47:51.617206+0000","last_undegraded":"2024-09-13T18:47:51.617206+0000","last_fullsized":"2024-09-13T18:47:51.617206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112682+0000","last_change":"2024-09-13T18:45:21.664695+0000","last_active":"2024-09-13T18:48:27.112682+0000","last_peered":"2024-09-13T18:48:27.112682+0000","last_clean":"2024-09-13T18:48:27.112682+0000","last_became_active":"2024-09-13T18:45:21.664401+0000","last_became_peered":"2024-09-13T18:45:21.664401+0000","last_unstale":"2024-09-13T18:48:27.112682+0000","last_undegraded":"2024-09-13T18:48:27.112682+0000","last_fullsized":"2024-09-13T18:48:27.112682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616542+0000","last_change":"2024-09-13T18:45:26.254041+0000","last_active":"2024-09-13T18:47:46.616542+0000","last_peered":"2024-09-13T18:47:46.616542+0000","last_clean":"2024-09-13T18:47:46.616542+0000","last_became_active":"2024-09-13T18:45:26.253579+0000","last_became_peered":"2024-09-13T18:45:26.253579+0000","last_unstale":"2024-09-13T18:47:46.616542+0000","last_undegraded":"2024-09-13T18:47:46.616542+0000","last_fullsized":"2024-09-13T18:47:46.616542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:19.171737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.613048+0000","last_change":"2024-09-13T18:45:26.253962+0000","last_active":"2024-09-13T18:47:26.613048+0000","last_peered":"2024-09-13T18:47:26.613048+0000","last_clean":"2024-09-13T18:47:26.613048+0000","last_became_active":"2024-09-13T18:45:26.252979+0000","last_became_peered":"2024-09-13T18:45:26.252979+0000","last_unstale":"2024-09-13T18:47:26.613048+0000","last_undegraded":"2024-09-13T18:47:26.613048+0000","last_fullsized":"2024-09-13T18:47:26.613048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.621059+0000","last_change":"2024-09-13T18:45:22.030919+0000","last_active":"2024-09-13T18:47:51.621059+0000","last_peered":"2024-09-13T18:47:51.621059+0000","last_clean":"2024-09-13T18:47:51.621059+0000","last_became_active":"2024-09-13T18:45:22.030453+0000","last_became_peered":"2024-09-13T18:45:22.030453+0000","last_unstale":"2024-09-13T18:47:51.621059+0000","last_undegraded":"2024-09-13T18:47:51.621059+0000","last_fullsized":"2024-09-13T18:47:51.621059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112562+0000","last_change":"2024-09-13T18:45:21.664824+0000","last_active":"2024-09-13T18:48:27.112562+0000","last_peered":"2024-09-13T18:48:27.112562+0000","last_clean":"2024-09-13T18:48:27.112562+0000","last_became_active":"2024-09-13T18:45:21.664571+0000","last_became_peered":"2024-09-13T18:45:21.664571+0000","last_unstale":"2024-09-13T18:48:27.112562+0000","last_undegraded":"2024-09-13T18:48:27.112562+0000","last_fullsized":"2024-09-13T18:48:27.112562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615970+0000","last_change":"2024-09-13T18:45:26.054920+0000","last_active":"2024-09-13T18:47:31.615970+0000","last_peered":"2024-09-13T18:47:31.615970+0000","last_clean":"2024-09-13T18:47:31.615970+0000","last_became_active":"2024-09-13T18:45:26.054510+0000","last_became_peered":"2024-09-13T18:45:26.054510+0000","last_unstale":"2024-09-13T18:47:31.615970+0000","last_undegraded":"2024-09-13T18:47:31.615970+0000","last_fullsized":"2024-09-13T18:47:31.615970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:32.061769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617366+0000","last_change":"2024-09-13T18:45:22.028321+0000","last_active":"2024-09-13T18:47:51.617366+0000","last_peered":"2024-09-13T18:47:51.617366+0000","last_clean":"2024-09-13T18:47:51.617366+0000","last_became_active":"2024-09-13T18:45:22.028062+0000","last_became_peered":"2024-09-13T18:45:22.028062+0000","last_unstale":"2024-09-13T18:47:51.617366+0000","last_undegraded":"2024-09-13T18:47:51.617366+0000","last_fullsized":"2024-09-13T18:47:51.617366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.109768+0000","last_change":"2024-09-13T18:45:21.672763+0000","last_active":"2024-09-13T18:48:22.109768+0000","last_peered":"2024-09-13T18:48:22.109768+0000","last_clean":"2024-09-13T18:48:22.109768+0000","last_became_active":"2024-09-13T18:45:21.672470+0000","last_became_peered":"2024-09-13T18:45:21.672470+0000","last_unstale":"2024-09-13T18:48:22.109768+0000","last_undegraded":"2024-09-13T18:48:22.109768+0000","last_fullsized":"2024-09-13T18:48:22.109768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.098429+0000","last_change":"2024-09-13T18:45:21.660195+0000","last_active":"2024-09-13T18:48:02.098429+0000","last_peered":"2024-09-13T18:48:02.098429+0000","last_clean":"2024-09-13T18:48:02.098429+0000","last_became_active":"2024-09-13T18:45:21.659912+0000","last_became_peered":"2024-09-13T18:45:21.659912+0000","last_unstale":"2024-09-13T18:48:02.098429+0000","last_undegraded":"2024-09-13T18:48:02.098429+0000","last_fullsized":"2024-09-13T18:48:02.098429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.616788+0000","last_change":"2024-09-13T18:45:22.024571+0000","last_active":"2024-09-13T18:47:56.616788+0000","last_peered":"2024-09-13T18:47:56.616788+0000","last_clean":"2024-09-13T18:47:56.616788+0000","last_became_active":"2024-09-13T18:45:22.024305+0000","last_became_peered":"2024-09-13T18:45:22.024305+0000","last_unstale":"2024-09-13T18:47:56.616788+0000","last_undegraded":"2024-09-13T18:47:56.616788+0000","last_fullsized":"2024-09-13T18:47:56.616788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617977+0000","last_change":"2024-09-13T18:45:26.056207+0000","last_active":"2024-09-13T18:47:56.617977+0000","last_peered":"2024-09-13T18:47:56.617977+0000","last_clean":"2024-09-13T18:47:56.617977+0000","last_became_active":"2024-09-13T18:45:26.055794+0000","last_became_peered":"2024-09-13T18:45:26.055794+0000","last_unstale":"2024-09-13T18:47:56.617977+0000","last_undegraded":"2024-09-13T18:47:56.617977+0000","last_fullsized":"2024-09-13T18:47:56.617977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:29.520825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617441+0000","last_change":"2024-09-13T18:45:21.670376+0000","last_active":"2024-09-13T18:47:51.617441+0000","last_peered":"2024-09-13T18:47:51.617441+0000","last_clean":"2024-09-13T18:47:51.617441+0000","last_became_active":"2024-09-13T18:45:21.670083+0000","last_became_peered":"2024-09-13T18:45:21.670083+0000","last_unstale":"2024-09-13T18:47:51.617441+0000","last_undegraded":"2024-09-13T18:47:51.617441+0000","last_fullsized":"2024-09-13T18:47:51.617441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617522+0000","last_change":"2024-09-13T18:45:22.021774+0000","last_active":"2024-09-13T18:47:56.617522+0000","last_peered":"2024-09-13T18:47:56.617522+0000","last_clean":"2024-09-13T18:47:56.617522+0000","last_became_active":"2024-09-13T18:45:22.021496+0000","last_became_peered":"2024-09-13T18:45:22.021496+0000","last_unstale":"2024-09-13T18:47:56.617522+0000","last_undegraded":"2024-09-13T18:47:56.617522+0000","last_fullsized":"2024-09-13T18:47:56.617522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:44.234639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.618047+0000","last_change":"2024-09-13T18:45:26.050478+0000","last_active":"2024-09-13T18:47:56.618047+0000","last_peered":"2024-09-13T18:47:56.618047+0000","last_clean":"2024-09-13T18:47:56.618047+0000","last_became_active":"2024-09-13T18:45:26.050095+0000","last_became_peered":"2024-09-13T18:45:26.050095+0000","last_unstale":"2024-09-13T18:47:56.618047+0000","last_undegraded":"2024-09-13T18:47:56.618047+0000","last_fullsized":"2024-09-13T18:47:56.618047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:28.276515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615874+0000","last_change":"2024-09-13T18:45:22.028025+0000","last_active":"2024-09-13T18:47:31.615874+0000","last_peered":"2024-09-13T18:47:31.615874+0000","last_clean":"2024-09-13T18:47:31.615874+0000","last_became_active":"2024-09-13T18:45:22.027528+0000","last_became_peered":"2024-09-13T18:45:22.027528+0000","last_unstale":"2024-09-13T18:47:31.615874+0000","last_undegraded":"2024-09-13T18:47:31.615874+0000","last_fullsized":"2024-09-13T18:47:31.615874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615332+0000","last_change":"2024-09-13T18:45:22.024615+0000","last_active":"2024-09-13T18:47:31.615332+0000","last_peered":"2024-09-13T18:47:31.615332+0000","last_clean":"2024-09-13T18:47:31.615332+0000","last_became_active":"2024-09-13T18:45:22.024369+0000","last_became_peered":"2024-09-13T18:45:22.024369+0000","last_unstale":"2024-09-13T18:47:31.615332+0000","last_undegraded":"2024-09-13T18:47:31.615332+0000","last_fullsized":"2024-09-13T18:47:31.615332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614768+0000","last_change":"2024-09-13T18:45:22.035861+0000","last_active":"2024-09-13T18:47:31.614768+0000","last_peered":"2024-09-13T18:47:31.614768+0000","last_clean":"2024-09-13T18:47:31.614768+0000","last_became_active":"2024-09-13T18:45:22.034318+0000","last_became_peered":"2024-09-13T18:45:22.034318+0000","last_unstale":"2024-09-13T18:47:31.614768+0000","last_undegraded":"2024-09-13T18:47:31.614768+0000","last_fullsized":"2024-09-13T18:47:31.614768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.613791+0000","last_change":"2024-09-13T18:45:22.033266+0000","last_active":"2024-09-13T18:47:31.613791+0000","last_peered":"2024-09-13T18:47:31.613791+0000","last_clean":"2024-09-13T18:47:31.613791+0000","last_became_active":"2024-09-13T18:45:22.032851+0000","last_became_peered":"2024-09-13T18:45:22.032851+0000","last_unstale":"2024-09-13T18:47:31.613791+0000","last_undegraded":"2024-09-13T18:47:31.613791+0000","last_fullsized":"2024-09-13T18:47:31.613791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615463+0000","last_change":"2024-09-13T18:45:22.033500+0000","last_active":"2024-09-13T18:47:36.615463+0000","last_peered":"2024-09-13T18:47:36.615463+0000","last_clean":"2024-09-13T18:47:36.615463+0000","last_became_active":"2024-09-13T18:45:22.033156+0000","last_became_peered":"2024-09-13T18:45:22.033156+0000","last_unstale":"2024-09-13T18:47:36.615463+0000","last_undegraded":"2024-09-13T18:47:36.615463+0000","last_fullsized":"2024-09-13T18:47:36.615463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.619224+0000","last_change":"2024-09-13T18:45:22.029906+0000","last_active":"2024-09-13T18:47:36.619224+0000","last_peered":"2024-09-13T18:47:36.619224+0000","last_clean":"2024-09-13T18:47:36.619224+0000","last_became_active":"2024-09-13T18:45:22.029654+0000","last_became_peered":"2024-09-13T18:45:22.029654+0000","last_unstale":"2024-09-13T18:47:36.619224+0000","last_undegraded":"2024-09-13T18:47:36.619224+0000","last_fullsized":"2024-09-13T18:47:36.619224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.616491+0000","last_change":"2024-09-13T18:45:22.028396+0000","last_active":"2024-09-13T18:47:36.616491+0000","last_peered":"2024-09-13T18:47:36.616491+0000","last_clean":"2024-09-13T18:47:36.616491+0000","last_became_active":"2024-09-13T18:45:22.028031+0000","last_became_peered":"2024-09-13T18:45:22.028031+0000","last_unstale":"2024-09-13T18:47:36.616491+0000","last_undegraded":"2024-09-13T18:47:36.616491+0000","last_fullsized":"2024-09-13T18:47:36.616491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615534+0000","last_change":"2024-09-13T18:45:22.032816+0000","last_active":"2024-09-13T18:47:36.615534+0000","last_peered":"2024-09-13T18:47:36.615534+0000","last_clean":"2024-09-13T18:47:36.615534+0000","last_became_active":"2024-09-13T18:45:22.032561+0000","last_became_peered":"2024-09-13T18:45:22.032561+0000","last_unstale":"2024-09-13T18:47:36.615534+0000","last_undegraded":"2024-09-13T18:47:36.615534+0000","last_fullsized":"2024-09-13T18:47:36.615534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615296+0000","last_change":"2024-09-13T18:45:22.036615+0000","last_active":"2024-09-13T18:47:36.615296+0000","last_peered":"2024-09-13T18:47:36.615296+0000","last_clean":"2024-09-13T18:47:36.615296+0000","last_became_active":"2024-09-13T18:45:22.036380+0000","last_became_peered":"2024-09-13T18:45:22.036380+0000","last_unstale":"2024-09-13T18:47:36.615296+0000","last_undegraded":"2024-09-13T18:47:36.615296+0000","last_fullsized":"2024-09-13T18:47:36.615296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.616019+0000","last_change":"2024-09-13T18:45:22.035082+0000","last_active":"2024-09-13T18:47:41.616019+0000","last_peered":"2024-09-13T18:47:41.616019+0000","last_clean":"2024-09-13T18:47:41.616019+0000","last_became_active":"2024-09-13T18:45:22.034646+0000","last_became_peered":"2024-09-13T18:45:22.034646+0000","last_unstale":"2024-09-13T18:47:41.616019+0000","last_undegraded":"2024-09-13T18:47:41.616019+0000","last_fullsized":"2024-09-13T18:47:41.616019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615955+0000","last_change":"2024-09-13T18:45:22.029195+0000","last_active":"2024-09-13T18:47:41.615955+0000","last_peered":"2024-09-13T18:47:41.615955+0000","last_clean":"2024-09-13T18:47:41.615955+0000","last_became_active":"2024-09-13T18:45:22.028430+0000","last_became_peered":"2024-09-13T18:45:22.028430+0000","last_unstale":"2024-09-13T18:47:41.615955+0000","last_undegraded":"2024-09-13T18:47:41.615955+0000","last_fullsized":"2024-09-13T18:47:41.615955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.614982+0000","last_change":"2024-09-13T18:45:22.019974+0000","last_active":"2024-09-13T18:47:41.614982+0000","last_peered":"2024-09-13T18:47:41.614982+0000","last_clean":"2024-09-13T18:47:41.614982+0000","last_became_active":"2024-09-13T18:45:22.019733+0000","last_became_peered":"2024-09-13T18:45:22.019733+0000","last_unstale":"2024-09-13T18:47:41.614982+0000","last_undegraded":"2024-09-13T18:47:41.614982+0000","last_fullsized":"2024-09-13T18:47:41.614982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.616976+0000","last_change":"2024-09-13T18:45:22.016110+0000","last_active":"2024-09-13T18:47:41.616976+0000","last_peered":"2024-09-13T18:47:41.616976+0000","last_clean":"2024-09-13T18:47:41.616976+0000","last_became_active":"2024-09-13T18:45:22.015868+0000","last_became_peered":"2024-09-13T18:45:22.015868+0000","last_unstale":"2024-09-13T18:47:41.616976+0000","last_undegraded":"2024-09-13T18:47:41.616976+0000","last_fullsized":"2024-09-13T18:47:41.616976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615690+0000","last_change":"2024-09-13T18:45:22.034477+0000","last_active":"2024-09-13T18:47:41.615690+0000","last_peered":"2024-09-13T18:47:41.615690+0000","last_clean":"2024-09-13T18:47:41.615690+0000","last_became_active":"2024-09-13T18:45:22.034019+0000","last_became_peered":"2024-09-13T18:45:22.034019+0000","last_unstale":"2024-09-13T18:47:41.615690+0000","last_undegraded":"2024-09-13T18:47:41.615690+0000","last_fullsized":"2024-09-13T18:47:41.615690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616852+0000","last_change":"2024-09-13T18:45:22.021787+0000","last_active":"2024-09-13T18:47:46.616852+0000","last_peered":"2024-09-13T18:47:46.616852+0000","last_clean":"2024-09-13T18:47:46.616852+0000","last_became_active":"2024-09-13T18:45:22.020415+0000","last_became_peered":"2024-09-13T18:45:22.020415+0000","last_unstale":"2024-09-13T18:47:46.616852+0000","last_undegraded":"2024-09-13T18:47:46.616852+0000","last_fullsized":"2024-09-13T18:47:46.616852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616670+0000","last_change":"2024-09-13T18:45:22.035941+0000","last_active":"2024-09-13T18:47:46.616670+0000","last_peered":"2024-09-13T18:47:46.616670+0000","last_clean":"2024-09-13T18:47:46.616670+0000","last_became_active":"2024-09-13T18:45:22.035491+0000","last_became_peered":"2024-09-13T18:45:22.035491+0000","last_unstale":"2024-09-13T18:47:46.616670+0000","last_undegraded":"2024-09-13T18:47:46.616670+0000","last_fullsized":"2024-09-13T18:47:46.616670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:46:11.607690+0000","last_change":"2024-09-13T18:46:11.147145+0000","last_active":"2024-09-13T18:46:11.607690+0000","last_peered":"2024-09-13T18:46:11.607690+0000","last_clean":"2024-09-13T18:46:11.607690+0000","last_became_active":"2024-09-13T18:46:11.146859+0000","last_became_peered":"2024-09-13T18:46:11.146859+0000","last_unstale":"2024-09-13T18:46:11.607690+0000","last_undegraded":"2024-09-13T18:46:11.607690+0000","last_fullsized":"2024-09-13T18:46:11.607690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:36.388621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.620452+0000","last_change":"2024-09-13T18:45:22.021298+0000","last_active":"2024-09-13T18:47:46.620452+0000","last_peered":"2024-09-13T18:47:46.620452+0000","last_clean":"2024-09-13T18:47:46.620452+0000","last_became_active":"2024-09-13T18:45:22.021042+0000","last_became_peered":"2024-09-13T18:45:22.021042+0000","last_unstale":"2024-09-13T18:47:46.620452+0000","last_undegraded":"2024-09-13T18:47:46.620452+0000","last_fullsized":"2024-09-13T18:47:46.620452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.615452+0000","last_change":"2024-09-13T18:45:22.021628+0000","last_active":"2024-09-13T18:47:46.615452+0000","last_peered":"2024-09-13T18:47:46.615452+0000","last_clean":"2024-09-13T18:47:46.615452+0000","last_became_active":"2024-09-13T18:45:22.021366+0000","last_became_peered":"2024-09-13T18:45:22.021366+0000","last_unstale":"2024-09-13T18:47:46.615452+0000","last_undegraded":"2024-09-13T18:47:46.615452+0000","last_fullsized":"2024-09-13T18:47:46.615452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617423+0000","last_change":"2024-09-13T18:45:22.029051+0000","last_active":"2024-09-13T18:47:51.617423+0000","last_peered":"2024-09-13T18:47:51.617423+0000","last_clean":"2024-09-13T18:47:51.617423+0000","last_became_active":"2024-09-13T18:45:22.028594+0000","last_became_peered":"2024-09-13T18:45:22.028594+0000","last_unstale":"2024-09-13T18:47:51.617423+0000","last_undegraded":"2024-09-13T18:47:51.617423+0000","last_fullsized":"2024-09-13T18:47:51.617423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616896+0000","last_change":"2024-09-13T18:45:22.016996+0000","last_active":"2024-09-13T18:47:51.616896+0000","last_peered":"2024-09-13T18:47:51.616896+0000","last_clean":"2024-09-13T18:47:51.616896+0000","last_became_active":"2024-09-13T18:45:22.016731+0000","last_became_peered":"2024-09-13T18:45:22.016731+0000","last_unstale":"2024-09-13T18:47:51.616896+0000","last_undegraded":"2024-09-13T18:47:51.616896+0000","last_fullsized":"2024-09-13T18:47:51.616896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617981+0000","last_change":"2024-09-13T18:45:22.028649+0000","last_active":"2024-09-13T18:47:51.617981+0000","last_peered":"2024-09-13T18:47:51.617981+0000","last_clean":"2024-09-13T18:47:51.617981+0000","last_became_active":"2024-09-13T18:45:22.027899+0000","last_became_peered":"2024-09-13T18:45:22.027899+0000","last_unstale":"2024-09-13T18:47:51.617981+0000","last_undegraded":"2024-09-13T18:47:51.617981+0000","last_fullsized":"2024-09-13T18:47:51.617981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617999+0000","last_change":"2024-09-13T18:45:22.024291+0000","last_active":"2024-09-13T18:47:51.617999+0000","last_peered":"2024-09-13T18:47:51.617999+0000","last_clean":"2024-09-13T18:47:51.617999+0000","last_became_active":"2024-09-13T18:45:22.024014+0000","last_became_peered":"2024-09-13T18:45:22.024014+0000","last_unstale":"2024-09-13T18:47:51.617999+0000","last_undegraded":"2024-09-13T18:47:51.617999+0000","last_fullsized":"2024-09-13T18:47:51.617999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616937+0000","last_change":"2024-09-13T18:45:22.036551+0000","last_active":"2024-09-13T18:47:51.616937+0000","last_peered":"2024-09-13T18:47:51.616937+0000","last_clean":"2024-09-13T18:47:51.616937+0000","last_became_active":"2024-09-13T18:45:22.036269+0000","last_became_peered":"2024-09-13T18:45:22.036269+0000","last_unstale":"2024-09-13T18:47:51.616937+0000","last_undegraded":"2024-09-13T18:47:51.616937+0000","last_fullsized":"2024-09-13T18:47:51.616937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617957+0000","last_change":"2024-09-13T18:45:22.032392+0000","last_active":"2024-09-13T18:47:56.617957+0000","last_peered":"2024-09-13T18:47:56.617957+0000","last_clean":"2024-09-13T18:47:56.617957+0000","last_became_active":"2024-09-13T18:45:22.027605+0000","last_became_peered":"2024-09-13T18:45:22.027605+0000","last_unstale":"2024-09-13T18:47:56.617957+0000","last_undegraded":"2024-09-13T18:47:56.617957+0000","last_fullsized":"2024-09-13T18:47:56.617957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617446+0000","last_change":"2024-09-13T18:45:22.029307+0000","last_active":"2024-09-13T18:47:56.617446+0000","last_peered":"2024-09-13T18:47:56.617446+0000","last_clean":"2024-09-13T18:47:56.617446+0000","last_became_active":"2024-09-13T18:45:22.029018+0000","last_became_peered":"2024-09-13T18:45:22.029018+0000","last_unstale":"2024-09-13T18:47:56.617446+0000","last_undegraded":"2024-09-13T18:47:56.617446+0000","last_fullsized":"2024-09-13T18:47:56.617446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617701+0000","last_change":"2024-09-13T18:45:22.029061+0000","last_active":"2024-09-13T18:47:56.617701+0000","last_peered":"2024-09-13T18:47:56.617701+0000","last_clean":"2024-09-13T18:47:56.617701+0000","last_became_active":"2024-09-13T18:45:22.028758+0000","last_became_peered":"2024-09-13T18:45:22.028758+0000","last_unstale":"2024-09-13T18:47:56.617701+0000","last_undegraded":"2024-09-13T18:47:56.617701+0000","last_fullsized":"2024-09-13T18:47:56.617701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617479+0000","last_change":"2024-09-13T18:45:22.029690+0000","last_active":"2024-09-13T18:47:56.617479+0000","last_peered":"2024-09-13T18:47:56.617479+0000","last_clean":"2024-09-13T18:47:56.617479+0000","last_became_active":"2024-09-13T18:45:22.029403+0000","last_became_peered":"2024-09-13T18:45:22.029403+0000","last_unstale":"2024-09-13T18:47:56.617479+0000","last_undegraded":"2024-09-13T18:47:56.617479+0000","last_fullsized":"2024-09-13T18:47:56.617479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.614237+0000","last_change":"2024-09-13T18:45:22.038483+0000","last_active":"2024-09-13T18:47:26.614237+0000","last_peered":"2024-09-13T18:47:26.614237+0000","last_clean":"2024-09-13T18:47:26.614237+0000","last_became_active":"2024-09-13T18:45:22.036877+0000","last_became_peered":"2024-09-13T18:45:22.036877+0000","last_unstale":"2024-09-13T18:47:26.614237+0000","last_undegraded":"2024-09-13T18:47:26.614237+0000","last_fullsized":"2024-09-13T18:47:26.614237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.613815+0000","last_change":"2024-09-13T18:45:22.022846+0000","last_active":"2024-09-13T18:47:31.613815+0000","last_peered":"2024-09-13T18:47:31.613815+0000","last_clean":"2024-09-13T18:47:31.613815+0000","last_became_active":"2024-09-13T18:45:22.022618+0000","last_became_peered":"2024-09-13T18:45:22.022618+0000","last_unstale":"2024-09-13T18:47:31.613815+0000","last_undegraded":"2024-09-13T18:47:31.613815+0000","last_fullsized":"2024-09-13T18:47:31.613815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.618716+0000","last_change":"2024-09-13T18:45:22.028545+0000","last_active":"2024-09-13T18:47:31.618716+0000","last_peered":"2024-09-13T18:47:31.618716+0000","last_clean":"2024-09-13T18:47:31.618716+0000","last_became_active":"2024-09-13T18:45:22.028291+0000","last_became_peered":"2024-09-13T18:45:22.028291+0000","last_unstale":"2024-09-13T18:47:31.618716+0000","last_undegraded":"2024-09-13T18:47:31.618716+0000","last_fullsized":"2024-09-13T18:47:31.618716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614388+0000","last_change":"2024-09-13T18:45:22.034460+0000","last_active":"2024-09-13T18:47:31.614388+0000","last_peered":"2024-09-13T18:47:31.614388+0000","last_clean":"2024-09-13T18:47:31.614388+0000","last_became_active":"2024-09-13T18:45:22.033974+0000","last_became_peered":"2024-09-13T18:45:22.033974+0000","last_unstale":"2024-09-13T18:47:31.614388+0000","last_undegraded":"2024-09-13T18:47:31.614388+0000","last_fullsized":"2024-09-13T18:47:31.614388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":951574,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":265,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":1903148,"data_compressed":245052,"data_compressed_allocated":294912,"data_compressed_original":1441792,"omap_allocated":0,"internal_metadata":0},"log_size":328,"ondisk_log_size":328,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":704313,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.42399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.754},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.46999999999999997},"min":{"1min":0.36199999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.65400000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49099999999999999,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70799999999999996,"5min":0.749,"15min":0.749},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.432,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67300000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66200000000000003,"5min":0.755,"15min":0.755},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.48099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.47099999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47299999999999998,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60399999999999998,"5min":0.748,"15min":0.748},"last":0.629}]},{"osd":5,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.52100000000000002},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.54300000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73099999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.57199999999999995},"min":{"1min":0.41199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":655360,"data_stored":1053215,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.67600000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.746,"15min":0.746},"last":0.437},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67700000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70699999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47299999999999998},"min":{"1min":0.33100000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63600000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.42799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.34200000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.41399999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.40000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.36499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":113453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.32600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.626,"5min":0.87,"15min":0.87},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78700000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67600000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54000000000000004,"15min":0.56299999999999994},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.375},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.55200000000000005},"min":{"1min":0.36899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76100000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.33000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33800000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59999999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71999999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.40200000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.39400000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68600000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.443},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.39900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.42099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":113489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.377,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.67400000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.309},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.499,"15min":0.499},"min":{"1min":0.35099999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.255,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66500000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.56200000000000006},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.435,"5min":0.25,"15min":0.25},"max":{"1min":0.747,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.41199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.40400000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59099999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47599999999999998,"15min":0.497},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.434}]},{"osd":6,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72299999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":1.075,"15min":1.075},"last":0.60999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":663552,"data_stored":1058791,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.63600000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.375,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.498,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.28799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.40600000000000003},"min":{"1min":0.251,"5min":0.223,"15min":0.223},"max":{"1min":0.753,"5min":1.121,"15min":1.121},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67200000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.27500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.46800000000000003},"min":{"1min":0.314,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.30199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61299999999999999,"15min":0.58999999999999997},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59699999999999998,"15min":0.623},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81000000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.497}]},{"osd":7,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73199999999999998,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63,"15min":0.67300000000000004},"min":{"1min":0.41899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.50700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":290816,"data_stored":124287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.35899999999999999},"min":{"1min":0.20899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70899999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.375}]},{"osd":1,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40600000000000003,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54300000000000004,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.432,"15min":0.41199999999999998},"min":{"1min":0.27400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.437},"min":{"1min":0.33000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.437},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.438},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70499999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77100000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.627},"min":{"1min":0.46500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.82899999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76700000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.82099999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.621}]},{"osd":6,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.45600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.995,"15min":0.995},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63400000000000001,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83699999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.45100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83299999999999996,"5min":0.874,"15min":0.874},"last":0.70999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":113523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.23599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.56200000000000006,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36399999999999999,"15min":0.34799999999999998},"min":{"1min":0.23499999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.22500000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.52900000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.435,"15min":0.42299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.57499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.38800000000000001},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.308}]},{"osd":4,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.74299999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.375},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79700000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72499999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74199999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77000000000000002,"5min":0.872,"15min":0.872},"last":0.41799999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80200000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":356352,"data_stored":704369,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39900000000000002,"15min":0.42299999999999999},"min":{"1min":0.23300000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.629,"5min":1.496,"15min":1.496},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.40300000000000002},"min":{"1min":0.252,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56699999999999995,"5min":1.024,"15min":1.024},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.26900000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.76300000000000001,"5min":1.518,"15min":1.518},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.29399999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83699999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":1.294,"15min":1.294},"last":0.38},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.64800000000000002},"min":{"1min":0.439,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91500000000000004,"5min":1.198,"15min":1.198},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73899999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.69399999999999995},"min":{"1min":0.42499999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.501},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61699999999999999,"15min":0.64800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96899999999999997,"5min":1.143,"15min":1.143},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60799999999999998,"15min":0.65100000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.72699999999999998,"5min":1.391,"15min":1.391},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66100000000000003,"15min":0.72899999999999998},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84999999999999998,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67900000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.629},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63,"15min":0.68000000000000005},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.82099999999999995,"5min":1.363,"15min":1.363},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":950776,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":939852,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:50:39.691 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:50:39.691 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:50:39.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.824+0000 7ff03ae41640 1 Processor -- start 2024-09-13T18:50:39.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.824+0000 7ff03ae41640 1 -- start start 2024-09-13T18:50:39.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff03ae41640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff0340712c0 0x7ff03413d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff03ae41640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff034071900 0x7ff03413da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff03ae41640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03406eab0 con 0x7ff0340b0cd0 2024-09-13T18:50:39.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff03ae41640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03406f3c0 con 0x7ff034071900 2024-09-13T18:50:39.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff03ae41640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03413df70 con 0x7ff0340712c0 2024-09-13T18:50:39.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff0393de640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff034071900 0x7ff03413da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff038bdd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff0340b0cd0 0x7ff034070bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41102/0 (socket says 172.21.15.29:41102) 2024-09-13T18:50:39.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff038bdd640 1 -- 172.21.15.29:0/2006847956 learned_addr learned my addr 172.21.15.29:0/2006847956 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:39.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff033fff640 1 --2- 172.21.15.29:0/2006847956 >> v2:172.21.15.96:3300/0 conn(0x7ff0340712c0 0x7ff03413d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff0393de640 1 -- 172.21.15.29:0/2006847956 >> v2:172.21.15.96:3300/0 conn(0x7ff0340712c0 msgr2=0x7ff03413d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:39.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff0393de640 1 --2- 172.21.15.29:0/2006847956 >> v2:172.21.15.96:3300/0 conn(0x7ff0340712c0 0x7ff03413d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff0393de640 1 -- 172.21.15.29:0/2006847956 >> v1:172.21.15.29:6789/0 conn(0x7ff0340b0cd0 legacy=0x7ff034070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff0393de640 1 -- 172.21.15.29:0/2006847956 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0340b10b0 con 0x7ff034071900 2024-09-13T18:50:39.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.825+0000 7ff0337fe640 1 -- 172.21.15.29:0/2006847956 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082425631 0 0) 0x7ff03406eab0 con 0x7ff0340b0cd0 2024-09-13T18:50:39.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.826+0000 7ff0393de640 1 --2- 172.21.15.29:0/2006847956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff034071900 0x7ff03413da30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff0340ae720 tx=0x7ff02c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7717cca19ad4057 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:39.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.826+0000 7ff0337fe640 1 -- 172.21.15.29:0/2006847956 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c007740 con 0x7ff034071900 2024-09-13T18:50:39.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.826+0000 7ff0337fe640 1 -- 172.21.15.29:0/2006847956 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c02d050 con 0x7ff034071900 2024-09-13T18:50:39.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.826+0000 7ff0337fe640 1 -- 172.21.15.29:0/2006847956 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c007ac0 con 0x7ff034071900 2024-09-13T18:50:39.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.827+0000 7ff03ae41640 1 -- 172.21.15.29:0/2006847956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff034071900 msgr2=0x7ff03413da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.827+0000 7ff03ae41640 1 --2- 172.21.15.29:0/2006847956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff034071900 0x7ff03413da30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff0340ae720 tx=0x7ff02c02a5f0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.827+0000 7ff03ae41640 1 -- 172.21.15.29:0/2006847956 shutdown_connections 2024-09-13T18:50:39.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.827+0000 7ff03ae41640 1 --2- 172.21.15.29:0/2006847956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff034071900 0x7ff03413da30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.827+0000 7ff03ae41640 1 --2- 172.21.15.29:0/2006847956 >> v2:172.21.15.96:3300/0 conn(0x7ff0340712c0 0x7ff03413d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.827+0000 7ff03ae41640 1 -- 172.21.15.29:0/2006847956 >> 172.21.15.29:0/2006847956 conn(0x7ff03406a890 msgr2=0x7ff0340b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:39.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.827+0000 7ff03ae41640 1 -- 172.21.15.29:0/2006847956 shutdown_connections 2024-09-13T18:50:39.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.827+0000 7ff03ae41640 1 -- 172.21.15.29:0/2006847956 wait complete. 2024-09-13T18:50:39.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.828+0000 7ff03ae41640 1 Processor -- start 2024-09-13T18:50:39.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.828+0000 7ff03ae41640 1 -- start start 2024-09-13T18:50:39.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.828+0000 7ff03ae41640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0340712c0 0x7ff0341d0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.828+0000 7ff03ae41640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff034071900 0x7ff0340a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.828+0000 7ff03ae41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340b0cd0 0x7ff0341de900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.828+0000 7ff03ae41640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0340a9ee0 con 0x7ff0340b0cd0 2024-09-13T18:50:39.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.828+0000 7ff03ae41640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0340ab490 con 0x7ff0340712c0 2024-09-13T18:50:39.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.828+0000 7ff03ae41640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0340aa100 con 0x7ff034071900 2024-09-13T18:50:39.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff0393de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340b0cd0 0x7ff0341de900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff0393de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340b0cd0 0x7ff0341de900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55906/0 (socket says 172.21.15.29:55906) 2024-09-13T18:50:39.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff0393de640 1 -- 172.21.15.29:0/119709400 learned_addr learned my addr 172.21.15.29:0/119709400 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:39.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff038bdd640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0340712c0 0x7ff0341d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff033fff640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff034071900 0x7ff0340a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff0393de640 1 -- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff034071900 msgr2=0x7ff0340a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff0393de640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff034071900 0x7ff0340a99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff0393de640 1 -- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0340712c0 msgr2=0x7ff0341d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:39.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff0393de640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0340712c0 0x7ff0341d0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:39.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff0393de640 1 -- 172.21.15.29:0/119709400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c009a70 con 0x7ff0340b0cd0 2024-09-13T18:50:39.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff0393de640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340b0cd0 0x7ff0341de900 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff02c02abe0 tx=0x7ff02c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:39.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff0317fa640 1 -- 172.21.15.29:0/119709400 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c03c830 con 0x7ff0340b0cd0 2024-09-13T18:50:39.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff0317fa640 1 -- 172.21.15.29:0/119709400 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c03c990 con 0x7ff0340b0cd0 2024-09-13T18:50:39.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff03ae41640 1 -- 172.21.15.29:0/119709400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0340aa3e0 con 0x7ff0340b0cd0 2024-09-13T18:50:39.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff0317fa640 1 -- 172.21.15.29:0/119709400 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c03cd20 con 0x7ff0340b0cd0 2024-09-13T18:50:39.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.829+0000 7ff03ae41640 1 -- 172.21.15.29:0/119709400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0341cf240 con 0x7ff0340b0cd0 2024-09-13T18:50:39.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.830+0000 7ff03ae41640 1 -- 172.21.15.29:0/119709400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0341de620 con 0x7ff0340b0cd0 2024-09-13T18:50:39.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.831+0000 7ff0317fa640 1 -- 172.21.15.29:0/119709400 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff02c031400 con 0x7ff0340b0cd0 2024-09-13T18:50:39.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.831+0000 7ff0317fa640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff01806ac00 0x7ff01806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:39.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.831+0000 7ff0317fa640 1 -- 172.21.15.29:0/119709400 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff02c0ab230 con 0x7ff0340b0cd0 2024-09-13T18:50:39.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.832+0000 7ff038bdd640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff01806ac00 0x7ff01806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:39.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.832+0000 7ff038bdd640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff01806ac00 0x7ff01806d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff028007fd0 tx=0x7ff028007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:39.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:39.836+0000 7ff0317fa640 1 -- 172.21.15.29:0/119709400 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff0341de620 con 0x7ff0340b0cd0 2024-09-13T18:50:40.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.006+0000 7ff03ae41640 1 -- 172.21.15.29:0/119709400 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff03406efe0 con 0x7ff01806ac00 2024-09-13T18:50:40.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.016+0000 7ff0317fa640 1 -- 172.21.15.29:0/119709400 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370430 (secure 0 0 0) 0x7ff028004c70 con 0x7ff01806ac00 2024-09-13T18:50:40.025 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:50:40.028 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-13T18:50:40.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.019+0000 7ff03ae41640 1 -- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff01806ac00 msgr2=0x7ff01806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:40.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.019+0000 7ff03ae41640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff01806ac00 0x7ff01806d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff028007fd0 tx=0x7ff028007de0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.019+0000 7ff03ae41640 1 -- 172.21.15.29:0/119709400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340b0cd0 msgr2=0x7ff0341de900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:40.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.019+0000 7ff03ae41640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340b0cd0 0x7ff0341de900 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff02c02abe0 tx=0x7ff02c004a40 comp rx=0 tx=0).stop 2024-09-13T18:50:40.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.019+0000 7ff03ae41640 1 -- 172.21.15.29:0/119709400 shutdown_connections 2024-09-13T18:50:40.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.019+0000 7ff03ae41640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff01806ac00 0x7ff01806d0c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.019+0000 7ff03ae41640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340b0cd0 0x7ff0341de900 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.019+0000 7ff03ae41640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff034071900 0x7ff0340a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.019+0000 7ff03ae41640 1 --2- 172.21.15.29:0/119709400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0340712c0 0x7ff0341d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.019+0000 7ff03ae41640 1 -- 172.21.15.29:0/119709400 >> 172.21.15.29:0/119709400 conn(0x7ff03406a890 msgr2=0x7ff0340b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:40.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.019+0000 7ff03ae41640 1 -- 172.21.15.29:0/119709400 shutdown_connections 2024-09-13T18:50:40.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.019+0000 7ff03ae41640 1 -- 172.21.15.29:0/119709400 wait complete. 2024-09-13T18:50:40.035 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-13T18:50:39.670740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1541942,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":155,"num_read_kb":139,"num_write":430,"num_write_kb":3494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":454,"ondisk_log_size":454,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235612,"kb_used_data":3100,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739108,"statfs":{"total":773094113280,"available":772852846592,"internally_reserved":0,"allocated":3174400,"data_stored":3985440,"data_compressed":310028,"data_compressed_allocated":385024,"data_compressed_original":2588672,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28651,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":17,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003172"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.613132+0000","last_change":"2024-09-13T18:45:21.668274+0000","last_active":"2024-09-13T18:47:26.613132+0000","last_peered":"2024-09-13T18:47:26.613132+0000","last_clean":"2024-09-13T18:47:26.613132+0000","last_became_active":"2024-09-13T18:45:21.667985+0000","last_became_peered":"2024-09-13T18:45:21.667985+0000","last_unstale":"2024-09-13T18:47:26.613132+0000","last_undegraded":"2024-09-13T18:47:26.613132+0000","last_fullsized":"2024-09-13T18:47:26.613132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:45.703424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.614178+0000","last_change":"2024-09-13T18:45:22.034389+0000","last_active":"2024-09-13T18:47:26.614178+0000","last_peered":"2024-09-13T18:47:26.614178+0000","last_clean":"2024-09-13T18:47:26.614178+0000","last_became_active":"2024-09-13T18:45:22.034125+0000","last_became_peered":"2024-09-13T18:45:22.034125+0000","last_unstale":"2024-09-13T18:47:26.614178+0000","last_undegraded":"2024-09-13T18:47:26.614178+0000","last_fullsized":"2024-09-13T18:47:26.614178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617386+0000","last_change":"2024-09-13T18:45:26.253118+0000","last_active":"2024-09-13T18:47:51.617386+0000","last_peered":"2024-09-13T18:47:51.617386+0000","last_clean":"2024-09-13T18:47:51.617386+0000","last_became_active":"2024-09-13T18:45:26.252747+0000","last_became_peered":"2024-09-13T18:45:26.252747+0000","last_unstale":"2024-09-13T18:47:51.617386+0000","last_undegraded":"2024-09-13T18:47:51.617386+0000","last_fullsized":"2024-09-13T18:47:51.617386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:11.065130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.089694+0000","last_change":"2024-09-13T18:45:21.666664+0000","last_active":"2024-09-13T18:47:47.089694+0000","last_peered":"2024-09-13T18:47:47.089694+0000","last_clean":"2024-09-13T18:47:47.089694+0000","last_became_active":"2024-09-13T18:45:21.666398+0000","last_became_peered":"2024-09-13T18:45:21.666398+0000","last_unstale":"2024-09-13T18:47:47.089694+0000","last_undegraded":"2024-09-13T18:47:47.089694+0000","last_fullsized":"2024-09-13T18:47:47.089694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:06.210838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.613875+0000","last_change":"2024-09-13T18:45:22.024774+0000","last_active":"2024-09-13T18:47:31.613875+0000","last_peered":"2024-09-13T18:47:31.613875+0000","last_clean":"2024-09-13T18:47:31.613875+0000","last_became_active":"2024-09-13T18:45:22.024424+0000","last_became_peered":"2024-09-13T18:45:22.024424+0000","last_unstale":"2024-09-13T18:47:31.613875+0000","last_undegraded":"2024-09-13T18:47:31.613875+0000","last_fullsized":"2024-09-13T18:47:31.613875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616742+0000","last_change":"2024-09-13T18:45:26.050411+0000","last_active":"2024-09-13T18:47:51.616742+0000","last_peered":"2024-09-13T18:47:51.616742+0000","last_clean":"2024-09-13T18:47:51.616742+0000","last_became_active":"2024-09-13T18:45:26.049414+0000","last_became_peered":"2024-09-13T18:45:26.049414+0000","last_unstale":"2024-09-13T18:47:51.616742+0000","last_undegraded":"2024-09-13T18:47:51.616742+0000","last_fullsized":"2024-09-13T18:47:51.616742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616880+0000","last_change":"2024-09-13T18:45:21.667928+0000","last_active":"2024-09-13T18:47:51.616880+0000","last_peered":"2024-09-13T18:47:51.616880+0000","last_clean":"2024-09-13T18:47:51.616880+0000","last_became_active":"2024-09-13T18:45:21.667602+0000","last_became_peered":"2024-09-13T18:45:21.667602+0000","last_unstale":"2024-09-13T18:47:51.616880+0000","last_undegraded":"2024-09-13T18:47:51.616880+0000","last_fullsized":"2024-09-13T18:47:51.616880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:53.936326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617756+0000","last_change":"2024-09-13T18:45:22.036952+0000","last_active":"2024-09-13T18:47:56.617756+0000","last_peered":"2024-09-13T18:47:56.617756+0000","last_clean":"2024-09-13T18:47:56.617756+0000","last_became_active":"2024-09-13T18:45:22.035790+0000","last_became_peered":"2024-09-13T18:45:22.035790+0000","last_unstale":"2024-09-13T18:47:56.617756+0000","last_undegraded":"2024-09-13T18:47:56.617756+0000","last_fullsized":"2024-09-13T18:47:56.617756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617541+0000","last_change":"2024-09-13T18:45:26.052333+0000","last_active":"2024-09-13T18:47:56.617541+0000","last_peered":"2024-09-13T18:47:56.617541+0000","last_clean":"2024-09-13T18:47:56.617541+0000","last_became_active":"2024-09-13T18:45:26.051873+0000","last_became_peered":"2024-09-13T18:45:26.051873+0000","last_unstale":"2024-09-13T18:47:56.617541+0000","last_undegraded":"2024-09-13T18:47:56.617541+0000","last_fullsized":"2024-09-13T18:47:56.617541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:03.925946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:37.145855+0000","last_change":"2024-09-13T18:45:21.669914+0000","last_active":"2024-09-13T18:49:37.145855+0000","last_peered":"2024-09-13T18:49:37.145855+0000","last_clean":"2024-09-13T18:49:37.145855+0000","last_became_active":"2024-09-13T18:45:21.669622+0000","last_became_peered":"2024-09-13T18:45:21.669622+0000","last_unstale":"2024-09-13T18:49:37.145855+0000","last_undegraded":"2024-09-13T18:49:37.145855+0000","last_fullsized":"2024-09-13T18:49:37.145855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.765670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617780+0000","last_change":"2024-09-13T18:45:22.035675+0000","last_active":"2024-09-13T18:47:56.617780+0000","last_peered":"2024-09-13T18:47:56.617780+0000","last_clean":"2024-09-13T18:47:56.617780+0000","last_became_active":"2024-09-13T18:45:22.034431+0000","last_became_peered":"2024-09-13T18:45:22.034431+0000","last_unstale":"2024-09-13T18:47:56.617780+0000","last_undegraded":"2024-09-13T18:47:56.617780+0000","last_fullsized":"2024-09-13T18:47:56.617780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617499+0000","last_change":"2024-09-13T18:45:26.052892+0000","last_active":"2024-09-13T18:47:56.617499+0000","last_peered":"2024-09-13T18:47:56.617499+0000","last_clean":"2024-09-13T18:47:56.617499+0000","last_became_active":"2024-09-13T18:45:26.052441+0000","last_became_peered":"2024-09-13T18:45:26.052441+0000","last_unstale":"2024-09-13T18:47:56.617499+0000","last_undegraded":"2024-09-13T18:47:56.617499+0000","last_fullsized":"2024-09-13T18:47:56.617499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:26.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.616424+0000","last_change":"2024-09-13T18:45:22.017741+0000","last_active":"2024-09-13T18:47:36.616424+0000","last_peered":"2024-09-13T18:47:36.616424+0000","last_clean":"2024-09-13T18:47:36.616424+0000","last_became_active":"2024-09-13T18:45:22.015758+0000","last_became_peered":"2024-09-13T18:45:22.015758+0000","last_unstale":"2024-09-13T18:47:36.616424+0000","last_undegraded":"2024-09-13T18:47:36.616424+0000","last_fullsized":"2024-09-13T18:47:36.616424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.103891+0000","last_change":"2024-09-13T18:45:21.672627+0000","last_active":"2024-09-13T18:48:12.103891+0000","last_peered":"2024-09-13T18:48:12.103891+0000","last_clean":"2024-09-13T18:48:12.103891+0000","last_became_active":"2024-09-13T18:45:21.672388+0000","last_became_peered":"2024-09-13T18:45:21.672388+0000","last_unstale":"2024-09-13T18:48:12.103891+0000","last_undegraded":"2024-09-13T18:48:12.103891+0000","last_fullsized":"2024-09-13T18:48:12.103891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615702+0000","last_change":"2024-09-13T18:46:11.150163+0000","last_active":"2024-09-13T18:47:41.615702+0000","last_peered":"2024-09-13T18:47:41.615702+0000","last_clean":"2024-09-13T18:47:41.615702+0000","last_became_active":"2024-09-13T18:46:11.149623+0000","last_became_peered":"2024-09-13T18:46:11.149623+0000","last_unstale":"2024-09-13T18:47:41.615702+0000","last_undegraded":"2024-09-13T18:47:41.615702+0000","last_fullsized":"2024-09-13T18:47:41.615702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:18.721386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.616049+0000","last_change":"2024-09-13T18:45:22.028858+0000","last_active":"2024-09-13T18:47:41.616049+0000","last_peered":"2024-09-13T18:47:41.616049+0000","last_clean":"2024-09-13T18:47:41.616049+0000","last_became_active":"2024-09-13T18:45:22.028336+0000","last_became_peered":"2024-09-13T18:45:22.028336+0000","last_unstale":"2024-09-13T18:47:41.616049+0000","last_undegraded":"2024-09-13T18:47:41.616049+0000","last_fullsized":"2024-09-13T18:47:41.616049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.618669+0000","last_change":"2024-09-13T18:45:21.667983+0000","last_active":"2024-09-13T18:47:31.618669+0000","last_peered":"2024-09-13T18:47:31.618669+0000","last_clean":"2024-09-13T18:47:31.618669+0000","last_became_active":"2024-09-13T18:45:21.667625+0000","last_became_peered":"2024-09-13T18:45:21.667625+0000","last_unstale":"2024-09-13T18:47:31.618669+0000","last_undegraded":"2024-09-13T18:47:31.618669+0000","last_fullsized":"2024-09-13T18:47:31.618669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615662+0000","last_change":"2024-09-13T18:45:26.050576+0000","last_active":"2024-09-13T18:47:41.615662+0000","last_peered":"2024-09-13T18:47:41.615662+0000","last_clean":"2024-09-13T18:47:41.615662+0000","last_became_active":"2024-09-13T18:45:26.049129+0000","last_became_peered":"2024-09-13T18:45:26.049129+0000","last_unstale":"2024-09-13T18:47:41.615662+0000","last_undegraded":"2024-09-13T18:47:41.615662+0000","last_fullsized":"2024-09-13T18:47:41.615662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:21.620581+0000","last_change":"2024-09-13T18:46:11.149400+0000","last_active":"2024-09-13T18:48:21.620581+0000","last_peered":"2024-09-13T18:48:21.620581+0000","last_clean":"2024-09-13T18:48:21.620581+0000","last_became_active":"2024-09-13T18:46:11.149036+0000","last_became_peered":"2024-09-13T18:46:11.149036+0000","last_unstale":"2024-09-13T18:48:21.620581+0000","last_undegraded":"2024-09-13T18:48:21.620581+0000","last_fullsized":"2024-09-13T18:48:21.620581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:06.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.104292+0000","last_change":"2024-09-13T18:45:21.668525+0000","last_active":"2024-09-13T18:48:12.104292+0000","last_peered":"2024-09-13T18:48:12.104292+0000","last_clean":"2024-09-13T18:48:12.104292+0000","last_became_active":"2024-09-13T18:45:21.668242+0000","last_became_peered":"2024-09-13T18:45:21.668242+0000","last_unstale":"2024-09-13T18:48:12.104292+0000","last_undegraded":"2024-09-13T18:48:12.104292+0000","last_fullsized":"2024-09-13T18:48:12.104292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.620048+0000","last_change":"2024-09-13T18:45:26.255263+0000","last_active":"2024-09-13T18:47:41.620048+0000","last_peered":"2024-09-13T18:47:41.620048+0000","last_clean":"2024-09-13T18:47:41.620048+0000","last_became_active":"2024-09-13T18:45:26.254886+0000","last_became_peered":"2024-09-13T18:45:26.254886+0000","last_unstale":"2024-09-13T18:47:41.620048+0000","last_undegraded":"2024-09-13T18:47:41.620048+0000","last_fullsized":"2024-09-13T18:47:41.620048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614954+0000","last_change":"2024-09-13T18:45:22.029624+0000","last_active":"2024-09-13T18:47:36.614954+0000","last_peered":"2024-09-13T18:47:36.614954+0000","last_clean":"2024-09-13T18:47:36.614954+0000","last_became_active":"2024-09-13T18:45:22.027835+0000","last_became_peered":"2024-09-13T18:45:22.027835+0000","last_unstale":"2024-09-13T18:47:36.614954+0000","last_undegraded":"2024-09-13T18:47:36.614954+0000","last_fullsized":"2024-09-13T18:47:36.614954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:16.317986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.107659+0000","last_change":"2024-09-13T18:45:21.669073+0000","last_active":"2024-09-13T18:48:17.107659+0000","last_peered":"2024-09-13T18:48:17.107659+0000","last_clean":"2024-09-13T18:48:17.107659+0000","last_became_active":"2024-09-13T18:45:21.668765+0000","last_became_peered":"2024-09-13T18:45:21.668765+0000","last_unstale":"2024-09-13T18:48:17.107659+0000","last_undegraded":"2024-09-13T18:48:17.107659+0000","last_fullsized":"2024-09-13T18:48:17.107659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615720+0000","last_change":"2024-09-13T18:45:26.050623+0000","last_active":"2024-09-13T18:47:41.615720+0000","last_peered":"2024-09-13T18:47:41.615720+0000","last_clean":"2024-09-13T18:47:41.615720+0000","last_became_active":"2024-09-13T18:45:26.049408+0000","last_became_peered":"2024-09-13T18:45:26.049408+0000","last_unstale":"2024-09-13T18:47:41.615720+0000","last_undegraded":"2024-09-13T18:47:41.615720+0000","last_fullsized":"2024-09-13T18:47:41.615720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:14.574386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614490+0000","last_change":"2024-09-13T18:45:22.022220+0000","last_active":"2024-09-13T18:47:36.614490+0000","last_peered":"2024-09-13T18:47:36.614490+0000","last_clean":"2024-09-13T18:47:36.614490+0000","last_became_active":"2024-09-13T18:45:22.021976+0000","last_became_peered":"2024-09-13T18:45:22.021976+0000","last_unstale":"2024-09-13T18:47:36.614490+0000","last_undegraded":"2024-09-13T18:47:36.614490+0000","last_fullsized":"2024-09-13T18:47:36.614490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:32.113775+0000","last_change":"2024-09-13T18:45:21.667931+0000","last_active":"2024-09-13T18:48:32.113775+0000","last_peered":"2024-09-13T18:48:32.113775+0000","last_clean":"2024-09-13T18:48:32.113775+0000","last_became_active":"2024-09-13T18:45:21.667680+0000","last_became_peered":"2024-09-13T18:45:21.667680+0000","last_unstale":"2024-09-13T18:48:32.113775+0000","last_undegraded":"2024-09-13T18:48:32.113775+0000","last_fullsized":"2024-09-13T18:48:32.113775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614135+0000","last_change":"2024-09-13T18:45:26.255088+0000","last_active":"2024-09-13T18:47:31.614135+0000","last_peered":"2024-09-13T18:47:31.614135+0000","last_clean":"2024-09-13T18:47:31.614135+0000","last_became_active":"2024-09-13T18:45:26.254662+0000","last_became_peered":"2024-09-13T18:45:26.254662+0000","last_unstale":"2024-09-13T18:47:31.614135+0000","last_undegraded":"2024-09-13T18:47:31.614135+0000","last_fullsized":"2024-09-13T18:47:31.614135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615555+0000","last_change":"2024-09-13T18:45:22.026678+0000","last_active":"2024-09-13T18:47:36.615555+0000","last_peered":"2024-09-13T18:47:36.615555+0000","last_clean":"2024-09-13T18:47:36.615555+0000","last_became_active":"2024-09-13T18:45:22.026419+0000","last_became_peered":"2024-09-13T18:45:22.026419+0000","last_unstale":"2024-09-13T18:47:36.615555+0000","last_undegraded":"2024-09-13T18:47:36.615555+0000","last_fullsized":"2024-09-13T18:47:36.615555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'36","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:35.985799+0000","last_change":"2024-09-13T18:45:21.664622+0000","last_active":"2024-09-13T18:50:35.985799+0000","last_peered":"2024-09-13T18:50:35.985799+0000","last_clean":"2024-09-13T18:50:35.985799+0000","last_became_active":"2024-09-13T18:45:21.664066+0000","last_became_peered":"2024-09-13T18:45:21.664066+0000","last_unstale":"2024-09-13T18:50:35.985799+0000","last_undegraded":"2024-09-13T18:50:35.985799+0000","last_fullsized":"2024-09-13T18:50:35.985799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.614068+0000","last_change":"2024-09-13T18:45:26.253888+0000","last_active":"2024-09-13T18:47:26.614068+0000","last_peered":"2024-09-13T18:47:26.614068+0000","last_clean":"2024-09-13T18:47:26.614068+0000","last_became_active":"2024-09-13T18:45:26.253488+0000","last_became_peered":"2024-09-13T18:45:26.253488+0000","last_unstale":"2024-09-13T18:47:26.614068+0000","last_undegraded":"2024-09-13T18:47:26.614068+0000","last_fullsized":"2024-09-13T18:47:26.614068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:44.826493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:36.633429+0000","last_change":"2024-09-13T18:45:22.022940+0000","last_active":"2024-09-13T18:49:36.633429+0000","last_peered":"2024-09-13T18:49:36.633429+0000","last_clean":"2024-09-13T18:49:36.633429+0000","last_became_active":"2024-09-13T18:45:22.022628+0000","last_became_peered":"2024-09-13T18:45:22.022628+0000","last_unstale":"2024-09-13T18:49:36.633429+0000","last_undegraded":"2024-09-13T18:49:36.633429+0000","last_fullsized":"2024-09-13T18:49:36.633429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.085981+0000","last_change":"2024-09-13T18:45:21.668903+0000","last_active":"2024-09-13T18:47:42.085981+0000","last_peered":"2024-09-13T18:47:42.085981+0000","last_clean":"2024-09-13T18:47:42.085981+0000","last_became_active":"2024-09-13T18:45:21.668645+0000","last_became_peered":"2024-09-13T18:45:21.668645+0000","last_unstale":"2024-09-13T18:47:42.085981+0000","last_undegraded":"2024-09-13T18:47:42.085981+0000","last_fullsized":"2024-09-13T18:47:42.085981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:33.143804+0000","last_change":"2024-09-13T18:46:11.658745+0000","last_active":"2024-09-13T18:49:33.143804+0000","last_peered":"2024-09-13T18:49:33.143804+0000","last_clean":"2024-09-13T18:49:33.143804+0000","last_became_active":"2024-09-13T18:46:11.658190+0000","last_became_peered":"2024-09-13T18:46:11.658190+0000","last_unstale":"2024-09-13T18:49:33.143804+0000","last_undegraded":"2024-09-13T18:49:33.143804+0000","last_fullsized":"2024-09-13T18:49:33.143804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:44.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:16.619888+0000","last_change":"2024-09-13T18:46:11.145972+0000","last_active":"2024-09-13T18:48:16.619888+0000","last_peered":"2024-09-13T18:48:16.619888+0000","last_clean":"2024-09-13T18:48:16.619888+0000","last_became_active":"2024-09-13T18:46:11.145524+0000","last_became_peered":"2024-09-13T18:46:11.145524+0000","last_unstale":"2024-09-13T18:48:16.619888+0000","last_undegraded":"2024-09-13T18:48:16.619888+0000","last_fullsized":"2024-09-13T18:48:16.619888+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:45.878704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.617963+0000","last_change":"2024-09-13T18:45:21.661117+0000","last_active":"2024-09-13T18:47:26.617963+0000","last_peered":"2024-09-13T18:47:26.617963+0000","last_clean":"2024-09-13T18:47:26.617963+0000","last_became_active":"2024-09-13T18:45:21.660577+0000","last_became_peered":"2024-09-13T18:45:21.660577+0000","last_unstale":"2024-09-13T18:47:26.617963+0000","last_undegraded":"2024-09-13T18:47:26.617963+0000","last_fullsized":"2024-09-13T18:47:26.617963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.618646+0000","last_change":"2024-09-13T18:45:26.056021+0000","last_active":"2024-09-13T18:47:31.618646+0000","last_peered":"2024-09-13T18:47:31.618646+0000","last_clean":"2024-09-13T18:47:31.618646+0000","last_became_active":"2024-09-13T18:45:26.053877+0000","last_became_peered":"2024-09-13T18:45:26.053877+0000","last_unstale":"2024-09-13T18:47:31.618646+0000","last_undegraded":"2024-09-13T18:47:31.618646+0000","last_fullsized":"2024-09-13T18:47:31.618646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:51.489422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:33.143704+0000","last_change":"2024-09-13T18:45:22.029936+0000","last_active":"2024-09-13T18:49:33.143704+0000","last_peered":"2024-09-13T18:49:33.143704+0000","last_clean":"2024-09-13T18:49:33.143704+0000","last_became_active":"2024-09-13T18:45:22.028714+0000","last_became_peered":"2024-09-13T18:45:22.028714+0000","last_unstale":"2024-09-13T18:49:33.143704+0000","last_undegraded":"2024-09-13T18:49:33.143704+0000","last_fullsized":"2024-09-13T18:49:33.143704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:35.746368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:52.092714+0000","last_change":"2024-09-13T18:45:21.667926+0000","last_active":"2024-09-13T18:47:52.092714+0000","last_peered":"2024-09-13T18:47:52.092714+0000","last_clean":"2024-09-13T18:47:52.092714+0000","last_became_active":"2024-09-13T18:45:21.667320+0000","last_became_peered":"2024-09-13T18:45:21.667320+0000","last_unstale":"2024-09-13T18:47:52.092714+0000","last_undegraded":"2024-09-13T18:47:52.092714+0000","last_fullsized":"2024-09-13T18:47:52.092714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:33.926106+0000","last_change":"2024-09-13T18:46:11.148369+0000","last_active":"2024-09-13T18:50:33.926106+0000","last_peered":"2024-09-13T18:50:33.926106+0000","last_clean":"2024-09-13T18:50:33.926106+0000","last_became_active":"2024-09-13T18:46:11.147801+0000","last_became_peered":"2024-09-13T18:46:11.147801+0000","last_unstale":"2024-09-13T18:50:33.926106+0000","last_undegraded":"2024-09-13T18:50:33.926106+0000","last_fullsized":"2024-09-13T18:50:33.926106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:54.923780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.617879+0000","last_change":"2024-09-13T18:45:22.023623+0000","last_active":"2024-09-13T18:47:26.617879+0000","last_peered":"2024-09-13T18:47:26.617879+0000","last_clean":"2024-09-13T18:47:26.617879+0000","last_became_active":"2024-09-13T18:45:22.023357+0000","last_became_peered":"2024-09-13T18:45:22.023357+0000","last_unstale":"2024-09-13T18:47:26.617879+0000","last_undegraded":"2024-09-13T18:47:26.617879+0000","last_fullsized":"2024-09-13T18:47:26.617879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'45","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:36.172250+0000","last_change":"2024-09-13T18:45:21.668065+0000","last_active":"2024-09-13T18:50:36.172250+0000","last_peered":"2024-09-13T18:50:36.172250+0000","last_clean":"2024-09-13T18:50:36.172250+0000","last_became_active":"2024-09-13T18:45:21.667768+0000","last_became_peered":"2024-09-13T18:45:21.667768+0000","last_unstale":"2024-09-13T18:50:36.172250+0000","last_undegraded":"2024-09-13T18:50:36.172250+0000","last_fullsized":"2024-09-13T18:50:36.172250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10924,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":39,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.619282+0000","last_change":"2024-09-13T18:45:26.057274+0000","last_active":"2024-09-13T18:47:36.619282+0000","last_peered":"2024-09-13T18:47:36.619282+0000","last_clean":"2024-09-13T18:47:36.619282+0000","last_became_active":"2024-09-13T18:45:26.056850+0000","last_became_peered":"2024-09-13T18:45:26.056850+0000","last_unstale":"2024-09-13T18:47:36.619282+0000","last_undegraded":"2024-09-13T18:47:36.619282+0000","last_fullsized":"2024-09-13T18:47:36.619282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.971516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.613727+0000","last_change":"2024-09-13T18:45:22.020577+0000","last_active":"2024-09-13T18:47:31.613727+0000","last_peered":"2024-09-13T18:47:31.613727+0000","last_clean":"2024-09-13T18:47:31.613727+0000","last_became_active":"2024-09-13T18:45:22.020317+0000","last_became_peered":"2024-09-13T18:45:22.020317+0000","last_unstale":"2024-09-13T18:47:31.613727+0000","last_undegraded":"2024-09-13T18:47:31.613727+0000","last_fullsized":"2024-09-13T18:47:31.613727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112381+0000","last_change":"2024-09-13T18:45:21.667753+0000","last_active":"2024-09-13T18:48:27.112381+0000","last_peered":"2024-09-13T18:48:27.112381+0000","last_clean":"2024-09-13T18:48:27.112381+0000","last_became_active":"2024-09-13T18:45:21.667483+0000","last_became_peered":"2024-09-13T18:45:21.667483+0000","last_unstale":"2024-09-13T18:48:27.112381+0000","last_undegraded":"2024-09-13T18:48:27.112381+0000","last_fullsized":"2024-09-13T18:48:27.112381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:22.171336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614460+0000","last_change":"2024-09-13T18:45:26.254703+0000","last_active":"2024-09-13T18:47:36.614460+0000","last_peered":"2024-09-13T18:47:36.614460+0000","last_clean":"2024-09-13T18:47:36.614460+0000","last_became_active":"2024-09-13T18:45:26.253533+0000","last_became_peered":"2024-09-13T18:45:26.253533+0000","last_unstale":"2024-09-13T18:47:36.614460+0000","last_undegraded":"2024-09-13T18:47:36.614460+0000","last_fullsized":"2024-09-13T18:47:36.614460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614845+0000","last_change":"2024-09-13T18:45:22.032365+0000","last_active":"2024-09-13T18:47:31.614845+0000","last_peered":"2024-09-13T18:47:31.614845+0000","last_clean":"2024-09-13T18:47:31.614845+0000","last_became_active":"2024-09-13T18:45:22.032109+0000","last_became_peered":"2024-09-13T18:45:22.032109+0000","last_unstale":"2024-09-13T18:47:31.614845+0000","last_undegraded":"2024-09-13T18:47:31.614845+0000","last_fullsized":"2024-09-13T18:47:31.614845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.110221+0000","last_change":"2024-09-13T18:45:21.662636+0000","last_active":"2024-09-13T18:48:22.110221+0000","last_peered":"2024-09-13T18:48:22.110221+0000","last_clean":"2024-09-13T18:48:22.110221+0000","last_became_active":"2024-09-13T18:45:21.662344+0000","last_became_peered":"2024-09-13T18:45:21.662344+0000","last_unstale":"2024-09-13T18:48:22.110221+0000","last_undegraded":"2024-09-13T18:48:22.110221+0000","last_fullsized":"2024-09-13T18:48:22.110221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:21.613035+0000","last_change":"2024-09-13T18:45:19.778048+0000","last_active":"2024-09-13T18:47:21.613035+0000","last_peered":"2024-09-13T18:47:21.613035+0000","last_clean":"2024-09-13T18:47:21.613035+0000","last_became_active":"2024-09-13T18:45:19.777172+0000","last_became_peered":"2024-09-13T18:45:19.777172+0000","last_unstale":"2024-09-13T18:47:21.613035+0000","last_undegraded":"2024-09-13T18:47:21.613035+0000","last_fullsized":"2024-09-13T18:47:21.613035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_clean_scrub_stamp":"2024-09-13T18:45:17.981407+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:51.905955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615939+0000","last_change":"2024-09-13T18:45:26.253260+0000","last_active":"2024-09-13T18:47:31.615939+0000","last_peered":"2024-09-13T18:47:31.615939+0000","last_clean":"2024-09-13T18:47:31.615939+0000","last_became_active":"2024-09-13T18:45:26.252890+0000","last_became_peered":"2024-09-13T18:45:26.252890+0000","last_unstale":"2024-09-13T18:47:31.615939+0000","last_undegraded":"2024-09-13T18:47:31.615939+0000","last_fullsized":"2024-09-13T18:47:31.615939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615655+0000","last_change":"2024-09-13T18:45:22.036446+0000","last_active":"2024-09-13T18:47:41.615655+0000","last_peered":"2024-09-13T18:47:41.615655+0000","last_clean":"2024-09-13T18:47:41.615655+0000","last_became_active":"2024-09-13T18:45:22.036153+0000","last_became_peered":"2024-09-13T18:45:22.036153+0000","last_unstale":"2024-09-13T18:47:41.615655+0000","last_undegraded":"2024-09-13T18:47:41.615655+0000","last_fullsized":"2024-09-13T18:47:41.615655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:51.629396+0000","last_change":"2024-09-13T18:45:21.665847+0000","last_active":"2024-09-13T18:49:51.629396+0000","last_peered":"2024-09-13T18:49:51.629396+0000","last_clean":"2024-09-13T18:49:51.629396+0000","last_became_active":"2024-09-13T18:45:21.665582+0000","last_became_peered":"2024-09-13T18:45:21.665582+0000","last_unstale":"2024-09-13T18:49:51.629396+0000","last_undegraded":"2024-09-13T18:49:51.629396+0000","last_fullsized":"2024-09-13T18:49:51.629396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.616410+0000","last_change":"2024-09-13T18:45:26.250391+0000","last_active":"2024-09-13T18:47:36.616410+0000","last_peered":"2024-09-13T18:47:36.616410+0000","last_clean":"2024-09-13T18:47:36.616410+0000","last_became_active":"2024-09-13T18:45:26.249986+0000","last_became_peered":"2024-09-13T18:45:26.249986+0000","last_unstale":"2024-09-13T18:47:36.616410+0000","last_undegraded":"2024-09-13T18:47:36.616410+0000","last_fullsized":"2024-09-13T18:47:36.616410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.616039+0000","last_change":"2024-09-13T18:45:22.037142+0000","last_active":"2024-09-13T18:47:41.616039+0000","last_peered":"2024-09-13T18:47:41.616039+0000","last_clean":"2024-09-13T18:47:41.616039+0000","last_became_active":"2024-09-13T18:45:22.036523+0000","last_became_peered":"2024-09-13T18:45:22.036523+0000","last_unstale":"2024-09-13T18:47:41.616039+0000","last_undegraded":"2024-09-13T18:47:41.616039+0000","last_fullsized":"2024-09-13T18:47:41.616039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.109845+0000","last_change":"2024-09-13T18:45:21.662924+0000","last_active":"2024-09-13T18:48:22.109845+0000","last_peered":"2024-09-13T18:48:22.109845+0000","last_clean":"2024-09-13T18:48:22.109845+0000","last_became_active":"2024-09-13T18:45:21.662405+0000","last_became_peered":"2024-09-13T18:45:21.662405+0000","last_unstale":"2024-09-13T18:48:22.109845+0000","last_undegraded":"2024-09-13T18:48:22.109845+0000","last_fullsized":"2024-09-13T18:48:22.109845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615002+0000","last_change":"2024-09-13T18:45:26.055309+0000","last_active":"2024-09-13T18:47:41.615002+0000","last_peered":"2024-09-13T18:47:41.615002+0000","last_clean":"2024-09-13T18:47:41.615002+0000","last_became_active":"2024-09-13T18:45:26.054449+0000","last_became_peered":"2024-09-13T18:45:26.054449+0000","last_unstale":"2024-09-13T18:47:41.615002+0000","last_undegraded":"2024-09-13T18:47:41.615002+0000","last_fullsized":"2024-09-13T18:47:41.615002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:46:11.610070+0000","last_change":"2024-09-13T18:46:11.150958+0000","last_active":"2024-09-13T18:46:11.610070+0000","last_peered":"2024-09-13T18:46:11.610070+0000","last_clean":"2024-09-13T18:46:11.610070+0000","last_became_active":"2024-09-13T18:46:11.150605+0000","last_became_peered":"2024-09-13T18:46:11.150605+0000","last_unstale":"2024-09-13T18:46:11.610070+0000","last_undegraded":"2024-09-13T18:46:11.610070+0000","last_fullsized":"2024-09-13T18:46:11.610070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:51.536838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.107379+0000","last_change":"2024-09-13T18:45:21.667622+0000","last_active":"2024-09-13T18:48:17.107379+0000","last_peered":"2024-09-13T18:48:17.107379+0000","last_clean":"2024-09-13T18:48:17.107379+0000","last_became_active":"2024-09-13T18:45:21.667340+0000","last_became_peered":"2024-09-13T18:45:21.667340+0000","last_unstale":"2024-09-13T18:48:17.107379+0000","last_undegraded":"2024-09-13T18:48:17.107379+0000","last_fullsized":"2024-09-13T18:48:17.107379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615280+0000","last_change":"2024-09-13T18:45:26.250450+0000","last_active":"2024-09-13T18:47:36.615280+0000","last_peered":"2024-09-13T18:47:36.615280+0000","last_clean":"2024-09-13T18:47:36.615280+0000","last_became_active":"2024-09-13T18:45:26.250020+0000","last_became_peered":"2024-09-13T18:45:26.250020+0000","last_unstale":"2024-09-13T18:47:36.615280+0000","last_undegraded":"2024-09-13T18:47:36.615280+0000","last_fullsized":"2024-09-13T18:47:36.615280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:46.567482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615721+0000","last_change":"2024-09-13T18:45:22.030584+0000","last_active":"2024-09-13T18:47:41.615721+0000","last_peered":"2024-09-13T18:47:41.615721+0000","last_clean":"2024-09-13T18:47:41.615721+0000","last_became_active":"2024-09-13T18:45:22.030275+0000","last_became_peered":"2024-09-13T18:45:22.030275+0000","last_unstale":"2024-09-13T18:47:41.615721+0000","last_undegraded":"2024-09-13T18:47:41.615721+0000","last_fullsized":"2024-09-13T18:47:41.615721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112091+0000","last_change":"2024-09-13T18:45:21.662490+0000","last_active":"2024-09-13T18:48:27.112091+0000","last_peered":"2024-09-13T18:48:27.112091+0000","last_clean":"2024-09-13T18:48:27.112091+0000","last_became_active":"2024-09-13T18:45:21.662210+0000","last_became_peered":"2024-09-13T18:45:21.662210+0000","last_unstale":"2024-09-13T18:48:27.112091+0000","last_undegraded":"2024-09-13T18:48:27.112091+0000","last_fullsized":"2024-09-13T18:48:27.112091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614925+0000","last_change":"2024-09-13T18:45:26.053575+0000","last_active":"2024-09-13T18:47:36.614925+0000","last_peered":"2024-09-13T18:47:36.614925+0000","last_clean":"2024-09-13T18:47:36.614925+0000","last_became_active":"2024-09-13T18:45:26.053195+0000","last_became_peered":"2024-09-13T18:45:26.053195+0000","last_unstale":"2024-09-13T18:47:36.614925+0000","last_undegraded":"2024-09-13T18:47:36.614925+0000","last_fullsized":"2024-09-13T18:47:36.614925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:28.745002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616177+0000","last_change":"2024-09-13T18:45:22.031817+0000","last_active":"2024-09-13T18:47:46.616177+0000","last_peered":"2024-09-13T18:47:46.616177+0000","last_clean":"2024-09-13T18:47:46.616177+0000","last_became_active":"2024-09-13T18:45:22.031312+0000","last_became_peered":"2024-09-13T18:45:22.031312+0000","last_unstale":"2024-09-13T18:47:46.616177+0000","last_undegraded":"2024-09-13T18:47:46.616177+0000","last_fullsized":"2024-09-13T18:47:46.616177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'11","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.111725+0000","last_change":"2024-09-13T18:45:21.655353+0000","last_active":"2024-09-13T18:48:27.111725+0000","last_peered":"2024-09-13T18:48:27.111725+0000","last_clean":"2024-09-13T18:48:27.111725+0000","last_became_active":"2024-09-13T18:45:21.654844+0000","last_became_peered":"2024-09-13T18:45:21.654844+0000","last_unstale":"2024-09-13T18:48:27.111725+0000","last_undegraded":"2024-09-13T18:48:27.111725+0000","last_fullsized":"2024-09-13T18:48:27.111725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616249+0000","last_change":"2024-09-13T18:45:26.056440+0000","last_active":"2024-09-13T18:47:51.616249+0000","last_peered":"2024-09-13T18:47:51.616249+0000","last_clean":"2024-09-13T18:47:51.616249+0000","last_became_active":"2024-09-13T18:45:26.055955+0000","last_became_peered":"2024-09-13T18:45:26.055955+0000","last_unstale":"2024-09-13T18:47:51.616249+0000","last_undegraded":"2024-09-13T18:47:51.616249+0000","last_fullsized":"2024-09-13T18:47:51.616249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:38.309349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.617402+0000","last_change":"2024-09-13T18:45:22.027821+0000","last_active":"2024-09-13T18:47:46.617402+0000","last_peered":"2024-09-13T18:47:46.617402+0000","last_clean":"2024-09-13T18:47:46.617402+0000","last_became_active":"2024-09-13T18:45:22.027172+0000","last_became_peered":"2024-09-13T18:45:22.027172+0000","last_unstale":"2024-09-13T18:47:46.617402+0000","last_undegraded":"2024-09-13T18:47:46.617402+0000","last_fullsized":"2024-09-13T18:47:46.617402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.107256+0000","last_change":"2024-09-13T18:45:21.664084+0000","last_active":"2024-09-13T18:48:17.107256+0000","last_peered":"2024-09-13T18:48:17.107256+0000","last_clean":"2024-09-13T18:48:17.107256+0000","last_became_active":"2024-09-13T18:45:21.663746+0000","last_became_peered":"2024-09-13T18:45:21.663746+0000","last_unstale":"2024-09-13T18:48:17.107256+0000","last_undegraded":"2024-09-13T18:48:17.107256+0000","last_fullsized":"2024-09-13T18:48:17.107256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617500+0000","last_change":"2024-09-13T18:45:26.253221+0000","last_active":"2024-09-13T18:47:51.617500+0000","last_peered":"2024-09-13T18:47:51.617500+0000","last_clean":"2024-09-13T18:47:51.617500+0000","last_became_active":"2024-09-13T18:45:26.252841+0000","last_became_peered":"2024-09-13T18:45:26.252841+0000","last_unstale":"2024-09-13T18:47:51.617500+0000","last_undegraded":"2024-09-13T18:47:51.617500+0000","last_fullsized":"2024-09-13T18:47:51.617500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:26.396713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616212+0000","last_change":"2024-09-13T18:45:22.033554+0000","last_active":"2024-09-13T18:47:46.616212+0000","last_peered":"2024-09-13T18:47:46.616212+0000","last_clean":"2024-09-13T18:47:46.616212+0000","last_became_active":"2024-09-13T18:45:22.032862+0000","last_became_peered":"2024-09-13T18:45:22.032862+0000","last_unstale":"2024-09-13T18:47:46.616212+0000","last_undegraded":"2024-09-13T18:47:46.616212+0000","last_fullsized":"2024-09-13T18:47:46.616212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'8","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112563+0000","last_change":"2024-09-13T18:45:21.668025+0000","last_active":"2024-09-13T18:48:27.112563+0000","last_peered":"2024-09-13T18:48:27.112563+0000","last_clean":"2024-09-13T18:48:27.112563+0000","last_became_active":"2024-09-13T18:45:21.667457+0000","last_became_peered":"2024-09-13T18:45:21.667457+0000","last_unstale":"2024-09-13T18:48:27.112563+0000","last_undegraded":"2024-09-13T18:48:27.112563+0000","last_fullsized":"2024-09-13T18:48:27.112563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616601+0000","last_change":"2024-09-13T18:45:26.250464+0000","last_active":"2024-09-13T18:47:46.616601+0000","last_peered":"2024-09-13T18:47:46.616601+0000","last_clean":"2024-09-13T18:47:46.616601+0000","last_became_active":"2024-09-13T18:45:26.250041+0000","last_became_peered":"2024-09-13T18:45:26.250041+0000","last_unstale":"2024-09-13T18:47:46.616601+0000","last_undegraded":"2024-09-13T18:47:46.616601+0000","last_fullsized":"2024-09-13T18:47:46.616601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:20.013806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.615471+0000","last_change":"2024-09-13T18:45:22.024133+0000","last_active":"2024-09-13T18:47:46.615471+0000","last_peered":"2024-09-13T18:47:46.615471+0000","last_clean":"2024-09-13T18:47:46.615471+0000","last_became_active":"2024-09-13T18:45:22.023882+0000","last_became_peered":"2024-09-13T18:45:22.023882+0000","last_unstale":"2024-09-13T18:47:46.615471+0000","last_undegraded":"2024-09-13T18:47:46.615471+0000","last_fullsized":"2024-09-13T18:47:46.615471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615027+0000","last_change":"2024-09-13T18:45:21.663297+0000","last_active":"2024-09-13T18:47:41.615027+0000","last_peered":"2024-09-13T18:47:41.615027+0000","last_clean":"2024-09-13T18:47:41.615027+0000","last_became_active":"2024-09-13T18:45:21.662980+0000","last_became_peered":"2024-09-13T18:45:21.662980+0000","last_unstale":"2024-09-13T18:47:41.615027+0000","last_undegraded":"2024-09-13T18:47:41.615027+0000","last_fullsized":"2024-09-13T18:47:41.615027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617186+0000","last_change":"2024-09-13T18:45:26.253184+0000","last_active":"2024-09-13T18:47:51.617186+0000","last_peered":"2024-09-13T18:47:51.617186+0000","last_clean":"2024-09-13T18:47:51.617186+0000","last_became_active":"2024-09-13T18:45:26.252786+0000","last_became_peered":"2024-09-13T18:45:26.252786+0000","last_unstale":"2024-09-13T18:47:51.617186+0000","last_undegraded":"2024-09-13T18:47:51.617186+0000","last_fullsized":"2024-09-13T18:47:51.617186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616847+0000","last_change":"2024-09-13T18:45:22.035052+0000","last_active":"2024-09-13T18:47:51.616847+0000","last_peered":"2024-09-13T18:47:51.616847+0000","last_clean":"2024-09-13T18:47:51.616847+0000","last_became_active":"2024-09-13T18:45:22.034765+0000","last_became_peered":"2024-09-13T18:45:22.034765+0000","last_unstale":"2024-09-13T18:47:51.616847+0000","last_undegraded":"2024-09-13T18:47:51.616847+0000","last_fullsized":"2024-09-13T18:47:51.616847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:28.674827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'99","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:35.986207+0000","last_change":"2024-09-13T18:45:21.668054+0000","last_active":"2024-09-13T18:50:35.986207+0000","last_peered":"2024-09-13T18:50:35.986207+0000","last_clean":"2024-09-13T18:50:35.986207+0000","last_became_active":"2024-09-13T18:45:21.667587+0000","last_became_peered":"2024-09-13T18:45:21.667587+0000","last_unstale":"2024-09-13T18:50:35.986207+0000","last_undegraded":"2024-09-13T18:50:35.986207+0000","last_fullsized":"2024-09-13T18:50:35.986207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":939852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.620478+0000","last_change":"2024-09-13T18:45:26.052997+0000","last_active":"2024-09-13T18:47:46.620478+0000","last_peered":"2024-09-13T18:47:46.620478+0000","last_clean":"2024-09-13T18:47:46.620478+0000","last_became_active":"2024-09-13T18:45:26.052614+0000","last_became_peered":"2024-09-13T18:45:26.052614+0000","last_unstale":"2024-09-13T18:47:46.620478+0000","last_undegraded":"2024-09-13T18:47:46.620478+0000","last_fullsized":"2024-09-13T18:47:46.620478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616204+0000","last_change":"2024-09-13T18:45:22.020754+0000","last_active":"2024-09-13T18:47:46.616204+0000","last_peered":"2024-09-13T18:47:46.616204+0000","last_clean":"2024-09-13T18:47:46.616204+0000","last_became_active":"2024-09-13T18:45:22.020461+0000","last_became_peered":"2024-09-13T18:45:22.020461+0000","last_unstale":"2024-09-13T18:47:46.616204+0000","last_undegraded":"2024-09-13T18:47:46.616204+0000","last_fullsized":"2024-09-13T18:47:46.616204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'28","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:35.178728+0000","last_change":"2024-09-13T18:45:21.664387+0000","last_active":"2024-09-13T18:50:35.178728+0000","last_peered":"2024-09-13T18:50:35.178728+0000","last_clean":"2024-09-13T18:50:35.178728+0000","last_became_active":"2024-09-13T18:45:21.663941+0000","last_became_peered":"2024-09-13T18:45:21.663941+0000","last_unstale":"2024-09-13T18:50:35.178728+0000","last_undegraded":"2024-09-13T18:50:35.178728+0000","last_fullsized":"2024-09-13T18:50:35.178728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616153+0000","last_change":"2024-09-13T18:45:26.051227+0000","last_active":"2024-09-13T18:47:46.616153+0000","last_peered":"2024-09-13T18:47:46.616153+0000","last_clean":"2024-09-13T18:47:46.616153+0000","last_became_active":"2024-09-13T18:45:26.050757+0000","last_became_peered":"2024-09-13T18:45:26.050757+0000","last_unstale":"2024-09-13T18:47:46.616153+0000","last_undegraded":"2024-09-13T18:47:46.616153+0000","last_fullsized":"2024-09-13T18:47:46.616153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:59.045390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616282+0000","last_change":"2024-09-13T18:45:22.025223+0000","last_active":"2024-09-13T18:47:51.616282+0000","last_peered":"2024-09-13T18:47:51.616282+0000","last_clean":"2024-09-13T18:47:51.616282+0000","last_became_active":"2024-09-13T18:45:22.024972+0000","last_became_peered":"2024-09-13T18:45:22.024972+0000","last_unstale":"2024-09-13T18:47:51.616282+0000","last_undegraded":"2024-09-13T18:47:51.616282+0000","last_fullsized":"2024-09-13T18:47:51.616282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'7","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.104828+0000","last_change":"2024-09-13T18:45:21.666814+0000","last_active":"2024-09-13T18:48:12.104828+0000","last_peered":"2024-09-13T18:48:12.104828+0000","last_clean":"2024-09-13T18:48:12.104828+0000","last_became_active":"2024-09-13T18:45:21.666516+0000","last_became_peered":"2024-09-13T18:45:21.666516+0000","last_unstale":"2024-09-13T18:48:12.104828+0000","last_undegraded":"2024-09-13T18:48:12.104828+0000","last_fullsized":"2024-09-13T18:48:12.104828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616514+0000","last_change":"2024-09-13T18:45:26.057746+0000","last_active":"2024-09-13T18:47:46.616514+0000","last_peered":"2024-09-13T18:47:46.616514+0000","last_clean":"2024-09-13T18:47:46.616514+0000","last_became_active":"2024-09-13T18:45:26.057285+0000","last_became_peered":"2024-09-13T18:45:26.057285+0000","last_unstale":"2024-09-13T18:47:46.616514+0000","last_undegraded":"2024-09-13T18:47:46.616514+0000","last_fullsized":"2024-09-13T18:47:46.616514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617206+0000","last_change":"2024-09-13T18:45:22.031653+0000","last_active":"2024-09-13T18:47:51.617206+0000","last_peered":"2024-09-13T18:47:51.617206+0000","last_clean":"2024-09-13T18:47:51.617206+0000","last_became_active":"2024-09-13T18:45:22.031341+0000","last_became_peered":"2024-09-13T18:45:22.031341+0000","last_unstale":"2024-09-13T18:47:51.617206+0000","last_undegraded":"2024-09-13T18:47:51.617206+0000","last_fullsized":"2024-09-13T18:47:51.617206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112682+0000","last_change":"2024-09-13T18:45:21.664695+0000","last_active":"2024-09-13T18:48:27.112682+0000","last_peered":"2024-09-13T18:48:27.112682+0000","last_clean":"2024-09-13T18:48:27.112682+0000","last_became_active":"2024-09-13T18:45:21.664401+0000","last_became_peered":"2024-09-13T18:45:21.664401+0000","last_unstale":"2024-09-13T18:48:27.112682+0000","last_undegraded":"2024-09-13T18:48:27.112682+0000","last_fullsized":"2024-09-13T18:48:27.112682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616542+0000","last_change":"2024-09-13T18:45:26.254041+0000","last_active":"2024-09-13T18:47:46.616542+0000","last_peered":"2024-09-13T18:47:46.616542+0000","last_clean":"2024-09-13T18:47:46.616542+0000","last_became_active":"2024-09-13T18:45:26.253579+0000","last_became_peered":"2024-09-13T18:45:26.253579+0000","last_unstale":"2024-09-13T18:47:46.616542+0000","last_undegraded":"2024-09-13T18:47:46.616542+0000","last_fullsized":"2024-09-13T18:47:46.616542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:19.171737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.613048+0000","last_change":"2024-09-13T18:45:26.253962+0000","last_active":"2024-09-13T18:47:26.613048+0000","last_peered":"2024-09-13T18:47:26.613048+0000","last_clean":"2024-09-13T18:47:26.613048+0000","last_became_active":"2024-09-13T18:45:26.252979+0000","last_became_peered":"2024-09-13T18:45:26.252979+0000","last_unstale":"2024-09-13T18:47:26.613048+0000","last_undegraded":"2024-09-13T18:47:26.613048+0000","last_fullsized":"2024-09-13T18:47:26.613048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.621059+0000","last_change":"2024-09-13T18:45:22.030919+0000","last_active":"2024-09-13T18:47:51.621059+0000","last_peered":"2024-09-13T18:47:51.621059+0000","last_clean":"2024-09-13T18:47:51.621059+0000","last_became_active":"2024-09-13T18:45:22.030453+0000","last_became_peered":"2024-09-13T18:45:22.030453+0000","last_unstale":"2024-09-13T18:47:51.621059+0000","last_undegraded":"2024-09-13T18:47:51.621059+0000","last_fullsized":"2024-09-13T18:47:51.621059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112562+0000","last_change":"2024-09-13T18:45:21.664824+0000","last_active":"2024-09-13T18:48:27.112562+0000","last_peered":"2024-09-13T18:48:27.112562+0000","last_clean":"2024-09-13T18:48:27.112562+0000","last_became_active":"2024-09-13T18:45:21.664571+0000","last_became_peered":"2024-09-13T18:45:21.664571+0000","last_unstale":"2024-09-13T18:48:27.112562+0000","last_undegraded":"2024-09-13T18:48:27.112562+0000","last_fullsized":"2024-09-13T18:48:27.112562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615970+0000","last_change":"2024-09-13T18:45:26.054920+0000","last_active":"2024-09-13T18:47:31.615970+0000","last_peered":"2024-09-13T18:47:31.615970+0000","last_clean":"2024-09-13T18:47:31.615970+0000","last_became_active":"2024-09-13T18:45:26.054510+0000","last_became_peered":"2024-09-13T18:45:26.054510+0000","last_unstale":"2024-09-13T18:47:31.615970+0000","last_undegraded":"2024-09-13T18:47:31.615970+0000","last_fullsized":"2024-09-13T18:47:31.615970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:32.061769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617366+0000","last_change":"2024-09-13T18:45:22.028321+0000","last_active":"2024-09-13T18:47:51.617366+0000","last_peered":"2024-09-13T18:47:51.617366+0000","last_clean":"2024-09-13T18:47:51.617366+0000","last_became_active":"2024-09-13T18:45:22.028062+0000","last_became_peered":"2024-09-13T18:45:22.028062+0000","last_unstale":"2024-09-13T18:47:51.617366+0000","last_undegraded":"2024-09-13T18:47:51.617366+0000","last_fullsized":"2024-09-13T18:47:51.617366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.109768+0000","last_change":"2024-09-13T18:45:21.672763+0000","last_active":"2024-09-13T18:48:22.109768+0000","last_peered":"2024-09-13T18:48:22.109768+0000","last_clean":"2024-09-13T18:48:22.109768+0000","last_became_active":"2024-09-13T18:45:21.672470+0000","last_became_peered":"2024-09-13T18:45:21.672470+0000","last_unstale":"2024-09-13T18:48:22.109768+0000","last_undegraded":"2024-09-13T18:48:22.109768+0000","last_fullsized":"2024-09-13T18:48:22.109768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.098429+0000","last_change":"2024-09-13T18:45:21.660195+0000","last_active":"2024-09-13T18:48:02.098429+0000","last_peered":"2024-09-13T18:48:02.098429+0000","last_clean":"2024-09-13T18:48:02.098429+0000","last_became_active":"2024-09-13T18:45:21.659912+0000","last_became_peered":"2024-09-13T18:45:21.659912+0000","last_unstale":"2024-09-13T18:48:02.098429+0000","last_undegraded":"2024-09-13T18:48:02.098429+0000","last_fullsized":"2024-09-13T18:48:02.098429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.616788+0000","last_change":"2024-09-13T18:45:22.024571+0000","last_active":"2024-09-13T18:47:56.616788+0000","last_peered":"2024-09-13T18:47:56.616788+0000","last_clean":"2024-09-13T18:47:56.616788+0000","last_became_active":"2024-09-13T18:45:22.024305+0000","last_became_peered":"2024-09-13T18:45:22.024305+0000","last_unstale":"2024-09-13T18:47:56.616788+0000","last_undegraded":"2024-09-13T18:47:56.616788+0000","last_fullsized":"2024-09-13T18:47:56.616788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617977+0000","last_change":"2024-09-13T18:45:26.056207+0000","last_active":"2024-09-13T18:47:56.617977+0000","last_peered":"2024-09-13T18:47:56.617977+0000","last_clean":"2024-09-13T18:47:56.617977+0000","last_became_active":"2024-09-13T18:45:26.055794+0000","last_became_peered":"2024-09-13T18:45:26.055794+0000","last_unstale":"2024-09-13T18:47:56.617977+0000","last_undegraded":"2024-09-13T18:47:56.617977+0000","last_fullsized":"2024-09-13T18:47:56.617977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:29.520825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617441+0000","last_change":"2024-09-13T18:45:21.670376+0000","last_active":"2024-09-13T18:47:51.617441+0000","last_peered":"2024-09-13T18:47:51.617441+0000","last_clean":"2024-09-13T18:47:51.617441+0000","last_became_active":"2024-09-13T18:45:21.670083+0000","last_became_peered":"2024-09-13T18:45:21.670083+0000","last_unstale":"2024-09-13T18:47:51.617441+0000","last_undegraded":"2024-09-13T18:47:51.617441+0000","last_fullsized":"2024-09-13T18:47:51.617441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617522+0000","last_change":"2024-09-13T18:45:22.021774+0000","last_active":"2024-09-13T18:47:56.617522+0000","last_peered":"2024-09-13T18:47:56.617522+0000","last_clean":"2024-09-13T18:47:56.617522+0000","last_became_active":"2024-09-13T18:45:22.021496+0000","last_became_peered":"2024-09-13T18:45:22.021496+0000","last_unstale":"2024-09-13T18:47:56.617522+0000","last_undegraded":"2024-09-13T18:47:56.617522+0000","last_fullsized":"2024-09-13T18:47:56.617522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:44.234639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.618047+0000","last_change":"2024-09-13T18:45:26.050478+0000","last_active":"2024-09-13T18:47:56.618047+0000","last_peered":"2024-09-13T18:47:56.618047+0000","last_clean":"2024-09-13T18:47:56.618047+0000","last_became_active":"2024-09-13T18:45:26.050095+0000","last_became_peered":"2024-09-13T18:45:26.050095+0000","last_unstale":"2024-09-13T18:47:56.618047+0000","last_undegraded":"2024-09-13T18:47:56.618047+0000","last_fullsized":"2024-09-13T18:47:56.618047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:28.276515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615874+0000","last_change":"2024-09-13T18:45:22.028025+0000","last_active":"2024-09-13T18:47:31.615874+0000","last_peered":"2024-09-13T18:47:31.615874+0000","last_clean":"2024-09-13T18:47:31.615874+0000","last_became_active":"2024-09-13T18:45:22.027528+0000","last_became_peered":"2024-09-13T18:45:22.027528+0000","last_unstale":"2024-09-13T18:47:31.615874+0000","last_undegraded":"2024-09-13T18:47:31.615874+0000","last_fullsized":"2024-09-13T18:47:31.615874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615332+0000","last_change":"2024-09-13T18:45:22.024615+0000","last_active":"2024-09-13T18:47:31.615332+0000","last_peered":"2024-09-13T18:47:31.615332+0000","last_clean":"2024-09-13T18:47:31.615332+0000","last_became_active":"2024-09-13T18:45:22.024369+0000","last_became_peered":"2024-09-13T18:45:22.024369+0000","last_unstale":"2024-09-13T18:47:31.615332+0000","last_undegraded":"2024-09-13T18:47:31.615332+0000","last_fullsized":"2024-09-13T18:47:31.615332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614768+0000","last_change":"2024-09-13T18:45:22.035861+0000","last_active":"2024-09-13T18:47:31.614768+0000","last_peered":"2024-09-13T18:47:31.614768+0000","last_clean":"2024-09-13T18:47:31.614768+0000","last_became_active":"2024-09-13T18:45:22.034318+0000","last_became_peered":"2024-09-13T18:45:22.034318+0000","last_unstale":"2024-09-13T18:47:31.614768+0000","last_undegraded":"2024-09-13T18:47:31.614768+0000","last_fullsized":"2024-09-13T18:47:31.614768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.613791+0000","last_change":"2024-09-13T18:45:22.033266+0000","last_active":"2024-09-13T18:47:31.613791+0000","last_peered":"2024-09-13T18:47:31.613791+0000","last_clean":"2024-09-13T18:47:31.613791+0000","last_became_active":"2024-09-13T18:45:22.032851+0000","last_became_peered":"2024-09-13T18:45:22.032851+0000","last_unstale":"2024-09-13T18:47:31.613791+0000","last_undegraded":"2024-09-13T18:47:31.613791+0000","last_fullsized":"2024-09-13T18:47:31.613791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615463+0000","last_change":"2024-09-13T18:45:22.033500+0000","last_active":"2024-09-13T18:47:36.615463+0000","last_peered":"2024-09-13T18:47:36.615463+0000","last_clean":"2024-09-13T18:47:36.615463+0000","last_became_active":"2024-09-13T18:45:22.033156+0000","last_became_peered":"2024-09-13T18:45:22.033156+0000","last_unstale":"2024-09-13T18:47:36.615463+0000","last_undegraded":"2024-09-13T18:47:36.615463+0000","last_fullsized":"2024-09-13T18:47:36.615463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.619224+0000","last_change":"2024-09-13T18:45:22.029906+0000","last_active":"2024-09-13T18:47:36.619224+0000","last_peered":"2024-09-13T18:47:36.619224+0000","last_clean":"2024-09-13T18:47:36.619224+0000","last_became_active":"2024-09-13T18:45:22.029654+0000","last_became_peered":"2024-09-13T18:45:22.029654+0000","last_unstale":"2024-09-13T18:47:36.619224+0000","last_undegraded":"2024-09-13T18:47:36.619224+0000","last_fullsized":"2024-09-13T18:47:36.619224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.616491+0000","last_change":"2024-09-13T18:45:22.028396+0000","last_active":"2024-09-13T18:47:36.616491+0000","last_peered":"2024-09-13T18:47:36.616491+0000","last_clean":"2024-09-13T18:47:36.616491+0000","last_became_active":"2024-09-13T18:45:22.028031+0000","last_became_peered":"2024-09-13T18:45:22.028031+0000","last_unstale":"2024-09-13T18:47:36.616491+0000","last_undegraded":"2024-09-13T18:47:36.616491+0000","last_fullsized":"2024-09-13T18:47:36.616491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615534+0000","last_change":"2024-09-13T18:45:22.032816+0000","last_active":"2024-09-13T18:47:36.615534+0000","last_peered":"2024-09-13T18:47:36.615534+0000","last_clean":"2024-09-13T18:47:36.615534+0000","last_became_active":"2024-09-13T18:45:22.032561+0000","last_became_peered":"2024-09-13T18:45:22.032561+0000","last_unstale":"2024-09-13T18:47:36.615534+0000","last_undegraded":"2024-09-13T18:47:36.615534+0000","last_fullsized":"2024-09-13T18:47:36.615534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615296+0000","last_change":"2024-09-13T18:45:22.036615+0000","last_active":"2024-09-13T18:47:36.615296+0000","last_peered":"2024-09-13T18:47:36.615296+0000","last_clean":"2024-09-13T18:47:36.615296+0000","last_became_active":"2024-09-13T18:45:22.036380+0000","last_became_peered":"2024-09-13T18:45:22.036380+0000","last_unstale":"2024-09-13T18:47:36.615296+0000","last_undegraded":"2024-09-13T18:47:36.615296+0000","last_fullsized":"2024-09-13T18:47:36.615296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.616019+0000","last_change":"2024-09-13T18:45:22.035082+0000","last_active":"2024-09-13T18:47:41.616019+0000","last_peered":"2024-09-13T18:47:41.616019+0000","last_clean":"2024-09-13T18:47:41.616019+0000","last_became_active":"2024-09-13T18:45:22.034646+0000","last_became_peered":"2024-09-13T18:45:22.034646+0000","last_unstale":"2024-09-13T18:47:41.616019+0000","last_undegraded":"2024-09-13T18:47:41.616019+0000","last_fullsized":"2024-09-13T18:47:41.616019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615955+0000","last_change":"2024-09-13T18:45:22.029195+0000","last_active":"2024-09-13T18:47:41.615955+0000","last_peered":"2024-09-13T18:47:41.615955+0000","last_clean":"2024-09-13T18:47:41.615955+0000","last_became_active":"2024-09-13T18:45:22.028430+0000","last_became_peered":"2024-09-13T18:45:22.028430+0000","last_unstale":"2024-09-13T18:47:41.615955+0000","last_undegraded":"2024-09-13T18:47:41.615955+0000","last_fullsized":"2024-09-13T18:47:41.615955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.614982+0000","last_change":"2024-09-13T18:45:22.019974+0000","last_active":"2024-09-13T18:47:41.614982+0000","last_peered":"2024-09-13T18:47:41.614982+0000","last_clean":"2024-09-13T18:47:41.614982+0000","last_became_active":"2024-09-13T18:45:22.019733+0000","last_became_peered":"2024-09-13T18:45:22.019733+0000","last_unstale":"2024-09-13T18:47:41.614982+0000","last_undegraded":"2024-09-13T18:47:41.614982+0000","last_fullsized":"2024-09-13T18:47:41.614982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.616976+0000","last_change":"2024-09-13T18:45:22.016110+0000","last_active":"2024-09-13T18:47:41.616976+0000","last_peered":"2024-09-13T18:47:41.616976+0000","last_clean":"2024-09-13T18:47:41.616976+0000","last_became_active":"2024-09-13T18:45:22.015868+0000","last_became_peered":"2024-09-13T18:45:22.015868+0000","last_unstale":"2024-09-13T18:47:41.616976+0000","last_undegraded":"2024-09-13T18:47:41.616976+0000","last_fullsized":"2024-09-13T18:47:41.616976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615690+0000","last_change":"2024-09-13T18:45:22.034477+0000","last_active":"2024-09-13T18:47:41.615690+0000","last_peered":"2024-09-13T18:47:41.615690+0000","last_clean":"2024-09-13T18:47:41.615690+0000","last_became_active":"2024-09-13T18:45:22.034019+0000","last_became_peered":"2024-09-13T18:45:22.034019+0000","last_unstale":"2024-09-13T18:47:41.615690+0000","last_undegraded":"2024-09-13T18:47:41.615690+0000","last_fullsized":"2024-09-13T18:47:41.615690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616852+0000","last_change":"2024-09-13T18:45:22.021787+0000","last_active":"2024-09-13T18:47:46.616852+0000","last_peered":"2024-09-13T18:47:46.616852+0000","last_clean":"2024-09-13T18:47:46.616852+0000","last_became_active":"2024-09-13T18:45:22.020415+0000","last_became_peered":"2024-09-13T18:45:22.020415+0000","last_unstale":"2024-09-13T18:47:46.616852+0000","last_undegraded":"2024-09-13T18:47:46.616852+0000","last_fullsized":"2024-09-13T18:47:46.616852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616670+0000","last_change":"2024-09-13T18:45:22.035941+0000","last_active":"2024-09-13T18:47:46.616670+0000","last_peered":"2024-09-13T18:47:46.616670+0000","last_clean":"2024-09-13T18:47:46.616670+0000","last_became_active":"2024-09-13T18:45:22.035491+0000","last_became_peered":"2024-09-13T18:45:22.035491+0000","last_unstale":"2024-09-13T18:47:46.616670+0000","last_undegraded":"2024-09-13T18:47:46.616670+0000","last_fullsized":"2024-09-13T18:47:46.616670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:46:11.607690+0000","last_change":"2024-09-13T18:46:11.147145+0000","last_active":"2024-09-13T18:46:11.607690+0000","last_peered":"2024-09-13T18:46:11.607690+0000","last_clean":"2024-09-13T18:46:11.607690+0000","last_became_active":"2024-09-13T18:46:11.146859+0000","last_became_peered":"2024-09-13T18:46:11.146859+0000","last_unstale":"2024-09-13T18:46:11.607690+0000","last_undegraded":"2024-09-13T18:46:11.607690+0000","last_fullsized":"2024-09-13T18:46:11.607690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:36.388621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.620452+0000","last_change":"2024-09-13T18:45:22.021298+0000","last_active":"2024-09-13T18:47:46.620452+0000","last_peered":"2024-09-13T18:47:46.620452+0000","last_clean":"2024-09-13T18:47:46.620452+0000","last_became_active":"2024-09-13T18:45:22.021042+0000","last_became_peered":"2024-09-13T18:45:22.021042+0000","last_unstale":"2024-09-13T18:47:46.620452+0000","last_undegraded":"2024-09-13T18:47:46.620452+0000","last_fullsized":"2024-09-13T18:47:46.620452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.615452+0000","last_change":"2024-09-13T18:45:22.021628+0000","last_active":"2024-09-13T18:47:46.615452+0000","last_peered":"2024-09-13T18:47:46.615452+0000","last_clean":"2024-09-13T18:47:46.615452+0000","last_became_active":"2024-09-13T18:45:22.021366+0000","last_became_peered":"2024-09-13T18:45:22.021366+0000","last_unstale":"2024-09-13T18:47:46.615452+0000","last_undegraded":"2024-09-13T18:47:46.615452+0000","last_fullsized":"2024-09-13T18:47:46.615452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617423+0000","last_change":"2024-09-13T18:45:22.029051+0000","last_active":"2024-09-13T18:47:51.617423+0000","last_peered":"2024-09-13T18:47:51.617423+0000","last_clean":"2024-09-13T18:47:51.617423+0000","last_became_active":"2024-09-13T18:45:22.028594+0000","last_became_peered":"2024-09-13T18:45:22.028594+0000","last_unstale":"2024-09-13T18:47:51.617423+0000","last_undegraded":"2024-09-13T18:47:51.617423+0000","last_fullsized":"2024-09-13T18:47:51.617423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616896+0000","last_change":"2024-09-13T18:45:22.016996+0000","last_active":"2024-09-13T18:47:51.616896+0000","last_peered":"2024-09-13T18:47:51.616896+0000","last_clean":"2024-09-13T18:47:51.616896+0000","last_became_active":"2024-09-13T18:45:22.016731+0000","last_became_peered":"2024-09-13T18:45:22.016731+0000","last_unstale":"2024-09-13T18:47:51.616896+0000","last_undegraded":"2024-09-13T18:47:51.616896+0000","last_fullsized":"2024-09-13T18:47:51.616896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617981+0000","last_change":"2024-09-13T18:45:22.028649+0000","last_active":"2024-09-13T18:47:51.617981+0000","last_peered":"2024-09-13T18:47:51.617981+0000","last_clean":"2024-09-13T18:47:51.617981+0000","last_became_active":"2024-09-13T18:45:22.027899+0000","last_became_peered":"2024-09-13T18:45:22.027899+0000","last_unstale":"2024-09-13T18:47:51.617981+0000","last_undegraded":"2024-09-13T18:47:51.617981+0000","last_fullsized":"2024-09-13T18:47:51.617981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617999+0000","last_change":"2024-09-13T18:45:22.024291+0000","last_active":"2024-09-13T18:47:51.617999+0000","last_peered":"2024-09-13T18:47:51.617999+0000","last_clean":"2024-09-13T18:47:51.617999+0000","last_became_active":"2024-09-13T18:45:22.024014+0000","last_became_peered":"2024-09-13T18:45:22.024014+0000","last_unstale":"2024-09-13T18:47:51.617999+0000","last_undegraded":"2024-09-13T18:47:51.617999+0000","last_fullsized":"2024-09-13T18:47:51.617999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616937+0000","last_change":"2024-09-13T18:45:22.036551+0000","last_active":"2024-09-13T18:47:51.616937+0000","last_peered":"2024-09-13T18:47:51.616937+0000","last_clean":"2024-09-13T18:47:51.616937+0000","last_became_active":"2024-09-13T18:45:22.036269+0000","last_became_peered":"2024-09-13T18:45:22.036269+0000","last_unstale":"2024-09-13T18:47:51.616937+0000","last_undegraded":"2024-09-13T18:47:51.616937+0000","last_fullsized":"2024-09-13T18:47:51.616937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617957+0000","last_change":"2024-09-13T18:45:22.032392+0000","last_active":"2024-09-13T18:47:56.617957+0000","last_peered":"2024-09-13T18:47:56.617957+0000","last_clean":"2024-09-13T18:47:56.617957+0000","last_became_active":"2024-09-13T18:45:22.027605+0000","last_became_peered":"2024-09-13T18:45:22.027605+0000","last_unstale":"2024-09-13T18:47:56.617957+0000","last_undegraded":"2024-09-13T18:47:56.617957+0000","last_fullsized":"2024-09-13T18:47:56.617957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617446+0000","last_change":"2024-09-13T18:45:22.029307+0000","last_active":"2024-09-13T18:47:56.617446+0000","last_peered":"2024-09-13T18:47:56.617446+0000","last_clean":"2024-09-13T18:47:56.617446+0000","last_became_active":"2024-09-13T18:45:22.029018+0000","last_became_peered":"2024-09-13T18:45:22.029018+0000","last_unstale":"2024-09-13T18:47:56.617446+0000","last_undegraded":"2024-09-13T18:47:56.617446+0000","last_fullsized":"2024-09-13T18:47:56.617446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617701+0000","last_change":"2024-09-13T18:45:22.029061+0000","last_active":"2024-09-13T18:47:56.617701+0000","last_peered":"2024-09-13T18:47:56.617701+0000","last_clean":"2024-09-13T18:47:56.617701+0000","last_became_active":"2024-09-13T18:45:22.028758+0000","last_became_peered":"2024-09-13T18:45:22.028758+0000","last_unstale":"2024-09-13T18:47:56.617701+0000","last_undegraded":"2024-09-13T18:47:56.617701+0000","last_fullsized":"2024-09-13T18:47:56.617701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617479+0000","last_change":"2024-09-13T18:45:22.029690+0000","last_active":"2024-09-13T18:47:56.617479+0000","last_peered":"2024-09-13T18:47:56.617479+0000","last_clean":"2024-09-13T18:47:56.617479+0000","last_became_active":"2024-09-13T18:45:22.029403+0000","last_became_peered":"2024-09-13T18:45:22.029403+0000","last_unstale":"2024-09-13T18:47:56.617479+0000","last_undegraded":"2024-09-13T18:47:56.617479+0000","last_fullsized":"2024-09-13T18:47:56.617479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.614237+0000","last_change":"2024-09-13T18:45:22.038483+0000","last_active":"2024-09-13T18:47:26.614237+0000","last_peered":"2024-09-13T18:47:26.614237+0000","last_clean":"2024-09-13T18:47:26.614237+0000","last_became_active":"2024-09-13T18:45:22.036877+0000","last_became_peered":"2024-09-13T18:45:22.036877+0000","last_unstale":"2024-09-13T18:47:26.614237+0000","last_undegraded":"2024-09-13T18:47:26.614237+0000","last_fullsized":"2024-09-13T18:47:26.614237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.613815+0000","last_change":"2024-09-13T18:45:22.022846+0000","last_active":"2024-09-13T18:47:31.613815+0000","last_peered":"2024-09-13T18:47:31.613815+0000","last_clean":"2024-09-13T18:47:31.613815+0000","last_became_active":"2024-09-13T18:45:22.022618+0000","last_became_peered":"2024-09-13T18:45:22.022618+0000","last_unstale":"2024-09-13T18:47:31.613815+0000","last_undegraded":"2024-09-13T18:47:31.613815+0000","last_fullsized":"2024-09-13T18:47:31.613815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.618716+0000","last_change":"2024-09-13T18:45:22.028545+0000","last_active":"2024-09-13T18:47:31.618716+0000","last_peered":"2024-09-13T18:47:31.618716+0000","last_clean":"2024-09-13T18:47:31.618716+0000","last_became_active":"2024-09-13T18:45:22.028291+0000","last_became_peered":"2024-09-13T18:45:22.028291+0000","last_unstale":"2024-09-13T18:47:31.618716+0000","last_undegraded":"2024-09-13T18:47:31.618716+0000","last_fullsized":"2024-09-13T18:47:31.618716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614388+0000","last_change":"2024-09-13T18:45:22.034460+0000","last_active":"2024-09-13T18:47:31.614388+0000","last_peered":"2024-09-13T18:47:31.614388+0000","last_clean":"2024-09-13T18:47:31.614388+0000","last_became_active":"2024-09-13T18:45:22.033974+0000","last_became_peered":"2024-09-13T18:45:22.033974+0000","last_unstale":"2024-09-13T18:47:31.614388+0000","last_undegraded":"2024-09-13T18:47:31.614388+0000","last_fullsized":"2024-09-13T18:47:31.614388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":951574,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":265,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":1903148,"data_compressed":245052,"data_compressed_allocated":294912,"data_compressed_original":1441792,"omap_allocated":0,"internal_metadata":0},"log_size":328,"ondisk_log_size":328,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":704313,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.42399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.754},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.46999999999999997},"min":{"1min":0.36199999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.65400000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49099999999999999,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70799999999999996,"5min":0.749,"15min":0.749},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.432,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67300000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66200000000000003,"5min":0.755,"15min":0.755},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.48099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.47099999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47299999999999998,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60399999999999998,"5min":0.748,"15min":0.748},"last":0.629}]},{"osd":5,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.52100000000000002},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.54300000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73099999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.57199999999999995},"min":{"1min":0.41199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":655360,"data_stored":1053215,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.67600000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.746,"15min":0.746},"last":0.437},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67700000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70699999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47299999999999998},"min":{"1min":0.33100000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63600000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.42799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.34200000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.41399999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.40000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.36499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":113453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.32600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.626,"5min":0.87,"15min":0.87},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78700000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67600000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54000000000000004,"15min":0.56299999999999994},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.375},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.55200000000000005},"min":{"1min":0.36899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76100000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.33000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33800000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59999999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71999999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.40200000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.39400000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68600000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.443},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.39900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.42099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":113489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.377,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.67400000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.309},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.499,"15min":0.499},"min":{"1min":0.35099999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.255,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66500000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.56200000000000006},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.435,"5min":0.25,"15min":0.25},"max":{"1min":0.747,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.41199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.40400000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59099999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47599999999999998,"15min":0.497},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.434}]},{"osd":6,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72299999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":1.075,"15min":1.075},"last":0.60999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":663552,"data_stored":1058791,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.63600000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.375,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.498,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.28799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.40600000000000003},"min":{"1min":0.251,"5min":0.223,"15min":0.223},"max":{"1min":0.753,"5min":1.121,"15min":1.121},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67200000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.27500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.46800000000000003},"min":{"1min":0.314,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.30199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61299999999999999,"15min":0.58999999999999997},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59699999999999998,"15min":0.623},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81000000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.497}]},{"osd":7,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73199999999999998,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63,"15min":0.67300000000000004},"min":{"1min":0.41899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.50700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":290816,"data_stored":124287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.35899999999999999},"min":{"1min":0.20899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70899999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.375}]},{"osd":1,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40600000000000003,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54300000000000004,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.432,"15min":0.41199999999999998},"min":{"1min":0.27400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.437},"min":{"1min":0.33000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.437},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.438},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70499999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77100000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.627},"min":{"1min":0.46500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.82899999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76700000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.82099999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.621}]},{"osd":6,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.45600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.995,"15min":0.995},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63400000000000001,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83699999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.45100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83299999999999996,"5min":0.874,"15min":0.874},"last":0.70999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":113523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.23599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.56200000000000006,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36399999999999999,"15min":0.34799999999999998},"min":{"1min":0.23499999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.22500000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.52900000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.435,"15min":0.42299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.57499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.38800000000000001},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.308}]},{"osd":4,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.74299999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.375},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79700000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72499999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74199999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77000000000000002,"5min":0.872,"15min":0.872},"last":0.41799999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80200000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":356352,"data_stored":704369,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39900000000000002,"15min":0.42299999999999999},"min":{"1min":0.23300000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.629,"5min":1.496,"15min":1.496},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.40300000000000002},"min":{"1min":0.252,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56699999999999995,"5min":1.024,"15min":1.024},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.26900000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.76300000000000001,"5min":1.518,"15min":1.518},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.29399999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83699999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":1.294,"15min":1.294},"last":0.38},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.64800000000000002},"min":{"1min":0.439,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91500000000000004,"5min":1.198,"15min":1.198},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73899999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.69399999999999995},"min":{"1min":0.42499999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.501},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61699999999999999,"15min":0.64800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96899999999999997,"5min":1.143,"15min":1.143},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60799999999999998,"15min":0.65100000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.72699999999999998,"5min":1.391,"15min":1.391},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66100000000000003,"15min":0.72899999999999998},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84999999999999998,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67900000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.629},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63,"15min":0.68000000000000005},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.82099999999999995,"5min":1.363,"15min":1.363},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":950776,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":939852,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:50:40.045 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:50:40.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.174+0000 7f81fc7e2640 1 Processor -- start 2024-09-13T18:50:40.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.174+0000 7f81fc7e2640 1 -- start start 2024-09-13T18:50:40.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fc7e2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81f40b9e20 0x7f81f413f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:40.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fc7e2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f81f40b4fa0 0x7f81f413fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fc7e2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81f40b5930 0x7f81f406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fc7e2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f406b500 con 0x7f81f40b9e20 2024-09-13T18:50:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fc7e2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f40b45a0 con 0x7f81f40b4fa0 2024-09-13T18:50:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fc7e2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f406c1d0 con 0x7f81f40b5930 2024-09-13T18:50:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fa57e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81f40b9e20 0x7f81f413f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fa57e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81f40b9e20 0x7f81f413f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55918/0 (socket says 172.21.15.29:55918) 2024-09-13T18:50:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fa57e640 1 -- 172.21.15.29:0/3771170296 learned_addr learned my addr 172.21.15.29:0/3771170296 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81f9d7d640 1 --2- 172.21.15.29:0/3771170296 >> v2:172.21.15.96:3300/0 conn(0x7f81f40b4fa0 0x7f81f413fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fad7f640 1 --2- 172.21.15.29:0/3771170296 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81f40b5930 0x7f81f406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fa57e640 1 -- 172.21.15.29:0/3771170296 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81f40b5930 msgr2=0x7f81f406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fa57e640 1 --2- 172.21.15.29:0/3771170296 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81f40b5930 0x7f81f406c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fa57e640 1 -- 172.21.15.29:0/3771170296 >> v2:172.21.15.96:3300/0 conn(0x7f81f40b4fa0 msgr2=0x7f81f413fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:40.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fa57e640 1 --2- 172.21.15.29:0/3771170296 >> v2:172.21.15.96:3300/0 conn(0x7f81f40b4fa0 0x7f81f413fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fa57e640 1 -- 172.21.15.29:0/3771170296 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40ba200 con 0x7f81f40b9e20 2024-09-13T18:50:40.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81fad7f640 1 --2- 172.21.15.29:0/3771170296 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81f40b5930 0x7f81f406c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:40.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.175+0000 7f81f9d7d640 1 --2- 172.21.15.29:0/3771170296 >> v2:172.21.15.96:3300/0 conn(0x7f81f40b4fa0 0x7f81f413fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:40.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.176+0000 7f81fa57e640 1 --2- 172.21.15.29:0/3771170296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81f40b9e20 0x7f81f413f9b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f81f40b3b10 tx=0x7f81f002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104bda9586c80215 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:40.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.176+0000 7f81f957c640 1 -- 172.21.15.29:0/3771170296 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f002ae90 con 0x7f81f40b9e20 2024-09-13T18:50:40.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.176+0000 7f81f957c640 1 -- 172.21.15.29:0/3771170296 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f0032440 con 0x7f81f40b9e20 2024-09-13T18:50:40.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.176+0000 7f81f957c640 1 -- 172.21.15.29:0/3771170296 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f00327d0 con 0x7f81f40b9e20 2024-09-13T18:50:40.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.177+0000 7f81fc7e2640 1 -- 172.21.15.29:0/3771170296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81f40b9e20 msgr2=0x7f81f413f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:40.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.177+0000 7f81fc7e2640 1 --2- 172.21.15.29:0/3771170296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81f40b9e20 0x7f81f413f9b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f81f40b3b10 tx=0x7f81f002a140 comp rx=0 tx=0).stop 2024-09-13T18:50:40.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.177+0000 7f81fc7e2640 1 -- 172.21.15.29:0/3771170296 shutdown_connections 2024-09-13T18:50:40.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.177+0000 7f81fc7e2640 1 --2- 172.21.15.29:0/3771170296 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81f40b5930 0x7f81f406c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.177+0000 7f81fc7e2640 1 --2- 172.21.15.29:0/3771170296 >> v2:172.21.15.96:3300/0 conn(0x7f81f40b4fa0 0x7f81f413fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.177+0000 7f81fc7e2640 1 --2- 172.21.15.29:0/3771170296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81f40b9e20 0x7f81f413f9b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.177+0000 7f81fc7e2640 1 -- 172.21.15.29:0/3771170296 >> 172.21.15.29:0/3771170296 conn(0x7f81f406a5c0 msgr2=0x7f81f40b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:40.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.177+0000 7f81fc7e2640 1 -- 172.21.15.29:0/3771170296 shutdown_connections 2024-09-13T18:50:40.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.177+0000 7f81fc7e2640 1 -- 172.21.15.29:0/3771170296 wait complete. 2024-09-13T18:50:40.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.178+0000 7f81fc7e2640 1 Processor -- start 2024-09-13T18:50:40.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.178+0000 7f81fc7e2640 1 -- start start 2024-09-13T18:50:40.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fc7e2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f40b4fa0 0x7f81f41db430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:40.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fc7e2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81f40b5930 0x7f81f41426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:40.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fc7e2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81f40b9e20 0x7f81f4143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:40.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fc7e2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f41438a0 con 0x7f81f40b9e20 2024-09-13T18:50:40.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fc7e2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40b2fb0 con 0x7f81f40b4fa0 2024-09-13T18:50:40.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fc7e2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40b3290 con 0x7f81f40b5930 2024-09-13T18:50:40.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fad7f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81f40b9e20 0x7f81f4143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:40.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fa57e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f40b4fa0 0x7f81f41db430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:40.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fa57e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f40b4fa0 0x7f81f41db430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:55484/0 (socket says 172.21.15.29:55484) 2024-09-13T18:50:40.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fa57e640 1 -- 172.21.15.29:0/59671901 learned_addr learned my addr 172.21.15.29:0/59671901 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:40.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fad7f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81f40b9e20 0x7f81f4143360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55920/0 (socket says 172.21.15.29:55920) 2024-09-13T18:50:40.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81f9d7d640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81f40b5930 0x7f81f41426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:40.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fad7f640 1 -- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81f40b5930 msgr2=0x7f81f41426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:40.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fad7f640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81f40b5930 0x7f81f41426f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fad7f640 1 -- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f40b4fa0 msgr2=0x7f81f41db430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:40.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fad7f640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f40b4fa0 0x7f81f41db430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fad7f640 1 -- 172.21.15.29:0/59671901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f00094d0 con 0x7f81f40b9e20 2024-09-13T18:50:40.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fad7f640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81f40b9e20 0x7f81f4143360 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f81ec007ec0 tx=0x7f81ec00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:40.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81eaffd640 1 -- 172.21.15.29:0/59671901 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec003b90 con 0x7f81f40b9e20 2024-09-13T18:50:40.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81eaffd640 1 -- 172.21.15.29:0/59671901 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec00f040 con 0x7f81f40b9e20 2024-09-13T18:50:40.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81fc7e2640 1 -- 172.21.15.29:0/59671901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f40b3570 con 0x7f81f40b9e20 2024-09-13T18:50:40.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.179+0000 7f81eaffd640 1 -- 172.21.15.29:0/59671901 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec004030 con 0x7f81f40b9e20 2024-09-13T18:50:40.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.180+0000 7f81fc7e2640 1 -- 172.21.15.29:0/59671901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f40abd10 con 0x7f81f40b9e20 2024-09-13T18:50:40.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.180+0000 7f81fc7e2640 1 -- 172.21.15.29:0/59671901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f40b37b0 con 0x7f81f40b9e20 2024-09-13T18:50:40.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.181+0000 7f81eaffd640 1 -- 172.21.15.29:0/59671901 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f81ec004190 con 0x7f81f40b9e20 2024-09-13T18:50:40.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.181+0000 7f81eaffd640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f81d806ac00 0x7f81d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:40.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.181+0000 7f81eaffd640 1 -- 172.21.15.29:0/59671901 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f81ec089920 con 0x7f81f40b9e20 2024-09-13T18:50:40.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.182+0000 7f81fa57e640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f81d806ac00 0x7f81d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:40.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.182+0000 7f81fa57e640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f81d806ac00 0x7f81d806d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f81f0035040 tx=0x7f81f002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:40.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.186+0000 7f81eaffd640 1 -- 172.21.15.29:0/59671901 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f81ec054880 con 0x7f81f40b9e20 2024-09-13T18:50:40.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.359+0000 7f81fc7e2640 1 -- 172.21.15.29:0/59671901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81f40b3b40 con 0x7f81f40b9e20 2024-09-13T18:50:40.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.360+0000 7f81eaffd640 1 -- 172.21.15.29:0/59671901 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18627 (secure 0 0 0) 0x7f81ec057ea0 con 0x7f81f40b9e20 2024-09-13T18:50:40.363 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:50:40.363 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:46:11.136377+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.f","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:50:40.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.362+0000 7f81fc7e2640 1 -- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f81d806ac00 msgr2=0x7f81d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:40.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.362+0000 7f81fc7e2640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f81d806ac00 0x7f81d806d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f81f0035040 tx=0x7f81f002e000 comp rx=0 tx=0).stop 2024-09-13T18:50:40.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.362+0000 7f81fc7e2640 1 -- 172.21.15.29:0/59671901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81f40b9e20 msgr2=0x7f81f4143360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:40.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.362+0000 7f81fc7e2640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81f40b9e20 0x7f81f4143360 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f81ec007ec0 tx=0x7f81ec00d4a0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.363+0000 7f81fc7e2640 1 -- 172.21.15.29:0/59671901 shutdown_connections 2024-09-13T18:50:40.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.363+0000 7f81fc7e2640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f81d806ac00 0x7f81d806d0c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.363+0000 7f81fc7e2640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81f40b9e20 0x7f81f4143360 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.363+0000 7f81fc7e2640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81f40b5930 0x7f81f41426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.363+0000 7f81fc7e2640 1 --2- 172.21.15.29:0/59671901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f40b4fa0 0x7f81f41db430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:40.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.363+0000 7f81fc7e2640 1 -- 172.21.15.29:0/59671901 >> 172.21.15.29:0/59671901 conn(0x7f81f406a5c0 msgr2=0x7f81f40b8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:40.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.363+0000 7f81fc7e2640 1 -- 172.21.15.29:0/59671901 shutdown_connections 2024-09-13T18:50:40.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:40.363+0000 7f81fc7e2640 1 -- 172.21.15.29:0/59671901 wait complete. 2024-09-13T18:50:41.377 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T18:50:41.378 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:50:41.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.494+0000 7f00cb8b8640 1 Processor -- start 2024-09-13T18:50:41.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.495+0000 7f00cb8b8640 1 -- start start 2024-09-13T18:50:41.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.495+0000 7f00cb8b8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f00c40b44b0 0x7f00c41462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.495+0000 7f00cb8b8640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00c40b3320 0x7f00c413fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.495+0000 7f00cb8b8640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c40b3880 con 0x7f00c40b5f50 2024-09-13T18:50:41.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.495+0000 7f00cb8b8640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c40b5580 con 0x7f00c40b44b0 2024-09-13T18:50:41.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.495+0000 7f00cb8b8640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40b4890 con 0x7f00c40b3320 2024-09-13T18:50:41.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.496+0000 7f00c9e55640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00c40b3320 0x7f00c413fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.496+0000 7f00c9654640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f00c40b44b0 0x7f00c41462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.496+0000 7f00c9e55640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00c40b3320 0x7f00c413fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:60936/0 (socket says 172.21.15.29:60936) 2024-09-13T18:50:41.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.496+0000 7f00c9e55640 1 -- 172.21.15.29:0/2276745742 learned_addr learned my addr 172.21.15.29:0/2276745742 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:41.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.496+0000 7f00c9e55640 1 -- 172.21.15.29:0/2276745742 >> v2:172.21.15.96:3300/0 conn(0x7f00c40b44b0 msgr2=0x7f00c41462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:41.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.496+0000 7f00c9e55640 1 --2- 172.21.15.29:0/2276745742 >> v2:172.21.15.96:3300/0 conn(0x7f00c40b44b0 0x7f00c41462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.496+0000 7f00c9e55640 1 -- 172.21.15.29:0/2276745742 >> v1:172.21.15.96:6789/0 conn(0x7f00c40b5f50 legacy=0x7f00c413f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.496+0000 7f00c9e55640 1 -- 172.21.15.29:0/2276745742 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40b57f0 con 0x7f00c40b3320 2024-09-13T18:50:41.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.496+0000 7f00c9654640 1 --2- 172.21.15.29:0/2276745742 >> v2:172.21.15.96:3300/0 conn(0x7f00c40b44b0 0x7f00c41462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.497+0000 7f00c9e55640 1 --2- 172.21.15.29:0/2276745742 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00c40b3320 0x7f00c413fd00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009e50 tx=0x7f00bc02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51451799590db8d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.497+0000 7f00bbfff640 1 -- 172.21.15.29:0/2276745742 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc031600 con 0x7f00c40b3320 2024-09-13T18:50:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.497+0000 7f00bbfff640 1 -- 172.21.15.29:0/2276745742 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc02d050 con 0x7f00c40b3320 2024-09-13T18:50:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.497+0000 7f00bbfff640 1 -- 172.21.15.29:0/2276745742 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc031980 con 0x7f00c40b3320 2024-09-13T18:50:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.497+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2276745742 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00c40b3320 msgr2=0x7f00c413fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.497+0000 7f00cb8b8640 1 --2- 172.21.15.29:0/2276745742 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00c40b3320 0x7f00c413fd00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009e50 tx=0x7f00bc02a710 comp rx=0 tx=0).stop 2024-09-13T18:50:41.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.498+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2276745742 shutdown_connections 2024-09-13T18:50:41.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.498+0000 7f00cb8b8640 1 --2- 172.21.15.29:0/2276745742 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00c40b3320 0x7f00c413fd00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.498+0000 7f00cb8b8640 1 --2- 172.21.15.29:0/2276745742 >> v2:172.21.15.96:3300/0 conn(0x7f00c40b44b0 0x7f00c41462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.498+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2276745742 >> 172.21.15.29:0/2276745742 conn(0x7f00c40b8050 msgr2=0x7f00c40b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:41.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.498+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2276745742 shutdown_connections 2024-09-13T18:50:41.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.498+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2276745742 wait complete. 2024-09-13T18:50:41.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.499+0000 7f00cb8b8640 1 Processor -- start 2024-09-13T18:50:41.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.499+0000 7f00cb8b8640 1 -- start start 2024-09-13T18:50:41.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.499+0000 7f00cb8b8640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00c40b3320 0x7f00c413d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.499+0000 7f00cb8b8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00c40b44b0 0x7f00c4145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.499+0000 7f00cb8b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c40b5f50 0x7f00c41db070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.499+0000 7f00cb8b8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40b9580 con 0x7f00c40b5f50 2024-09-13T18:50:41.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.499+0000 7f00cb8b8640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40ba9f0 con 0x7f00c40b44b0 2024-09-13T18:50:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.499+0000 7f00cb8b8640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40bacd0 con 0x7f00c40b3320 2024-09-13T18:50:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c9e55640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c40b5f50 0x7f00c41db070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c8e53640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00c40b44b0 0x7f00c4145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c9654640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00c40b3320 0x7f00c413d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c9e55640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c40b5f50 0x7f00c41db070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55934/0 (socket says 172.21.15.29:55934) 2024-09-13T18:50:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c8e53640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00c40b44b0 0x7f00c4145080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.29:55504/0 (socket says 172.21.15.29:55504) 2024-09-13T18:50:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c9e55640 1 -- 172.21.15.29:0/2995352638 learned_addr learned my addr 172.21.15.29:0/2995352638 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c8e53640 1 -- 172.21.15.29:0/2995352638 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00c40b3320 msgr2=0x7f00c413d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c8e53640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00c40b3320 0x7f00c413d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c8e53640 1 -- 172.21.15.29:0/2995352638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c40b5f50 msgr2=0x7f00c41db070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c8e53640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c40b5f50 0x7f00c41db070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c8e53640 1 -- 172.21.15.29:0/2995352638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c0009400 con 0x7f00c40b44b0 2024-09-13T18:50:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c9e55640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c40b5f50 0x7f00c41db070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00c8e53640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00c40b44b0 0x7f00c4145080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f00c40b6330 tx=0x7f00b400c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00b9ffb640 1 -- 172.21.15.29:0/2995352638 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b40052d0 con 0x7f00c40b44b0 2024-09-13T18:50:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00b9ffb640 1 -- 172.21.15.29:0/2995352638 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b4005430 con 0x7f00c40b44b0 2024-09-13T18:50:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00b9ffb640 1 -- 172.21.15.29:0/2995352638 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b4003830 con 0x7f00c40b44b0 2024-09-13T18:50:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.500+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2995352638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00bc009b30 con 0x7f00c40b44b0 2024-09-13T18:50:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.501+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2995352638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c40b9a10 con 0x7f00c40b44b0 2024-09-13T18:50:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.501+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2995352638 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00c4146820 con 0x7f00c40b44b0 2024-09-13T18:50:41.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.502+0000 7f00b9ffb640 1 -- 172.21.15.29:0/2995352638 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f00b4003990 con 0x7f00c40b44b0 2024-09-13T18:50:41.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.503+0000 7f00b9ffb640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f00a806ac30 0x7f00a806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.503+0000 7f00b9ffb640 1 -- 172.21.15.29:0/2995352638 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f00b4088ee0 con 0x7f00c40b44b0 2024-09-13T18:50:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.503+0000 7f00b9ffb640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] conn(0x7f00a8074510 0x7f00a80769b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.503+0000 7f00b9ffb640 1 -- 172.21.15.29:0/2995352638 --> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00a8077080 con 0x7f00a8074510 2024-09-13T18:50:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.503+0000 7f00b9ffb640 1 -- 172.21.15.29:0/2995352638 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00b4089250 con 0x7f00c40b44b0 2024-09-13T18:50:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.503+0000 7f00c9654640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f00a806ac30 0x7f00a806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.503+0000 7f00c9e55640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] conn(0x7f00a8074510 0x7f00a80769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.503+0000 7f00c9e55640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] conn(0x7f00a8074510 0x7f00a80769b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.503+0000 7f00c9654640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f00a806ac30 0x7f00a806d0f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f00c41456e0 tx=0x7f00c0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.504+0000 7f00b9ffb640 1 -- 172.21.15.29:0/2995352638 <== osd.0 v2:172.21.15.29:6808/2605275306 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f00a8077080 con 0x7f00a8074510 2024-09-13T18:50:41.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2995352638 --> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00c4145dc0 con 0x7f00a8074510 2024-09-13T18:50:41.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00b9ffb640 1 -- 172.21.15.29:0/2995352638 <== osd.0 v2:172.21.15.29:6808/2605275306 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f00bc031910 con 0x7f00a8074510 2024-09-13T18:50:41.520 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-13T18:50:41.520 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:50:41.520 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-13T18:50:41.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2995352638 >> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] conn(0x7f00a8074510 msgr2=0x7f00a80769b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00cb8b8640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.29:6808/2605275306,v1:172.21.15.29:6809/2605275306] conn(0x7f00a8074510 0x7f00a80769b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2995352638 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f00a806ac30 msgr2=0x7f00a806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00cb8b8640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f00a806ac30 0x7f00a806d0f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f00c41456e0 tx=0x7f00c0009190 comp rx=0 tx=0).stop 2024-09-13T18:50:41.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2995352638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00c40b44b0 msgr2=0x7f00c4145080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00cb8b8640 1 --2- 172.21.15.29:0/2995352638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00c40b44b0 0x7f00c4145080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f00c40b6330 tx=0x7f00b400c820 comp rx=0 tx=0).stop 2024-09-13T18:50:41.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00c9e55640 1 -- 172.21.15.29:0/2995352638 reap_dead start 2024-09-13T18:50:41.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2995352638 shutdown_connections 2024-09-13T18:50:41.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2995352638 >> 172.21.15.29:0/2995352638 conn(0x7f00c40b8050 msgr2=0x7f00c40b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:41.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2995352638 shutdown_connections 2024-09-13T18:50:41.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.517+0000 7f00cb8b8640 1 -- 172.21.15.29:0/2995352638 wait complete. 2024-09-13T18:50:41.531 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T18:50:41.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.631+0000 7f6f05420640 1 Processor -- start 2024-09-13T18:50:41.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.631+0000 7f6f05420640 1 -- start start 2024-09-13T18:50:41.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6f05420640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f001497b0 0x7f6f00151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6f05420640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f000b86b0 con 0x7f6f000b1020 2024-09-13T18:50:41.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6f05420640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f000b02d0 con 0x7f6f000b82d0 2024-09-13T18:50:41.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6f05420640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000b1680 con 0x7f6f001497b0 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6efe7fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6f000b1020 0x7f6f001490a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41116/0 (socket says 172.21.15.29:41116) 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6efe7fc640 1 -- 172.21.15.29:0/501253579 learned_addr learned my addr 172.21.15.29:0/501253579 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6eff7fe640 1 --2- 172.21.15.29:0/501253579 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f001497b0 0x7f6f00151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6efdffb640 1 -- 172.21.15.29:0/501253579 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670276821 0 0) 0x7f6f000b86b0 con 0x7f6f000b1020 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6efdffb640 1 -- 172.21.15.29:0/501253579 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ee8003520 con 0x7f6f000b1020 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6efdffb640 1 -- 172.21.15.29:0/501253579 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507894273 0 0) 0x7f6f000b02d0 con 0x7f6f000b82d0 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6efdffb640 1 -- 172.21.15.29:0/501253579 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f000b86b0 con 0x7f6f000b82d0 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6eff7fe640 1 -- 172.21.15.29:0/501253579 >> v1:172.21.15.96:6789/0 conn(0x7f6f000b82d0 legacy=0x7f6f00142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6eff7fe640 1 -- 172.21.15.29:0/501253579 >> v1:172.21.15.29:6789/0 conn(0x7f6f000b1020 legacy=0x7f6f001490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.632+0000 7f6eff7fe640 1 -- 172.21.15.29:0/501253579 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f000b1960 con 0x7f6f001497b0 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.633+0000 7f6eff7fe640 1 --2- 172.21.15.29:0/501253579 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f001497b0 0x7f6f00151350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009dc0 tx=0x7f6ef802a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64274e1910550d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.633+0000 7f6efdffb640 1 -- 172.21.15.29:0/501253579 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8007740 con 0x7f6f001497b0 2024-09-13T18:50:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.633+0000 7f6efdffb640 1 -- 172.21.15.29:0/501253579 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef802d050 con 0x7f6f001497b0 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.633+0000 7f6efdffb640 1 -- 172.21.15.29:0/501253579 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8007ac0 con 0x7f6f001497b0 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.634+0000 7f6f05420640 1 -- 172.21.15.29:0/501253579 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f001497b0 msgr2=0x7f6f00151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.634+0000 7f6f05420640 1 --2- 172.21.15.29:0/501253579 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f001497b0 0x7f6f00151350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009dc0 tx=0x7f6ef802a5b0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.634+0000 7f6f05420640 1 -- 172.21.15.29:0/501253579 shutdown_connections 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.634+0000 7f6f05420640 1 --2- 172.21.15.29:0/501253579 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f001497b0 0x7f6f00151350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.634+0000 7f6f05420640 1 -- 172.21.15.29:0/501253579 >> 172.21.15.29:0/501253579 conn(0x7f6f0006a560 msgr2=0x7f6f000b7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.634+0000 7f6f05420640 1 -- 172.21.15.29:0/501253579 shutdown_connections 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.634+0000 7f6f05420640 1 -- 172.21.15.29:0/501253579 wait complete. 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.635+0000 7f6f05420640 1 Processor -- start 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.635+0000 7f6f05420640 1 -- start start 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6f05420640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f000b1020 0x7f6f00070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6f05420640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f000b82d0 0x7f6f001db3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6f05420640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f001497b0 0x7f6f001db8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6f05420640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00146800 con 0x7f6f000b82d0 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6f05420640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00071a70 con 0x7f6f000b1020 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6f05420640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000abb10 con 0x7f6f001497b0 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6efe7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f000b82d0 0x7f6f001db3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6efe7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f000b82d0 0x7f6f001db3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55942/0 (socket says 172.21.15.29:55942) 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6efe7fc640 1 -- 172.21.15.29:0/3281519533 learned_addr learned my addr 172.21.15.29:0/3281519533 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6eff7fe640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f001497b0 0x7f6f001db8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6efeffd640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f000b1020 0x7f6f00070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6efe7fc640 1 -- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f001497b0 msgr2=0x7f6f001db8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6efe7fc640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f001497b0 0x7f6f001db8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6efe7fc640 1 -- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f000b1020 msgr2=0x7f6f00070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6efe7fc640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f000b1020 0x7f6f00070930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6efe7fc640 1 -- 172.21.15.29:0/3281519533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef8009a70 con 0x7f6f000b82d0 2024-09-13T18:50:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6eff7fe640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f001497b0 0x7f6f001db8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6efe7fc640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f000b82d0 0x7f6f001db3b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400c410 tx=0x7f6ef400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.636+0000 7f6ee77fe640 1 -- 172.21.15.29:0/3281519533 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4005ce0 con 0x7f6f000b82d0 2024-09-13T18:50:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.637+0000 7f6ee77fe640 1 -- 172.21.15.29:0/3281519533 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef4005e40 con 0x7f6f000b82d0 2024-09-13T18:50:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.637+0000 7f6f05420640 1 -- 172.21.15.29:0/3281519533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f000abdf0 con 0x7f6f000b82d0 2024-09-13T18:50:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.637+0000 7f6ee77fe640 1 -- 172.21.15.29:0/3281519533 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40072d0 con 0x7f6f000b82d0 2024-09-13T18:50:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.637+0000 7f6f05420640 1 -- 172.21.15.29:0/3281519533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f00070fc0 con 0x7f6f000b82d0 2024-09-13T18:50:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.638+0000 7f6f05420640 1 -- 172.21.15.29:0/3281519533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f00146970 con 0x7f6f000b82d0 2024-09-13T18:50:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.638+0000 7f6ee77fe640 1 -- 172.21.15.29:0/3281519533 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6ef4007430 con 0x7f6f000b82d0 2024-09-13T18:50:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.639+0000 7f6ee77fe640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6eec06ac00 0x7f6eec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.639+0000 7f6ee77fe640 1 -- 172.21.15.29:0/3281519533 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6ef4088b90 con 0x7f6f000b82d0 2024-09-13T18:50:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.639+0000 7f6efeffd640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6eec06ac00 0x7f6eec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.639+0000 7f6efeffd640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6eec06ac00 0x7f6eec06d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00011e0 tx=0x7f6ef0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.643+0000 7f6ee77fe640 1 -- 172.21.15.29:0/3281519533 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6f00146970 con 0x7f6f000b82d0 2024-09-13T18:50:41.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.814+0000 7f6f05420640 1 -- 172.21.15.29:0/3281519533 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f000b4090 con 0x7f6eec06ac00 2024-09-13T18:50:41.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.815+0000 7f6ee77fe640 1 -- 172.21.15.29:0/3281519533 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6ef00014f0 con 0x7f6eec06ac00 2024-09-13T18:50:41.817 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T18:50:41.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.817+0000 7f6f05420640 1 -- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6eec06ac00 msgr2=0x7f6eec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.817+0000 7f6f05420640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6eec06ac00 0x7f6eec06d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00011e0 tx=0x7f6ef0009040 comp rx=0 tx=0).stop 2024-09-13T18:50:41.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.817+0000 7f6f05420640 1 -- 172.21.15.29:0/3281519533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f000b82d0 msgr2=0x7f6f001db3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.817+0000 7f6f05420640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f000b82d0 0x7f6f001db3b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400c410 tx=0x7f6ef400c8d0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.817+0000 7f6f05420640 1 -- 172.21.15.29:0/3281519533 shutdown_connections 2024-09-13T18:50:41.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.817+0000 7f6f05420640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6eec06ac00 0x7f6eec06d0c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.817+0000 7f6f05420640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f001497b0 0x7f6f001db8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.817+0000 7f6f05420640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f000b82d0 0x7f6f001db3b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.817+0000 7f6f05420640 1 --2- 172.21.15.29:0/3281519533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f000b1020 0x7f6f00070930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.817+0000 7f6f05420640 1 -- 172.21.15.29:0/3281519533 >> 172.21.15.29:0/3281519533 conn(0x7f6f0006a560 msgr2=0x7f6f000b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:41.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.817+0000 7f6f05420640 1 -- 172.21.15.29:0/3281519533 shutdown_connections 2024-09-13T18:50:41.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.817+0000 7f6f05420640 1 -- 172.21.15.29:0/3281519533 wait complete. 2024-09-13T18:50:41.830 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T18:50:41.831 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:50:41.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.933+0000 7ff596a90640 1 Processor -- start 2024-09-13T18:50:41.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.933+0000 7ff596a90640 1 -- start start 2024-09-13T18:50:41.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.934+0000 7ff596a90640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff59013fdd0 0x7ff590071210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.934+0000 7ff596a90640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff590071bb0 con 0x7ff59013f9f0 2024-09-13T18:50:41.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.934+0000 7ff596a90640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59006f390 con 0x7ff590145920 2024-09-13T18:50:41.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.934+0000 7ff596a90640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff590070b10 con 0x7ff59013fdd0 2024-09-13T18:50:41.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.934+0000 7ff59482c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff59013f9f0 0x7ff59006aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41118/0 (socket says 172.21.15.29:41118) 2024-09-13T18:50:41.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.934+0000 7ff59482c640 1 -- 172.21.15.29:0/2092749571 learned_addr learned my addr 172.21.15.29:0/2092749571 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:41.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.934+0000 7ff58ffff640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff59013fdd0 0x7ff590071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.934+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839906802 0 0) 0x7ff590071bb0 con 0x7ff59013f9f0 2024-09-13T18:50:41.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.934+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff578003520 con 0x7ff59013f9f0 2024-09-13T18:50:41.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282043403 0 0) 0x7ff59006f390 con 0x7ff590145920 2024-09-13T18:50:41.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff590071bb0 con 0x7ff590145920 2024-09-13T18:50:41.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469687297 0 0) 0x7ff578003520 con 0x7ff59013f9f0 2024-09-13T18:50:41.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff59013fdd0 msgr2=0x7ff590071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:41.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff59013fdd0 0x7ff590071210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 >> v1:172.21.15.96:6789/0 conn(0x7ff590145920 legacy=0x7ff590150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59006f670 con 0x7ff59013f9f0 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7ff580001670 con 0x7ff59013f9f0 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58ffff640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff59013fdd0 0x7ff590071210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 >> v1:172.21.15.29:6789/0 conn(0x7ff59013f9f0 legacy=0x7ff59006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff59013fdd0 0x7ff578003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff578004070 0x7ff5780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff578004d00 0x7ff578005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57800ba90 con 0x7ff578004070 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57800bc00 con 0x7ff578004d00 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57800bdc0 con 0x7ff59013fdd0 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58ffff640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff578004070 0x7ff5780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff59482c640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff59013fdd0 0x7ff578003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff59502d640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff578004d00 0x7ff578005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58ffff640 1 -- 172.21.15.29:0/2092749571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff59013fdd0 msgr2=0x7ff578003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58ffff640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff59013fdd0 0x7ff578003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58ffff640 1 -- 172.21.15.29:0/2092749571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff578004d00 msgr2=0x7ff578005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58ffff640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff578004d00 0x7ff578005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.935+0000 7ff58ffff640 1 -- 172.21.15.29:0/2092749571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff584009400 con 0x7ff578004070 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.936+0000 7ff58ffff640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff578004070 0x7ff5780047c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff584009c40 tx=0x7ff5780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e20636be855ced server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.936+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584031400 con 0x7ff578004070 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.936+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58402d050 con 0x7ff578004070 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.936+0000 7ff58f7fe640 1 -- 172.21.15.29:0/2092749571 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584031780 con 0x7ff578004070 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.936+0000 7ff596a90640 1 -- 172.21.15.29:0/2092749571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff578004070 msgr2=0x7ff5780047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.936+0000 7ff596a90640 1 --2- 172.21.15.29:0/2092749571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff578004070 0x7ff5780047c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff584009c40 tx=0x7ff5780057f0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.937+0000 7ff59502d640 1 -- 172.21.15.29:0/2092749571 reap_dead start 2024-09-13T18:50:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.937+0000 7ff596a90640 1 -- 172.21.15.29:0/2092749571 shutdown_connections 2024-09-13T18:50:41.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.937+0000 7ff596a90640 1 -- 172.21.15.29:0/2092749571 >> 172.21.15.29:0/2092749571 conn(0x7ff5900b4710 msgr2=0x7ff5900b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:41.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.937+0000 7ff596a90640 1 -- 172.21.15.29:0/2092749571 shutdown_connections 2024-09-13T18:50:41.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.937+0000 7ff596a90640 1 -- 172.21.15.29:0/2092749571 wait complete. 2024-09-13T18:50:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.938+0000 7ff596a90640 1 Processor -- start 2024-09-13T18:50:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.938+0000 7ff596a90640 1 -- start start 2024-09-13T18:50:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.938+0000 7ff596a90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff578004070 0x7ff590141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.938+0000 7ff596a90640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff590141f70 0x7ff590138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.938+0000 7ff596a90640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5901393a0 0x7ff5901de460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.938+0000 7ff596a90640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff590140500 con 0x7ff578004070 2024-09-13T18:50:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff596a90640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900ad420 con 0x7ff5901393a0 2024-09-13T18:50:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff596a90640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff590142520 con 0x7ff590141f70 2024-09-13T18:50:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff59482c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff578004070 0x7ff590141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff59482c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff578004070 0x7ff590141a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55962/0 (socket says 172.21.15.29:55962) 2024-09-13T18:50:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff59482c640 1 -- 172.21.15.29:0/3392455750 learned_addr learned my addr 172.21.15.29:0/3392455750 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff58ffff640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff590141f70 0x7ff590138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff59502d640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5901393a0 0x7ff5901de460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff59482c640 1 -- 172.21.15.29:0/3392455750 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff590141f70 msgr2=0x7ff590138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff59482c640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff590141f70 0x7ff590138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff59482c640 1 -- 172.21.15.29:0/3392455750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5901393a0 msgr2=0x7ff5901de460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff59482c640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5901393a0 0x7ff5901de460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff59482c640 1 -- 172.21.15.29:0/3392455750 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590140220 con 0x7ff578004070 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff59482c640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff578004070 0x7ff590141a30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff580007340 tx=0x7ff580007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff58d7fa640 1 -- 172.21.15.29:0/3392455750 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58000f860 con 0x7ff578004070 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff58d7fa640 1 -- 172.21.15.29:0/3392455750 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58000fa00 con 0x7ff578004070 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff596a90640 1 -- 172.21.15.29:0/3392455750 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5900ae180 con 0x7ff578004070 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff58d7fa640 1 -- 172.21.15.29:0/3392455750 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58000fdb0 con 0x7ff578004070 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.939+0000 7ff596a90640 1 -- 172.21.15.29:0/3392455750 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5900ab8c0 con 0x7ff578004070 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.940+0000 7ff596a90640 1 -- 172.21.15.29:0/3392455750 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff59006fb90 con 0x7ff578004070 2024-09-13T18:50:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.941+0000 7ff58d7fa640 1 -- 172.21.15.29:0/3392455750 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff58001d460 con 0x7ff578004070 2024-09-13T18:50:41.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.941+0000 7ff58d7fa640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff57c06ac30 0x7ff57c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.941+0000 7ff58d7fa640 1 -- 172.21.15.29:0/3392455750 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff580089630 con 0x7ff578004070 2024-09-13T18:50:41.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.941+0000 7ff58ffff640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff57c06ac30 0x7ff57c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.941+0000 7ff58d7fa640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] conn(0x7ff57c074510 0x7ff57c0769b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:41.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.942+0000 7ff58d7fa640 1 -- 172.21.15.29:0/3392455750 --> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff57c077080 con 0x7ff57c074510 2024-09-13T18:50:41.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.942+0000 7ff58d7fa640 1 -- 172.21.15.29:0/3392455750 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff58008bcf0 con 0x7ff578004070 2024-09-13T18:50:41.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.942+0000 7ff59502d640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] conn(0x7ff57c074510 0x7ff57c0769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:41.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.942+0000 7ff59502d640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] conn(0x7ff57c074510 0x7ff57c0769b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:41.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.942+0000 7ff58ffff640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff57c06ac30 0x7ff57c06d0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff584033000 tx=0x7ff584008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:41.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.943+0000 7ff58d7fa640 1 -- 172.21.15.29:0/3392455750 <== osd.1 v2:172.21.15.29:6824/2613470093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff57c077080 con 0x7ff57c074510 2024-09-13T18:50:41.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.955+0000 7ff596a90640 1 -- 172.21.15.29:0/3392455750 --> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff5900ae3c0 con 0x7ff57c074510 2024-09-13T18:50:41.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.955+0000 7ff58d7fa640 1 -- 172.21.15.29:0/3392455750 <== osd.1 v2:172.21.15.29:6824/2613470093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff5900ae3c0 con 0x7ff57c074510 2024-09-13T18:50:41.958 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-13T18:50:41.958 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:50:41.958 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-13T18:50:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.955+0000 7ff596a90640 1 -- 172.21.15.29:0/3392455750 >> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] conn(0x7ff57c074510 msgr2=0x7ff57c0769b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.955+0000 7ff596a90640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.29:6824/2613470093,v1:172.21.15.29:6825/2613470093] conn(0x7ff57c074510 0x7ff57c0769b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.955+0000 7ff596a90640 1 -- 172.21.15.29:0/3392455750 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff57c06ac30 msgr2=0x7ff57c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.955+0000 7ff596a90640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7ff57c06ac30 0x7ff57c06d0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff584033000 tx=0x7ff584008030 comp rx=0 tx=0).stop 2024-09-13T18:50:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.955+0000 7ff596a90640 1 -- 172.21.15.29:0/3392455750 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff578004070 msgr2=0x7ff590141a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.955+0000 7ff596a90640 1 --2- 172.21.15.29:0/3392455750 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff578004070 0x7ff590141a30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff580007340 tx=0x7ff580007800 comp rx=0 tx=0).stop 2024-09-13T18:50:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.955+0000 7ff59502d640 1 -- 172.21.15.29:0/3392455750 reap_dead start 2024-09-13T18:50:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.955+0000 7ff596a90640 1 -- 172.21.15.29:0/3392455750 shutdown_connections 2024-09-13T18:50:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.955+0000 7ff596a90640 1 -- 172.21.15.29:0/3392455750 >> 172.21.15.29:0/3392455750 conn(0x7ff5900b4710 msgr2=0x7ff5900b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.956+0000 7ff596a90640 1 -- 172.21.15.29:0/3392455750 shutdown_connections 2024-09-13T18:50:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:41.956+0000 7ff596a90640 1 -- 172.21.15.29:0/3392455750 wait complete. 2024-09-13T18:50:41.968 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T18:50:42.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.071+0000 7efdfbfff640 1 Processor -- start 2024-09-13T18:50:42.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.071+0000 7efdfbfff640 1 -- start start 2024-09-13T18:50:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.071+0000 7efdfbfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efdfc06e950 0x7efdfc13c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.071+0000 7efdfbfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdfc13c700 0x7efdfc14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.072+0000 7efdfbfff640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc0721d0 con 0x7efdfc0b1e50 2024-09-13T18:50:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.072+0000 7efdfbfff640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc0b7f10 con 0x7efdfc13c700 2024-09-13T18:50:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.072+0000 7efdfbfff640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc0b7d00 con 0x7efdfc06e950 2024-09-13T18:50:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.072+0000 7efdfb7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdfc13c700 0x7efdfc14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.072+0000 7efdfb7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdfc13c700 0x7efdfc14cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55976/0 (socket says 172.21.15.29:55976) 2024-09-13T18:50:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.072+0000 7efdfb7fe640 1 -- 172.21.15.29:0/1984691225 learned_addr learned my addr 172.21.15.29:0/1984691225 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.072+0000 7efdfa7fc640 1 --2- 172.21.15.29:0/1984691225 >> v2:172.21.15.96:3300/0 conn(0x7efdfc06e950 0x7efdfc13c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.072+0000 7efdfb7fe640 1 -- 172.21.15.29:0/1984691225 >> v2:172.21.15.96:3300/0 conn(0x7efdfc06e950 msgr2=0x7efdfc13c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.072+0000 7efdfb7fe640 1 --2- 172.21.15.29:0/1984691225 >> v2:172.21.15.96:3300/0 conn(0x7efdfc06e950 0x7efdfc13c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.072+0000 7efdfb7fe640 1 -- 172.21.15.29:0/1984691225 >> v1:172.21.15.96:6789/0 conn(0x7efdfc0b1e50 legacy=0x7efdfc142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.072+0000 7efdfb7fe640 1 -- 172.21.15.29:0/1984691225 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc06ee10 con 0x7efdfc13c700 2024-09-13T18:50:42.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.073+0000 7efdfb7fe640 1 --2- 172.21.15.29:0/1984691225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdfc13c700 0x7efdfc14cdf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0669e0 tx=0x7efdf402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a5918f8f5befab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.073+0000 7efdf9ffb640 1 -- 172.21.15.29:0/1984691225 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4031600 con 0x7efdfc13c700 2024-09-13T18:50:42.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.073+0000 7efdf9ffb640 1 -- 172.21.15.29:0/1984691225 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf402d050 con 0x7efdfc13c700 2024-09-13T18:50:42.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.073+0000 7efdf9ffb640 1 -- 172.21.15.29:0/1984691225 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4031980 con 0x7efdfc13c700 2024-09-13T18:50:42.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.073+0000 7efdfbfff640 1 -- 172.21.15.29:0/1984691225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdfc13c700 msgr2=0x7efdfc14cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.073+0000 7efdfbfff640 1 --2- 172.21.15.29:0/1984691225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdfc13c700 0x7efdfc14cdf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0669e0 tx=0x7efdf402a5d0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.073+0000 7efdfbfff640 1 -- 172.21.15.29:0/1984691225 shutdown_connections 2024-09-13T18:50:42.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.073+0000 7efdfbfff640 1 --2- 172.21.15.29:0/1984691225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdfc13c700 0x7efdfc14cdf0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.073+0000 7efdfbfff640 1 --2- 172.21.15.29:0/1984691225 >> v2:172.21.15.96:3300/0 conn(0x7efdfc06e950 0x7efdfc13c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.073+0000 7efdfbfff640 1 -- 172.21.15.29:0/1984691225 >> 172.21.15.29:0/1984691225 conn(0x7efdfc0b71e0 msgr2=0x7efdfc0b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.073+0000 7efdfbfff640 1 -- 172.21.15.29:0/1984691225 shutdown_connections 2024-09-13T18:50:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.073+0000 7efdfbfff640 1 -- 172.21.15.29:0/1984691225 wait complete. 2024-09-13T18:50:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.075+0000 7efdfbfff640 1 Processor -- start 2024-09-13T18:50:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.075+0000 7efdfbfff640 1 -- start start 2024-09-13T18:50:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.075+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdfc06e950 0x7efdfc0af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.075+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdfc0b1e50 0x7efdfc0ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.075+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdfc13c700 0x7efdfc13b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.075+0000 7efdfbfff640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc13ce60 con 0x7efdfc13c700 2024-09-13T18:50:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.075+0000 7efdfbfff640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0ae840 con 0x7efdfc0b1e50 2024-09-13T18:50:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.075+0000 7efdfbfff640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0abd30 con 0x7efdfc06e950 2024-09-13T18:50:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.075+0000 7efdfb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdfc13c700 0x7efdfc13b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.075+0000 7efdfb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdfc13c700 0x7efdfc13b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55982/0 (socket says 172.21.15.29:55982) 2024-09-13T18:50:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.075+0000 7efdfb7fe640 1 -- 172.21.15.29:0/455527756 learned_addr learned my addr 172.21.15.29:0/455527756 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efdfa7fc640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdfc0b1e50 0x7efdfc0ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efdfaffd640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdfc06e950 0x7efdfc0af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efdfb7fe640 1 -- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdfc06e950 msgr2=0x7efdfc0af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efdfb7fe640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdfc06e950 0x7efdfc0af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efdfb7fe640 1 -- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdfc0b1e50 msgr2=0x7efdfc0ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efdfb7fe640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdfc0b1e50 0x7efdfc0ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efdfb7fe640 1 -- 172.21.15.29:0/455527756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4009b30 con 0x7efdfc13c700 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efdfaffd640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdfc06e950 0x7efdfc0af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efdfb7fe640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdfc13c700 0x7efdfc13b000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009f40 tx=0x7efdf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efde37fe640 1 -- 172.21.15.29:0/455527756 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf403d860 con 0x7efdfc13c700 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efde37fe640 1 -- 172.21.15.29:0/455527756 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf403d9e0 con 0x7efdfc13c700 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efdfbfff640 1 -- 172.21.15.29:0/455527756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc0ac010 con 0x7efdfc13c700 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efde37fe640 1 -- 172.21.15.29:0/455527756 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf403dd90 con 0x7efdfc13c700 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.076+0000 7efdfbfff640 1 -- 172.21.15.29:0/455527756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc0ad9e0 con 0x7efdfc13c700 2024-09-13T18:50:42.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.077+0000 7efdfbfff640 1 -- 172.21.15.29:0/455527756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc0ac250 con 0x7efdfc13c700 2024-09-13T18:50:42.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.078+0000 7efde37fe640 1 -- 172.21.15.29:0/455527756 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efdf403b400 con 0x7efdfc13c700 2024-09-13T18:50:42.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.079+0000 7efde37fe640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efde806ac00 0x7efde806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.079+0000 7efde37fe640 1 -- 172.21.15.29:0/455527756 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efdf40aa5f0 con 0x7efdfc13c700 2024-09-13T18:50:42.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.079+0000 7efdfaffd640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efde806ac00 0x7efde806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.079+0000 7efdfaffd640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efde806ac00 0x7efde806d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efdec003eb0 tx=0x7efdec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.083+0000 7efde37fe640 1 -- 172.21.15.29:0/455527756 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efdfc0ac250 con 0x7efdfc13c700 2024-09-13T18:50:42.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.255+0000 7efdfbfff640 1 -- 172.21.15.29:0/455527756 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7efdfc06f0f0 con 0x7efde806ac00 2024-09-13T18:50:42.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.256+0000 7efde37fe640 1 -- 172.21.15.29:0/455527756 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efdec003aa0 con 0x7efde806ac00 2024-09-13T18:50:42.259 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T18:50:42.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.258+0000 7efdfbfff640 1 -- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efde806ac00 msgr2=0x7efde806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.258+0000 7efdfbfff640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efde806ac00 0x7efde806d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efdec003eb0 tx=0x7efdec009040 comp rx=0 tx=0).stop 2024-09-13T18:50:42.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.258+0000 7efdfbfff640 1 -- 172.21.15.29:0/455527756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdfc13c700 msgr2=0x7efdfc13b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.258+0000 7efdfbfff640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdfc13c700 0x7efdfc13b000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009f40 tx=0x7efdf4004a40 comp rx=0 tx=0).stop 2024-09-13T18:50:42.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.258+0000 7efdfbfff640 1 -- 172.21.15.29:0/455527756 shutdown_connections 2024-09-13T18:50:42.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.258+0000 7efdfbfff640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7efde806ac00 0x7efde806d0c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.258+0000 7efdfbfff640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdfc13c700 0x7efdfc13b000 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.258+0000 7efdfbfff640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdfc0b1e50 0x7efdfc0ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.258+0000 7efdfbfff640 1 --2- 172.21.15.29:0/455527756 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdfc06e950 0x7efdfc0af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.258+0000 7efdfbfff640 1 -- 172.21.15.29:0/455527756 >> 172.21.15.29:0/455527756 conn(0x7efdfc0b71e0 msgr2=0x7efdfc141130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.258+0000 7efdfbfff640 1 -- 172.21.15.29:0/455527756 shutdown_connections 2024-09-13T18:50:42.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.258+0000 7efdfbfff640 1 -- 172.21.15.29:0/455527756 wait complete. 2024-09-13T18:50:42.273 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T18:50:42.273 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:50:42.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.376+0000 7f0aaef9c640 1 Processor -- start 2024-09-13T18:50:42.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.376+0000 7f0aaef9c640 1 -- start start 2024-09-13T18:50:42.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aaef9c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0aa80b39a0 0x7f0aa8145da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aaef9c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0aa81462e0 0x7f0aa814cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aaef9c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa809c4e0 con 0x7f0aa809c100 2024-09-13T18:50:42.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aaef9c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa80b2b90 con 0x7f0aa80b39a0 2024-09-13T18:50:42.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aaef9c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa8146730 con 0x7f0aa81462e0 2024-09-13T18:50:42.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aa7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0aa80b39a0 0x7f0aa8145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aa7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0aa80b39a0 0x7f0aa8145da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55996/0 (socket says 172.21.15.29:55996) 2024-09-13T18:50:42.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aa7fff640 1 -- 172.21.15.29:0/1610504655 learned_addr learned my addr 172.21.15.29:0/1610504655 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:42.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aad539640 1 --2- 172.21.15.29:0/1610504655 >> v2:172.21.15.96:3300/0 conn(0x7f0aa81462e0 0x7f0aa814cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aa7fff640 1 -- 172.21.15.29:0/1610504655 >> v2:172.21.15.96:3300/0 conn(0x7f0aa81462e0 msgr2=0x7f0aa814cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aa7fff640 1 --2- 172.21.15.29:0/1610504655 >> v2:172.21.15.96:3300/0 conn(0x7f0aa81462e0 0x7f0aa814cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aa7fff640 1 -- 172.21.15.29:0/1610504655 >> v1:172.21.15.96:6789/0 conn(0x7f0aa809c100 legacy=0x7f0aa8071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.377+0000 7f0aa7fff640 1 -- 172.21.15.29:0/1610504655 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa80b79d0 con 0x7f0aa80b39a0 2024-09-13T18:50:42.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.378+0000 7f0aa7fff640 1 --2- 172.21.15.29:0/1610504655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80b39a0 0x7f0aa8145da0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80b7bc0 tx=0x7f0a9c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434a7a0f8ffe829a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.378+0000 7f0aa77fe640 1 -- 172.21.15.29:0/1610504655 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c032790 con 0x7f0aa80b39a0 2024-09-13T18:50:42.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.378+0000 7f0aa77fe640 1 -- 172.21.15.29:0/1610504655 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0328f0 con 0x7f0aa80b39a0 2024-09-13T18:50:42.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.378+0000 7f0aa77fe640 1 -- 172.21.15.29:0/1610504655 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c032c80 con 0x7f0aa80b39a0 2024-09-13T18:50:42.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.379+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1610504655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80b39a0 msgr2=0x7f0aa8145da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.379+0000 7f0aaef9c640 1 --2- 172.21.15.29:0/1610504655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80b39a0 0x7f0aa8145da0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80b7bc0 tx=0x7f0a9c02c890 comp rx=0 tx=0).stop 2024-09-13T18:50:42.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.379+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1610504655 shutdown_connections 2024-09-13T18:50:42.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.379+0000 7f0aaef9c640 1 --2- 172.21.15.29:0/1610504655 >> v2:172.21.15.96:3300/0 conn(0x7f0aa81462e0 0x7f0aa814cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.379+0000 7f0aaef9c640 1 --2- 172.21.15.29:0/1610504655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa80b39a0 0x7f0aa8145da0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.379+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1610504655 >> 172.21.15.29:0/1610504655 conn(0x7f0aa806a2f0 msgr2=0x7f0aa806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.379+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1610504655 shutdown_connections 2024-09-13T18:50:42.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.379+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1610504655 wait complete. 2024-09-13T18:50:42.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.380+0000 7f0aaef9c640 1 Processor -- start 2024-09-13T18:50:42.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.380+0000 7f0aaef9c640 1 -- start start 2024-09-13T18:50:42.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aaef9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa809c100 0x7f0aa813f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aaef9c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80b39a0 0x7f0aa81d7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aaef9c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa81462e0 0x7f0aa81d7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aaef9c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa81cde10 con 0x7f0aa809c100 2024-09-13T18:50:42.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aaef9c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80ae880 con 0x7f0aa80b39a0 2024-09-13T18:50:42.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aaef9c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80b0020 con 0x7f0aa81462e0 2024-09-13T18:50:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aacd38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa809c100 0x7f0aa813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aacd38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa809c100 0x7f0aa813f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56000/0 (socket says 172.21.15.29:56000) 2024-09-13T18:50:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aacd38640 1 -- 172.21.15.29:0/1011593367 learned_addr learned my addr 172.21.15.29:0/1011593367 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aad539640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa81462e0 0x7f0aa81d7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aa7fff640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80b39a0 0x7f0aa81d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aacd38640 1 -- 172.21.15.29:0/1011593367 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa81462e0 msgr2=0x7f0aa81d7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aacd38640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0aa81462e0 0x7f0aa81d7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aacd38640 1 -- 172.21.15.29:0/1011593367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80b39a0 msgr2=0x7f0aa81d7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aacd38640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0aa80b39a0 0x7f0aa81d7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.381+0000 7f0aacd38640 1 -- 172.21.15.29:0/1011593367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c00b770 con 0x7f0aa809c100 2024-09-13T18:50:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.382+0000 7f0aacd38640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa809c100 0x7f0aa813f890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c790 tx=0x7f0a9800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.382+0000 7f0aa57fa640 1 -- 172.21.15.29:0/1011593367 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800cea0 con 0x7f0aa809c100 2024-09-13T18:50:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.382+0000 7f0aa57fa640 1 -- 172.21.15.29:0/1011593367 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a98006d50 con 0x7f0aa809c100 2024-09-13T18:50:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.382+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1011593367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa80b0300 con 0x7f0aa809c100 2024-09-13T18:50:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.382+0000 7f0aa57fa640 1 -- 172.21.15.29:0/1011593367 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98003bb0 con 0x7f0aa809c100 2024-09-13T18:50:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.382+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1011593367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa81cda30 con 0x7f0aa809c100 2024-09-13T18:50:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.383+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1011593367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0aa809d7e0 con 0x7f0aa809c100 2024-09-13T18:50:42.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.383+0000 7f0aa57fa640 1 -- 172.21.15.29:0/1011593367 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0a98003d10 con 0x7f0aa809c100 2024-09-13T18:50:42.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.384+0000 7f0aa57fa640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0a9406ac00 0x7f0a9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.384+0000 7f0aa57fa640 1 -- 172.21.15.29:0/1011593367 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0a980891b0 con 0x7f0aa809c100 2024-09-13T18:50:42.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.384+0000 7f0aa57fa640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] conn(0x7f0a940744e0 0x7f0a94076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.384+0000 7f0aa7fff640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0a9406ac00 0x7f0a9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.384+0000 7f0aa57fa640 1 -- 172.21.15.29:0/1011593367 --> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a94077050 con 0x7f0a940744e0 2024-09-13T18:50:42.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.384+0000 7f0aa57fa640 1 -- 172.21.15.29:0/1011593367 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a9808b870 con 0x7f0aa809c100 2024-09-13T18:50:42.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.384+0000 7f0aad539640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] conn(0x7f0a940744e0 0x7f0a94076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.384+0000 7f0aad539640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] conn(0x7f0a940744e0 0x7f0a94076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.384+0000 7f0aa7fff640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0a9406ac00 0x7f0a9406d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c037000 tx=0x7f0a9c03e040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.385+0000 7f0aa57fa640 1 -- 172.21.15.29:0/1011593367 <== osd.2 v2:172.21.15.29:6800/3954589082 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0a94077050 con 0x7f0a940744e0 2024-09-13T18:50:42.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.397+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1011593367 --> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0aa80b7fb0 con 0x7f0a940744e0 2024-09-13T18:50:42.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.397+0000 7f0aa57fa640 1 -- 172.21.15.29:0/1011593367 <== osd.2 v2:172.21.15.29:6800/3954589082 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0aa0009b80 con 0x7f0a940744e0 2024-09-13T18:50:42.400 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-13T18:50:42.400 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:50:42.400 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-13T18:50:42.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.398+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1011593367 >> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] conn(0x7f0a940744e0 msgr2=0x7f0a94076980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.398+0000 7f0aaef9c640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.29:6800/3954589082,v1:172.21.15.29:6801/3954589082] conn(0x7f0a940744e0 0x7f0a94076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.398+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1011593367 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0a9406ac00 msgr2=0x7f0a9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.398+0000 7f0aaef9c640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f0a9406ac00 0x7f0a9406d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c037000 tx=0x7f0a9c03e040 comp rx=0 tx=0).stop 2024-09-13T18:50:42.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.398+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1011593367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa809c100 msgr2=0x7f0aa813f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.398+0000 7f0aaef9c640 1 --2- 172.21.15.29:0/1011593367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0aa809c100 0x7f0aa813f890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c790 tx=0x7f0a9800cc50 comp rx=0 tx=0).stop 2024-09-13T18:50:42.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.398+0000 7f0aad539640 1 -- 172.21.15.29:0/1011593367 reap_dead start 2024-09-13T18:50:42.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.398+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1011593367 shutdown_connections 2024-09-13T18:50:42.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.398+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1011593367 >> 172.21.15.29:0/1011593367 conn(0x7f0aa806a2f0 msgr2=0x7f0aa806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.398+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1011593367 shutdown_connections 2024-09-13T18:50:42.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.398+0000 7f0aaef9c640 1 -- 172.21.15.29:0/1011593367 wait complete. 2024-09-13T18:50:42.411 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T18:50:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.510+0000 7f28c5583640 1 Processor -- start 2024-09-13T18:50:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.510+0000 7f28c5583640 1 -- start start 2024-09-13T18:50:42.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28c5583640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c013f9f0 0x7f28c006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28c5583640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28c013fdd0 0x7f28c0071210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28c5583640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c0071bb0 con 0x7f28c0145920 2024-09-13T18:50:42.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28c5583640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c0070b10 con 0x7f28c013fdd0 2024-09-13T18:50:42.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28c5583640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c006f390 con 0x7f28c013f9f0 2024-09-13T18:50:42.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28be7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28c013fdd0 0x7f28c0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28bf7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f28c0145920 0x7f28c0148ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41122/0 (socket says 172.21.15.29:41122) 2024-09-13T18:50:42.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28be7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28c013fdd0 0x7f28c0071210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56014/0 (socket says 172.21.15.29:56014) 2024-09-13T18:50:42.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28bf7fe640 1 -- 172.21.15.29:0/3773016946 learned_addr learned my addr 172.21.15.29:0/3773016946 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:42.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28beffd640 1 --2- 172.21.15.29:0/3773016946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c013f9f0 0x7f28c006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28be7fc640 1 -- 172.21.15.29:0/3773016946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c013f9f0 msgr2=0x7f28c006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28be7fc640 1 --2- 172.21.15.29:0/3773016946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c013f9f0 0x7f28c006aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28be7fc640 1 -- 172.21.15.29:0/3773016946 >> v1:172.21.15.29:6789/0 conn(0x7f28c0145920 legacy=0x7f28c0148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28be7fc640 1 -- 172.21.15.29:0/3773016946 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c006f670 con 0x7f28c013fdd0 2024-09-13T18:50:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.511+0000 7f28bdffb640 1 -- 172.21.15.29:0/3773016946 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747371608 0 0) 0x7f28c0071bb0 con 0x7f28c0145920 2024-09-13T18:50:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.512+0000 7f28be7fc640 1 --2- 172.21.15.29:0/3773016946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c013fdd0 0x7f28c0071210 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f28b40097a0 tx=0x7f28b402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1c0fc7664d53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.512+0000 7f28bdffb640 1 -- 172.21.15.29:0/3773016946 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b402ae50 con 0x7f28c013fdd0 2024-09-13T18:50:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.512+0000 7f28bdffb640 1 -- 172.21.15.29:0/3773016946 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b4032440 con 0x7f28c013fdd0 2024-09-13T18:50:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.512+0000 7f28bdffb640 1 -- 172.21.15.29:0/3773016946 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40327d0 con 0x7f28c013fdd0 2024-09-13T18:50:42.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.513+0000 7f28c5583640 1 -- 172.21.15.29:0/3773016946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c013fdd0 msgr2=0x7f28c0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.513+0000 7f28c5583640 1 --2- 172.21.15.29:0/3773016946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c013fdd0 0x7f28c0071210 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f28b40097a0 tx=0x7f28b402a100 comp rx=0 tx=0).stop 2024-09-13T18:50:42.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.513+0000 7f28c5583640 1 -- 172.21.15.29:0/3773016946 shutdown_connections 2024-09-13T18:50:42.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.513+0000 7f28c5583640 1 --2- 172.21.15.29:0/3773016946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c013fdd0 0x7f28c0071210 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.513+0000 7f28c5583640 1 --2- 172.21.15.29:0/3773016946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c013f9f0 0x7f28c006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.513+0000 7f28c5583640 1 -- 172.21.15.29:0/3773016946 >> 172.21.15.29:0/3773016946 conn(0x7f28c00b4710 msgr2=0x7f28c00b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.513+0000 7f28c5583640 1 -- 172.21.15.29:0/3773016946 shutdown_connections 2024-09-13T18:50:42.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.513+0000 7f28c5583640 1 -- 172.21.15.29:0/3773016946 wait complete. 2024-09-13T18:50:42.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.514+0000 7f28c5583640 1 Processor -- start 2024-09-13T18:50:42.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.514+0000 7f28c5583640 1 -- start start 2024-09-13T18:50:42.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28c5583640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c013f9f0 0x7f28c0142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28c5583640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28c013fdd0 0x7f28c0147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28c5583640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c0145920 0x7f28c0148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28c5583640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c01df550 con 0x7f28c013f9f0 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28c5583640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c00ac570 con 0x7f28c013fdd0 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28c5583640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c00ac850 con 0x7f28c0145920 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28beffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c013f9f0 0x7f28c0142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28beffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c013f9f0 0x7f28c0142020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56016/0 (socket says 172.21.15.29:56016) 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28beffd640 1 -- 172.21.15.29:0/2233308109 learned_addr learned my addr 172.21.15.29:0/2233308109 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28bf7fe640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c0145920 0x7f28c0148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28be7fc640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28c013fdd0 0x7f28c0147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28beffd640 1 -- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c0145920 msgr2=0x7f28c0148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28beffd640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c0145920 0x7f28c0148520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28beffd640 1 -- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28c013fdd0 msgr2=0x7f28c0147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28beffd640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28c013fdd0 0x7f28c0147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28beffd640 1 -- 172.21.15.29:0/2233308109 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4009400 con 0x7f28c013f9f0 2024-09-13T18:50:42.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28be7fc640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28c013fdd0 0x7f28c0147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:42.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28bf7fe640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c0145920 0x7f28c0148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:42.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.515+0000 7f28beffd640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c013f9f0 0x7f28c0142020 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f28b000e870 tx=0x7f28b000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.516+0000 7f28a77fe640 1 -- 172.21.15.29:0/2233308109 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b00094f0 con 0x7f28c013f9f0 2024-09-13T18:50:42.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.516+0000 7f28a77fe640 1 -- 172.21.15.29:0/2233308109 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b000c940 con 0x7f28c013f9f0 2024-09-13T18:50:42.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.516+0000 7f28a77fe640 1 -- 172.21.15.29:0/2233308109 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b000ccf0 con 0x7f28c013f9f0 2024-09-13T18:50:42.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.516+0000 7f28c5583640 1 -- 172.21.15.29:0/2233308109 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c01def00 con 0x7f28c013f9f0 2024-09-13T18:50:42.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.516+0000 7f28c5583640 1 -- 172.21.15.29:0/2233308109 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c01debc0 con 0x7f28c013f9f0 2024-09-13T18:50:42.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.517+0000 7f28c5583640 1 -- 172.21.15.29:0/2233308109 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c00702b0 con 0x7f28c013f9f0 2024-09-13T18:50:42.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.517+0000 7f28a77fe640 1 -- 172.21.15.29:0/2233308109 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f28b0013470 con 0x7f28c013f9f0 2024-09-13T18:50:42.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.518+0000 7f28a77fe640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f28ac06ac00 0x7f28ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.518+0000 7f28a77fe640 1 -- 172.21.15.29:0/2233308109 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f28b00897e0 con 0x7f28c013f9f0 2024-09-13T18:50:42.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.518+0000 7f28be7fc640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f28ac06ac00 0x7f28ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.518+0000 7f28be7fc640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f28ac06ac00 0x7f28ac06d0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f28b4034000 tx=0x7f28b402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.523+0000 7f28a77fe640 1 -- 172.21.15.29:0/2233308109 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f28b0054610 con 0x7f28c013f9f0 2024-09-13T18:50:42.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.692+0000 7f28c5583640 1 -- 172.21.15.29:0/2233308109 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f28c006fb90 con 0x7f28ac06ac00 2024-09-13T18:50:42.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.692+0000 7f28a77fe640 1 -- 172.21.15.29:0/2233308109 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f28b4042090 con 0x7f28ac06ac00 2024-09-13T18:50:42.695 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T18:50:42.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.694+0000 7f28c5583640 1 -- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f28ac06ac00 msgr2=0x7f28ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.694+0000 7f28c5583640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f28ac06ac00 0x7f28ac06d0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f28b4034000 tx=0x7f28b402e000 comp rx=0 tx=0).stop 2024-09-13T18:50:42.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.694+0000 7f28c5583640 1 -- 172.21.15.29:0/2233308109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c013f9f0 msgr2=0x7f28c0142020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.694+0000 7f28c5583640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c013f9f0 0x7f28c0142020 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f28b000e870 tx=0x7f28b000ed30 comp rx=0 tx=0).stop 2024-09-13T18:50:42.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.694+0000 7f28c5583640 1 -- 172.21.15.29:0/2233308109 shutdown_connections 2024-09-13T18:50:42.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.694+0000 7f28c5583640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f28ac06ac00 0x7f28ac06d0c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.694+0000 7f28c5583640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c0145920 0x7f28c0148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.694+0000 7f28c5583640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28c013fdd0 0x7f28c0147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.694+0000 7f28c5583640 1 --2- 172.21.15.29:0/2233308109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c013f9f0 0x7f28c0142020 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.694+0000 7f28c5583640 1 -- 172.21.15.29:0/2233308109 >> 172.21.15.29:0/2233308109 conn(0x7f28c00b4710 msgr2=0x7f28c0144af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.695+0000 7f28c5583640 1 -- 172.21.15.29:0/2233308109 shutdown_connections 2024-09-13T18:50:42.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.695+0000 7f28c5583640 1 -- 172.21.15.29:0/2233308109 wait complete. 2024-09-13T18:50:42.708 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T18:50:42.708 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:50:42.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.811+0000 7f40d38e5640 1 Processor -- start 2024-09-13T18:50:42.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.812+0000 7f40d38e5640 1 -- start start 2024-09-13T18:50:42.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.812+0000 7f40d38e5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40cc0b44b0 0x7f40cc1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.812+0000 7f40d38e5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f40cc0b3320 0x7f40cc13fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.812+0000 7f40d38e5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc0b3880 con 0x7f40cc0b5f50 2024-09-13T18:50:42.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.812+0000 7f40d38e5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0b5580 con 0x7f40cc0b3320 2024-09-13T18:50:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.812+0000 7f40d38e5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b4890 con 0x7f40cc0b44b0 2024-09-13T18:50:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.812+0000 7f40d1e82640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f40cc0b3320 0x7f40cc13fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.812+0000 7f40d1e82640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f40cc0b3320 0x7f40cc13fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56032/0 (socket says 172.21.15.29:56032) 2024-09-13T18:50:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.813+0000 7f40d1e82640 1 -- 172.21.15.29:0/3351467809 learned_addr learned my addr 172.21.15.29:0/3351467809 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.813+0000 7f40d1681640 1 --2- 172.21.15.29:0/3351467809 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40cc0b44b0 0x7f40cc1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.813+0000 7f40d1e82640 1 -- 172.21.15.29:0/3351467809 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40cc0b44b0 msgr2=0x7f40cc1462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.813+0000 7f40d1e82640 1 --2- 172.21.15.29:0/3351467809 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40cc0b44b0 0x7f40cc1462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.813+0000 7f40d1e82640 1 -- 172.21.15.29:0/3351467809 >> v1:172.21.15.96:6789/0 conn(0x7f40cc0b5f50 legacy=0x7f40cc13f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.813+0000 7f40d1e82640 1 -- 172.21.15.29:0/3351467809 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0b57f0 con 0x7f40cc0b3320 2024-09-13T18:50:42.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.814+0000 7f40d1e82640 1 --2- 172.21.15.29:0/3351467809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40cc0b3320 0x7f40cc13fd00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009e50 tx=0x7f40c402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473e68010743e2f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.814+0000 7f40c3fff640 1 -- 172.21.15.29:0/3351467809 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4031600 con 0x7f40cc0b3320 2024-09-13T18:50:42.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.814+0000 7f40c3fff640 1 -- 172.21.15.29:0/3351467809 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c402d050 con 0x7f40cc0b3320 2024-09-13T18:50:42.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.814+0000 7f40c3fff640 1 -- 172.21.15.29:0/3351467809 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4031980 con 0x7f40cc0b3320 2024-09-13T18:50:42.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.814+0000 7f40d38e5640 1 -- 172.21.15.29:0/3351467809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40cc0b3320 msgr2=0x7f40cc13fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.814+0000 7f40d38e5640 1 --2- 172.21.15.29:0/3351467809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40cc0b3320 0x7f40cc13fd00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009e50 tx=0x7f40c402a710 comp rx=0 tx=0).stop 2024-09-13T18:50:42.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.814+0000 7f40d38e5640 1 -- 172.21.15.29:0/3351467809 shutdown_connections 2024-09-13T18:50:42.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.814+0000 7f40d38e5640 1 --2- 172.21.15.29:0/3351467809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40cc0b3320 0x7f40cc13fd00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.814+0000 7f40d38e5640 1 --2- 172.21.15.29:0/3351467809 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40cc0b44b0 0x7f40cc1462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.814+0000 7f40d38e5640 1 -- 172.21.15.29:0/3351467809 >> 172.21.15.29:0/3351467809 conn(0x7f40cc0b8050 msgr2=0x7f40cc0b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.814+0000 7f40d38e5640 1 -- 172.21.15.29:0/3351467809 shutdown_connections 2024-09-13T18:50:42.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.814+0000 7f40d38e5640 1 -- 172.21.15.29:0/3351467809 wait complete. 2024-09-13T18:50:42.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.815+0000 7f40d38e5640 1 Processor -- start 2024-09-13T18:50:42.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.816+0000 7f40d38e5640 1 -- start start 2024-09-13T18:50:42.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.816+0000 7f40d38e5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40cc0b3320 0x7f40cc1de580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.816+0000 7f40d38e5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0b44b0 0x7f40cc137490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.816+0000 7f40d38e5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40cc0b5f50 0x7f40cc13b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.816+0000 7f40d38e5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc135730 con 0x7f40cc0b3320 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.816+0000 7f40d38e5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc135120 con 0x7f40cc0b44b0 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.816+0000 7f40d38e5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc13caf0 con 0x7f40cc0b5f50 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.816+0000 7f40d1681640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40cc0b3320 0x7f40cc1de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.816+0000 7f40d1681640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40cc0b3320 0x7f40cc1de580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56036/0 (socket says 172.21.15.29:56036) 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.816+0000 7f40d1681640 1 -- 172.21.15.29:0/2816741022 learned_addr learned my addr 172.21.15.29:0/2816741022 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.816+0000 7f40d1e82640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40cc0b5f50 0x7f40cc13b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.816+0000 7f40d0e80640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0b44b0 0x7f40cc137490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.817+0000 7f40d1681640 1 -- 172.21.15.29:0/2816741022 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40cc0b5f50 msgr2=0x7f40cc13b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.817+0000 7f40d1681640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40cc0b5f50 0x7f40cc13b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.817+0000 7f40d1681640 1 -- 172.21.15.29:0/2816741022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0b44b0 msgr2=0x7f40cc137490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.817+0000 7f40d1681640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40cc0b44b0 0x7f40cc137490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.817+0000 7f40d1681640 1 -- 172.21.15.29:0/2816741022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4009b30 con 0x7f40cc0b3320 2024-09-13T18:50:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.817+0000 7f40d1681640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40cc0b3320 0x7f40cc1de580 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f40c800d800 tx=0x7f40c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.817+0000 7f40c1ffb640 1 -- 172.21.15.29:0/2816741022 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c800b6c0 con 0x7f40cc0b3320 2024-09-13T18:50:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.817+0000 7f40c1ffb640 1 -- 172.21.15.29:0/2816741022 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c800b820 con 0x7f40cc0b3320 2024-09-13T18:50:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.817+0000 7f40d38e5640 1 -- 172.21.15.29:0/2816741022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc13cdd0 con 0x7f40cc0b3320 2024-09-13T18:50:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.817+0000 7f40c1ffb640 1 -- 172.21.15.29:0/2816741022 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c800bbb0 con 0x7f40cc0b3320 2024-09-13T18:50:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.817+0000 7f40d38e5640 1 -- 172.21.15.29:0/2816741022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc1353c0 con 0x7f40cc0b3320 2024-09-13T18:50:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.818+0000 7f40d38e5640 1 -- 172.21.15.29:0/2816741022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f40cc146820 con 0x7f40cc0b3320 2024-09-13T18:50:42.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.819+0000 7f40c1ffb640 1 -- 172.21.15.29:0/2816741022 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f40c800bd10 con 0x7f40cc0b3320 2024-09-13T18:50:42.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.819+0000 7f40c1ffb640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f40b006ac00 0x7f40b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.819+0000 7f40c1ffb640 1 -- 172.21.15.29:0/2816741022 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f40c8089a90 con 0x7f40cc0b3320 2024-09-13T18:50:42.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.819+0000 7f40c1ffb640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] conn(0x7f40b00744e0 0x7f40b0076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.819+0000 7f40c1ffb640 1 -- 172.21.15.29:0/2816741022 --> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40b0077050 con 0x7f40b00744e0 2024-09-13T18:50:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.819+0000 7f40d0e80640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f40b006ac00 0x7f40b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.819+0000 7f40c1ffb640 1 -- 172.21.15.29:0/2816741022 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40c808e2c0 con 0x7f40cc0b3320 2024-09-13T18:50:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.819+0000 7f40d1e82640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] conn(0x7f40b00744e0 0x7f40b0076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.820+0000 7f40d1e82640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] conn(0x7f40b00744e0 0x7f40b0076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.820+0000 7f40d0e80640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f40b006ac00 0x7f40b006d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f40cc134d00 tx=0x7f40bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.820+0000 7f40c1ffb640 1 -- 172.21.15.29:0/2816741022 <== osd.3 v2:172.21.15.29:6816/286406825 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f40b0077050 con 0x7f40b00744e0 2024-09-13T18:50:42.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40d38e5640 1 -- 172.21.15.29:0/2816741022 --> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f40cc0664f0 con 0x7f40b00744e0 2024-09-13T18:50:42.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40c1ffb640 1 -- 172.21.15.29:0/2816741022 <== osd.3 v2:172.21.15.29:6816/286406825 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f40cc0664f0 con 0x7f40b00744e0 2024-09-13T18:50:42.835 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-13T18:50:42.836 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:50:42.836 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-13T18:50:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40d38e5640 1 -- 172.21.15.29:0/2816741022 >> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] conn(0x7f40b00744e0 msgr2=0x7f40b0076980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40d38e5640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.29:6816/286406825,v1:172.21.15.29:6817/286406825] conn(0x7f40b00744e0 0x7f40b0076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40d38e5640 1 -- 172.21.15.29:0/2816741022 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f40b006ac00 msgr2=0x7f40b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40d38e5640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f40b006ac00 0x7f40b006d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f40cc134d00 tx=0x7f40bc009040 comp rx=0 tx=0).stop 2024-09-13T18:50:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40d38e5640 1 -- 172.21.15.29:0/2816741022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40cc0b3320 msgr2=0x7f40cc1de580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40d38e5640 1 --2- 172.21.15.29:0/2816741022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40cc0b3320 0x7f40cc1de580 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f40c800d800 tx=0x7f40c800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40d1e82640 1 -- 172.21.15.29:0/2816741022 reap_dead start 2024-09-13T18:50:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40d38e5640 1 -- 172.21.15.29:0/2816741022 shutdown_connections 2024-09-13T18:50:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40d38e5640 1 -- 172.21.15.29:0/2816741022 >> 172.21.15.29:0/2816741022 conn(0x7f40cc0b8050 msgr2=0x7f40cc13f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40d38e5640 1 -- 172.21.15.29:0/2816741022 shutdown_connections 2024-09-13T18:50:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.833+0000 7f40d38e5640 1 -- 172.21.15.29:0/2816741022 wait complete. 2024-09-13T18:50:42.846 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T18:50:42.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.945+0000 7f61594b1640 1 Processor -- start 2024-09-13T18:50:42.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.945+0000 7f61594b1640 1 -- start start 2024-09-13T18:50:42.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.946+0000 7f61594b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61540b5990 0x7f615406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.946+0000 7f61594b1640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61540b6170 con 0x7f61540b6c50 2024-09-13T18:50:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.946+0000 7f61594b1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61540b6450 con 0x7f6154093de0 2024-09-13T18:50:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.946+0000 7f61594b1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61540b2230 con 0x7f61540b5990 2024-09-13T18:50:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.946+0000 7f61537fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f61540b6c50 0x7f615415cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41136/0 (socket says 172.21.15.29:41136) 2024-09-13T18:50:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.946+0000 7f61537fe640 1 -- 172.21.15.29:0/2272666204 learned_addr learned my addr 172.21.15.29:0/2272666204 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.946+0000 7f61527fc640 1 --2- 172.21.15.29:0/2272666204 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61540b5990 0x7f615406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.946+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338008933 0 0) 0x7f61540b6170 con 0x7f61540b6c50 2024-09-13T18:50:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.957+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6140003440 con 0x7f61540b6c50 2024-09-13T18:50:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.957+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308946965 0 0) 0x7f61540b6450 con 0x7f6154093de0 2024-09-13T18:50:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.957+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61540b6170 con 0x7f6154093de0 2024-09-13T18:50:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.957+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 310612877 0 0) 0x7f6140003440 con 0x7f61540b6c50 2024-09-13T18:50:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.957+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61540b5990 msgr2=0x7f615406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.957+0000 7f6151ffb640 1 --2- 172.21.15.29:0/2272666204 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61540b5990 0x7f615406b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.957+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 >> v1:172.21.15.96:6789/0 conn(0x7f6154093de0 legacy=0x7f61540b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.957+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61540b6730 con 0x7f61540b6c50 2024-09-13T18:50:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f614c001670 con 0x7f61540b6c50 2024-09-13T18:50:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 >> v1:172.21.15.29:6789/0 conn(0x7f61540b6c50 legacy=0x7f615415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f6151ffb640 1 --2- 172.21.15.29:0/2272666204 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61540b5990 0x7f6140005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f6151ffb640 1 --2- 172.21.15.29:0/2272666204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61400062e0 0x7f6140006740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f6151ffb640 1 --2- 172.21.15.29:0/2272666204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6140006f00 0x7f6140007380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61540b2230 con 0x7f6140006f00 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6140007c60 con 0x7f61400062e0 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6140007e20 con 0x7f61540b5990 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f61537fe640 1 --2- 172.21.15.29:0/2272666204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6140006f00 0x7f6140007380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f6152ffd640 1 --2- 172.21.15.29:0/2272666204 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61540b5990 0x7f6140005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f61527fc640 1 --2- 172.21.15.29:0/2272666204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61400062e0 0x7f6140006740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f61537fe640 1 -- 172.21.15.29:0/2272666204 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61540b5990 msgr2=0x7f6140005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f61537fe640 1 --2- 172.21.15.29:0/2272666204 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61540b5990 0x7f6140005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f61537fe640 1 -- 172.21.15.29:0/2272666204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61400062e0 msgr2=0x7f6140006740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f61537fe640 1 --2- 172.21.15.29:0/2272666204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61400062e0 0x7f6140006740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.958+0000 7f61537fe640 1 -- 172.21.15.29:0/2272666204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140003440 con 0x7f6140006f00 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.959+0000 7f61537fe640 1 --2- 172.21.15.29:0/2272666204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6140006f00 0x7f6140007380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f614c007fa0 tx=0x7f61400036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f7abac807190a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.959+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c005ad0 con 0x7f6140006f00 2024-09-13T18:50:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.959+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c02d070 con 0x7f6140006f00 2024-09-13T18:50:42.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.959+0000 7f6151ffb640 1 -- 172.21.15.29:0/2272666204 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c007070 con 0x7f6140006f00 2024-09-13T18:50:42.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.959+0000 7f61594b1640 1 -- 172.21.15.29:0/2272666204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6140006f00 msgr2=0x7f6140007380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.959+0000 7f61594b1640 1 --2- 172.21.15.29:0/2272666204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6140006f00 0x7f6140007380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f614c007fa0 tx=0x7f61400036f0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.959+0000 7f61537fe640 1 -- 172.21.15.29:0/2272666204 reap_dead start 2024-09-13T18:50:42.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.959+0000 7f61594b1640 1 -- 172.21.15.29:0/2272666204 shutdown_connections 2024-09-13T18:50:42.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.959+0000 7f61594b1640 1 -- 172.21.15.29:0/2272666204 >> 172.21.15.29:0/2272666204 conn(0x7f6154099230 msgr2=0x7f6154099640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.959+0000 7f61594b1640 1 -- 172.21.15.29:0/2272666204 shutdown_connections 2024-09-13T18:50:42.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.960+0000 7f61594b1640 1 -- 172.21.15.29:0/2272666204 wait complete. 2024-09-13T18:50:42.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.961+0000 7f61594b1640 1 Processor -- start 2024-09-13T18:50:42.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.961+0000 7f61594b1640 1 -- start start 2024-09-13T18:50:42.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.961+0000 7f61594b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6140006f00 0x7f61541e8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.961+0000 7f61594b1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61541ec0d0 0x7f615409c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.961+0000 7f61594b1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f615409c9d0 0x7f615408d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.961+0000 7f61594b1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615409ce50 con 0x7f61541ec0d0 2024-09-13T18:50:42.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.961+0000 7f61594b1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61541ec550 con 0x7f615409c9d0 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.961+0000 7f61594b1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61541eb680 con 0x7f6140006f00 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.961+0000 7f61527fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61541ec0d0 0x7f615409c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f61527fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61541ec0d0 0x7f615409c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56044/0 (socket says 172.21.15.29:56044) 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f61527fc640 1 -- 172.21.15.29:0/1678368387 learned_addr learned my addr 172.21.15.29:0/1678368387 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f6152ffd640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6140006f00 0x7f61541e8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f61537fe640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f615409c9d0 0x7f615408d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f61527fc640 1 -- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6140006f00 msgr2=0x7f61541e8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f61527fc640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6140006f00 0x7f61541e8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f61527fc640 1 -- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f615409c9d0 msgr2=0x7f615408d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f61527fc640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f615409c9d0 0x7f615408d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f61527fc640 1 -- 172.21.15.29:0/1678368387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61541e90a0 con 0x7f61541ec0d0 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f61527fc640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61541ec0d0 0x7f615409c490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f613c00b7a0 tx=0x7f613c00bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f614b7fe640 1 -- 172.21.15.29:0/1678368387 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c005b60 con 0x7f61541ec0d0 2024-09-13T18:50:42.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f614b7fe640 1 -- 172.21.15.29:0/1678368387 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c00be50 con 0x7f61541ec0d0 2024-09-13T18:50:42.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f61594b1640 1 -- 172.21.15.29:0/1678368387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615409a530 con 0x7f61541ec0d0 2024-09-13T18:50:42.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f614b7fe640 1 -- 172.21.15.29:0/1678368387 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c010c80 con 0x7f61541ec0d0 2024-09-13T18:50:42.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.962+0000 7f61594b1640 1 -- 172.21.15.29:0/1678368387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61541ebbb0 con 0x7f61541ec0d0 2024-09-13T18:50:42.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.963+0000 7f61594b1640 1 -- 172.21.15.29:0/1678368387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615409d8a0 con 0x7f61541ec0d0 2024-09-13T18:50:42.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.964+0000 7f614b7fe640 1 -- 172.21.15.29:0/1678368387 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f613c014430 con 0x7f61541ec0d0 2024-09-13T18:50:42.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.964+0000 7f614b7fe640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f613406ac00 0x7f613406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.964+0000 7f614b7fe640 1 -- 172.21.15.29:0/1678368387 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f613c089c60 con 0x7f61541ec0d0 2024-09-13T18:50:42.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.964+0000 7f6152ffd640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f613406ac00 0x7f613406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.965+0000 7f6152ffd640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f613406ac00 0x7f613406d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6144000f80 tx=0x7f6144009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:42.969+0000 7f614b7fe640 1 -- 172.21.15.29:0/1678368387 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f613c054bc0 con 0x7f61541ec0d0 2024-09-13T18:50:43.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.137+0000 7f61594b1640 1 -- 172.21.15.29:0/1678368387 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f615406b5b0 con 0x7f613406ac00 2024-09-13T18:50:43.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.138+0000 7f614b7fe640 1 -- 172.21.15.29:0/1678368387 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6144001d50 con 0x7f613406ac00 2024-09-13T18:50:43.140 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T18:50:43.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.140+0000 7f61594b1640 1 -- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f613406ac00 msgr2=0x7f613406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.140+0000 7f61594b1640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f613406ac00 0x7f613406d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6144000f80 tx=0x7f6144009040 comp rx=0 tx=0).stop 2024-09-13T18:50:43.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.140+0000 7f61594b1640 1 -- 172.21.15.29:0/1678368387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61541ec0d0 msgr2=0x7f615409c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.140+0000 7f61594b1640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61541ec0d0 0x7f615409c490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f613c00b7a0 tx=0x7f613c00bc60 comp rx=0 tx=0).stop 2024-09-13T18:50:43.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.140+0000 7f61594b1640 1 -- 172.21.15.29:0/1678368387 shutdown_connections 2024-09-13T18:50:43.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.140+0000 7f61594b1640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f613406ac00 0x7f613406d0c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.140+0000 7f61594b1640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f615409c9d0 0x7f615408d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.140+0000 7f61594b1640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61541ec0d0 0x7f615409c490 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.140+0000 7f61594b1640 1 --2- 172.21.15.29:0/1678368387 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6140006f00 0x7f61541e8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.140+0000 7f61594b1640 1 -- 172.21.15.29:0/1678368387 >> 172.21.15.29:0/1678368387 conn(0x7f6154099230 msgr2=0x7f6154090230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:43.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.140+0000 7f61594b1640 1 -- 172.21.15.29:0/1678368387 shutdown_connections 2024-09-13T18:50:43.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.140+0000 7f61594b1640 1 -- 172.21.15.29:0/1678368387 wait complete. 2024-09-13T18:50:43.154 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T18:50:43.154 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:50:43.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.256+0000 7fdbd9b9c640 1 Processor -- start 2024-09-13T18:50:43.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.256+0000 7fdbd9b9c640 1 -- start start 2024-09-13T18:50:43.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.257+0000 7fdbd9b9c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdbd40b5f50 0x7fdbd413f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.257+0000 7fdbd9b9c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdbd40b3320 0x7fdbd413fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.257+0000 7fdbd9b9c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd40b3880 con 0x7fdbd40b44b0 2024-09-13T18:50:43.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.257+0000 7fdbd9b9c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd40b5580 con 0x7fdbd40b5f50 2024-09-13T18:50:43.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.257+0000 7fdbd9b9c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40b4890 con 0x7fdbd40b3320 2024-09-13T18:50:43.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.257+0000 7fdbd2ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdbd40b5f50 0x7fdbd413f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.257+0000 7fdbd37fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdbd40b44b0 0x7fdbd41462e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41148/0 (socket says 172.21.15.29:41148) 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.257+0000 7fdbd2ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdbd40b5f50 0x7fdbd413f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56050/0 (socket says 172.21.15.29:56050) 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.257+0000 7fdbd37fe640 1 -- 172.21.15.29:0/1155551916 learned_addr learned my addr 172.21.15.29:0/1155551916 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.258+0000 7fdbd3fff640 1 --2- 172.21.15.29:0/1155551916 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdbd40b3320 0x7fdbd413fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.258+0000 7fdbd2ffd640 1 -- 172.21.15.29:0/1155551916 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdbd40b3320 msgr2=0x7fdbd413fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.258+0000 7fdbd2ffd640 1 --2- 172.21.15.29:0/1155551916 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdbd40b3320 0x7fdbd413fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.258+0000 7fdbd2ffd640 1 -- 172.21.15.29:0/1155551916 >> v1:172.21.15.29:6789/0 conn(0x7fdbd40b44b0 legacy=0x7fdbd41462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.258+0000 7fdbd27fc640 1 -- 172.21.15.29:0/1155551916 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808228233 0 0) 0x7fdbd40b3880 con 0x7fdbd40b44b0 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.258+0000 7fdbd2ffd640 1 -- 172.21.15.29:0/1155551916 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40b57f0 con 0x7fdbd40b5f50 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.258+0000 7fdbd2ffd640 1 --2- 172.21.15.29:0/1155551916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd40b5f50 0x7fdbd413f5f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80097a0 tx=0x7fdbc802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc940616c1f4569 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.259+0000 7fdbd27fc640 1 -- 172.21.15.29:0/1155551916 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8032440 con 0x7fdbd40b5f50 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.259+0000 7fdbd27fc640 1 -- 172.21.15.29:0/1155551916 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc80325a0 con 0x7fdbd40b5f50 2024-09-13T18:50:43.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.259+0000 7fdbd27fc640 1 -- 172.21.15.29:0/1155551916 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8032930 con 0x7fdbd40b5f50 2024-09-13T18:50:43.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.259+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/1155551916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd40b5f50 msgr2=0x7fdbd413f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.259+0000 7fdbd9b9c640 1 --2- 172.21.15.29:0/1155551916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd40b5f50 0x7fdbd413f5f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80097a0 tx=0x7fdbc802a180 comp rx=0 tx=0).stop 2024-09-13T18:50:43.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.259+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/1155551916 shutdown_connections 2024-09-13T18:50:43.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.259+0000 7fdbd9b9c640 1 --2- 172.21.15.29:0/1155551916 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdbd40b3320 0x7fdbd413fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.259+0000 7fdbd9b9c640 1 --2- 172.21.15.29:0/1155551916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd40b5f50 0x7fdbd413f5f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.259+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/1155551916 >> 172.21.15.29:0/1155551916 conn(0x7fdbd40b8050 msgr2=0x7fdbd40b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:43.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.259+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/1155551916 shutdown_connections 2024-09-13T18:50:43.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.259+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/1155551916 wait complete. 2024-09-13T18:50:43.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.260+0000 7fdbd9b9c640 1 Processor -- start 2024-09-13T18:50:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.260+0000 7fdbd9b9c640 1 -- start start 2024-09-13T18:50:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd9b9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd40b3320 0x7fdbd4135140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd9b9c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbd40b44b0 0x7fdbd4137490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd9b9c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdbd40b5f50 0x7fdbd4134580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd9b9c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40ba6c0 con 0x7fdbd40b3320 2024-09-13T18:50:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd9b9c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4134ac0 con 0x7fdbd40b44b0 2024-09-13T18:50:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd9b9c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40b9580 con 0x7fdbd40b5f50 2024-09-13T18:50:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd40b3320 0x7fdbd4135140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd40b3320 0x7fdbd4135140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56060/0 (socket says 172.21.15.29:56060) 2024-09-13T18:50:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd37fe640 1 -- 172.21.15.29:0/3816197852 learned_addr learned my addr 172.21.15.29:0/3816197852 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd2ffd640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbd40b44b0 0x7fdbd4137490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd3fff640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdbd40b5f50 0x7fdbd4134580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd37fe640 1 -- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdbd40b5f50 msgr2=0x7fdbd4134580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd37fe640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdbd40b5f50 0x7fdbd4134580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd37fe640 1 -- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbd40b44b0 msgr2=0x7fdbd4137490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd37fe640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbd40b44b0 0x7fdbd4137490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd37fe640 1 -- 172.21.15.29:0/3816197852 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8009400 con 0x7fdbd40b3320 2024-09-13T18:50:43.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd3fff640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdbd40b5f50 0x7fdbd4134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:43.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.261+0000 7fdbd2ffd640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbd40b44b0 0x7fdbd4137490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:43.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.262+0000 7fdbd37fe640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd40b3320 0x7fdbd4135140 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c500 tx=0x7fdbc400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.262+0000 7fdbbbfff640 1 -- 172.21.15.29:0/3816197852 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4007560 con 0x7fdbd40b3320 2024-09-13T18:50:43.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.262+0000 7fdbbbfff640 1 -- 172.21.15.29:0/3816197852 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc40047e0 con 0x7fdbd40b3320 2024-09-13T18:50:43.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.262+0000 7fdbbbfff640 1 -- 172.21.15.29:0/3816197852 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4004b90 con 0x7fdbd40b3320 2024-09-13T18:50:43.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.262+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/3816197852 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd4134cc0 con 0x7fdbd40b3320 2024-09-13T18:50:43.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.262+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/3816197852 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd40bb6b0 con 0x7fdbd40b3320 2024-09-13T18:50:43.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.263+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/3816197852 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdbd4140070 con 0x7fdbd40b3320 2024-09-13T18:50:43.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.263+0000 7fdbbbfff640 1 -- 172.21.15.29:0/3816197852 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdbc4004cf0 con 0x7fdbd40b3320 2024-09-13T18:50:43.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.264+0000 7fdbbbfff640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdbc006ac30 0x7fdbc006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.264+0000 7fdbbbfff640 1 -- 172.21.15.29:0/3816197852 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdbc4088830 con 0x7fdbd40b3320 2024-09-13T18:50:43.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.264+0000 7fdbd2ffd640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdbc006ac30 0x7fdbc006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.264+0000 7fdbbbfff640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] conn(0x7fdbc0074510 0x7fdbc00769b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.264+0000 7fdbbbfff640 1 -- 172.21.15.29:0/3816197852 --> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbc0077080 con 0x7fdbc0074510 2024-09-13T18:50:43.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.264+0000 7fdbbbfff640 1 -- 172.21.15.29:0/3816197852 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbc408d2c0 con 0x7fdbd40b3320 2024-09-13T18:50:43.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.264+0000 7fdbd3fff640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] conn(0x7fdbc0074510 0x7fdbc00769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.264+0000 7fdbd2ffd640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdbc006ac30 0x7fdbc006d0f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8034000 tx=0x7fdbc802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.264+0000 7fdbd3fff640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] conn(0x7fdbc0074510 0x7fdbc00769b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.265+0000 7fdbbbfff640 1 -- 172.21.15.29:0/3816197852 <== osd.4 v2:172.21.15.96:6808/1598807756 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fdbc0077080 con 0x7fdbc0074510 2024-09-13T18:50:43.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.277+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/3816197852 --> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdbd4145dc0 con 0x7fdbc0074510 2024-09-13T18:50:43.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.278+0000 7fdbbbfff640 1 -- 172.21.15.29:0/3816197852 <== osd.4 v2:172.21.15.96:6808/1598807756 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdbcc00e3f0 con 0x7fdbc0074510 2024-09-13T18:50:43.280 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-13T18:50:43.281 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:50:43.281 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-13T18:50:43.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.278+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] conn(0x7fdbc0074510 msgr2=0x7fdbc00769b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.278+0000 7fdbd9b9c640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:6808/1598807756,v1:172.21.15.96:6809/1598807756] conn(0x7fdbc0074510 0x7fdbc00769b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.278+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdbc006ac30 msgr2=0x7fdbc006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.278+0000 7fdbd9b9c640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdbc006ac30 0x7fdbc006d0f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8034000 tx=0x7fdbc802e000 comp rx=0 tx=0).stop 2024-09-13T18:50:43.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.278+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/3816197852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd40b3320 msgr2=0x7fdbd4135140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.278+0000 7fdbd9b9c640 1 --2- 172.21.15.29:0/3816197852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd40b3320 0x7fdbd4135140 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c500 tx=0x7fdbc400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.278+0000 7fdbd3fff640 1 -- 172.21.15.29:0/3816197852 reap_dead start 2024-09-13T18:50:43.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.278+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/3816197852 shutdown_connections 2024-09-13T18:50:43.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.278+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/3816197852 >> 172.21.15.29:0/3816197852 conn(0x7fdbd40b8050 msgr2=0x7fdbd413f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:43.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.278+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/3816197852 shutdown_connections 2024-09-13T18:50:43.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.278+0000 7fdbd9b9c640 1 -- 172.21.15.29:0/3816197852 wait complete. 2024-09-13T18:50:43.291 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T18:50:43.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.391+0000 7fa523ed0640 1 Processor -- start 2024-09-13T18:50:43.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.391+0000 7fa523ed0640 1 -- start start 2024-09-13T18:50:43.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa523ed0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa51c09c100 0x7fa51c071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa523ed0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa51c0721b0 0x7fa51c145da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa523ed0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa51c0b39a0 0x7fa51c1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa523ed0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c0b2b90 con 0x7fa51c0b39a0 2024-09-13T18:50:43.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa523ed0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c09c4e0 con 0x7fa51c09c100 2024-09-13T18:50:43.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa523ed0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0b79d0 con 0x7fa51c0721b0 2024-09-13T18:50:43.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa52246d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa51c0b39a0 0x7fa51c1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa52246d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa51c0b39a0 0x7fa51c1462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56068/0 (socket says 172.21.15.29:56068) 2024-09-13T18:50:43.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa52246d640 1 -- 172.21.15.29:0/3501270078 learned_addr learned my addr 172.21.15.29:0/3501270078 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:43.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa52146b640 1 --2- 172.21.15.29:0/3501270078 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa51c0721b0 0x7fa51c145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa521c6c640 1 --2- 172.21.15.29:0/3501270078 >> v2:172.21.15.96:3300/0 conn(0x7fa51c09c100 0x7fa51c071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa52246d640 1 -- 172.21.15.29:0/3501270078 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa51c0721b0 msgr2=0x7fa51c145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:43.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa52246d640 1 --2- 172.21.15.29:0/3501270078 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa51c0721b0 0x7fa51c145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa52246d640 1 -- 172.21.15.29:0/3501270078 >> v2:172.21.15.96:3300/0 conn(0x7fa51c09c100 msgr2=0x7fa51c071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:43.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa52246d640 1 --2- 172.21.15.29:0/3501270078 >> v2:172.21.15.96:3300/0 conn(0x7fa51c09c100 0x7fa51c071c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.392+0000 7fa52246d640 1 -- 172.21.15.29:0/3501270078 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c0b7c90 con 0x7fa51c0b39a0 2024-09-13T18:50:43.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.393+0000 7fa52246d640 1 --2- 172.21.15.29:0/3501270078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa51c0b39a0 0x7fa51c1462e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa51c09a2a0 tx=0x7fa51402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834c452cfb74583b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.393+0000 7fa520c6a640 1 -- 172.21.15.29:0/3501270078 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514031600 con 0x7fa51c0b39a0 2024-09-13T18:50:43.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.393+0000 7fa520c6a640 1 -- 172.21.15.29:0/3501270078 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51402d050 con 0x7fa51c0b39a0 2024-09-13T18:50:43.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.393+0000 7fa520c6a640 1 -- 172.21.15.29:0/3501270078 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514031980 con 0x7fa51c0b39a0 2024-09-13T18:50:43.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.393+0000 7fa523ed0640 1 -- 172.21.15.29:0/3501270078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa51c0b39a0 msgr2=0x7fa51c1462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.393+0000 7fa523ed0640 1 --2- 172.21.15.29:0/3501270078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa51c0b39a0 0x7fa51c1462e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa51c09a2a0 tx=0x7fa51402a610 comp rx=0 tx=0).stop 2024-09-13T18:50:43.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.393+0000 7fa523ed0640 1 -- 172.21.15.29:0/3501270078 shutdown_connections 2024-09-13T18:50:43.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.393+0000 7fa523ed0640 1 --2- 172.21.15.29:0/3501270078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa51c0b39a0 0x7fa51c1462e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.393+0000 7fa523ed0640 1 --2- 172.21.15.29:0/3501270078 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa51c0721b0 0x7fa51c145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.393+0000 7fa523ed0640 1 --2- 172.21.15.29:0/3501270078 >> v2:172.21.15.96:3300/0 conn(0x7fa51c09c100 0x7fa51c071c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.394+0000 7fa523ed0640 1 -- 172.21.15.29:0/3501270078 >> 172.21.15.29:0/3501270078 conn(0x7fa51c06a2f0 msgr2=0x7fa51c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:43.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.394+0000 7fa523ed0640 1 -- 172.21.15.29:0/3501270078 shutdown_connections 2024-09-13T18:50:43.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.394+0000 7fa523ed0640 1 -- 172.21.15.29:0/3501270078 wait complete. 2024-09-13T18:50:43.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.395+0000 7fa523ed0640 1 Processor -- start 2024-09-13T18:50:43.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.395+0000 7fa523ed0640 1 -- start start 2024-09-13T18:50:43.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.395+0000 7fa523ed0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0721b0 0x7fa51c0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.395+0000 7fa523ed0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa51c09c100 0x7fa51c1dea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.395+0000 7fa523ed0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa51c0b39a0 0x7fa51c1449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.395+0000 7fa523ed0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0b0d30 con 0x7fa51c09c100 2024-09-13T18:50:43.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.395+0000 7fa523ed0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0b1260 con 0x7fa51c0721b0 2024-09-13T18:50:43.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.395+0000 7fa523ed0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c1def40 con 0x7fa51c0b39a0 2024-09-13T18:50:43.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.395+0000 7fa52146b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa51c09c100 0x7fa51c1dea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.395+0000 7fa52146b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa51c09c100 0x7fa51c1dea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56070/0 (socket says 172.21.15.29:56070) 2024-09-13T18:50:43.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.395+0000 7fa52146b640 1 -- 172.21.15.29:0/96506386 learned_addr learned my addr 172.21.15.29:0/96506386 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:43.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.395+0000 7fa521c6c640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0721b0 0x7fa51c0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.396+0000 7fa52246d640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa51c0b39a0 0x7fa51c1449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.396+0000 7fa52146b640 1 -- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa51c0b39a0 msgr2=0x7fa51c1449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.396+0000 7fa52146b640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa51c0b39a0 0x7fa51c1449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.396+0000 7fa52146b640 1 -- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0721b0 msgr2=0x7fa51c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.396+0000 7fa52146b640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0721b0 0x7fa51c0710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.396+0000 7fa52146b640 1 -- 172.21.15.29:0/96506386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa514009b30 con 0x7fa51c09c100 2024-09-13T18:50:43.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.396+0000 7fa52146b640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa51c09c100 0x7fa51c1dea00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00e8e0 tx=0x7fa50c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.396+0000 7fa5127fc640 1 -- 172.21.15.29:0/96506386 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00c940 con 0x7fa51c09c100 2024-09-13T18:50:43.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.396+0000 7fa5127fc640 1 -- 172.21.15.29:0/96506386 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c00caa0 con 0x7fa51c09c100 2024-09-13T18:50:43.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.396+0000 7fa523ed0640 1 -- 172.21.15.29:0/96506386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c147310 con 0x7fa51c09c100 2024-09-13T18:50:43.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.396+0000 7fa5127fc640 1 -- 172.21.15.29:0/96506386 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00ce30 con 0x7fa51c09c100 2024-09-13T18:50:43.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.396+0000 7fa523ed0640 1 -- 172.21.15.29:0/96506386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c146f30 con 0x7fa51c09c100 2024-09-13T18:50:43.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.397+0000 7fa523ed0640 1 -- 172.21.15.29:0/96506386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c09bc50 con 0x7fa51c09c100 2024-09-13T18:50:43.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.398+0000 7fa5127fc640 1 -- 172.21.15.29:0/96506386 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa50c013470 con 0x7fa51c09c100 2024-09-13T18:50:43.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.398+0000 7fa5127fc640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa50006ac00 0x7fa50006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.398+0000 7fa5127fc640 1 -- 172.21.15.29:0/96506386 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa50c0898c0 con 0x7fa51c09c100 2024-09-13T18:50:43.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.398+0000 7fa521c6c640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa50006ac00 0x7fa50006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.399+0000 7fa521c6c640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa50006ac00 0x7fa50006d0c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa518009ac0 tx=0x7fa518009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.402+0000 7fa5127fc640 1 -- 172.21.15.29:0/96506386 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa50c054820 con 0x7fa51c09c100 2024-09-13T18:50:43.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.573+0000 7fa523ed0640 1 -- 172.21.15.29:0/96506386 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa51c0afeb0 con 0x7fa50006ac00 2024-09-13T18:50:43.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.573+0000 7fa5127fc640 1 -- 172.21.15.29:0/96506386 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa51c0afeb0 con 0x7fa50006ac00 2024-09-13T18:50:43.576 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T18:50:43.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.575+0000 7fa523ed0640 1 -- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa50006ac00 msgr2=0x7fa50006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.575+0000 7fa523ed0640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa50006ac00 0x7fa50006d0c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa518009ac0 tx=0x7fa518009190 comp rx=0 tx=0).stop 2024-09-13T18:50:43.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.575+0000 7fa523ed0640 1 -- 172.21.15.29:0/96506386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa51c09c100 msgr2=0x7fa51c1dea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.575+0000 7fa523ed0640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa51c09c100 0x7fa51c1dea00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00e8e0 tx=0x7fa50c00eda0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.575+0000 7fa523ed0640 1 -- 172.21.15.29:0/96506386 shutdown_connections 2024-09-13T18:50:43.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.575+0000 7fa523ed0640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fa50006ac00 0x7fa50006d0c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.575+0000 7fa523ed0640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa51c0b39a0 0x7fa51c1449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.575+0000 7fa523ed0640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa51c09c100 0x7fa51c1dea00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.575+0000 7fa523ed0640 1 --2- 172.21.15.29:0/96506386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa51c0721b0 0x7fa51c0710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.575+0000 7fa523ed0640 1 -- 172.21.15.29:0/96506386 >> 172.21.15.29:0/96506386 conn(0x7fa51c06a2f0 msgr2=0x7fa51c06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:43.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.575+0000 7fa523ed0640 1 -- 172.21.15.29:0/96506386 shutdown_connections 2024-09-13T18:50:43.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.575+0000 7fa523ed0640 1 -- 172.21.15.29:0/96506386 wait complete. 2024-09-13T18:50:43.588 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T18:50:43.588 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:50:43.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.691+0000 7f889a080640 1 Processor -- start 2024-09-13T18:50:43.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.691+0000 7f889a080640 1 -- start start 2024-09-13T18:50:43.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f889a080640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88940b55f0 0x7f8894144010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f889a080640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8894144550 0x7f889414e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f889a080640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88940b3ce0 con 0x7f88940b7b10 2024-09-13T18:50:43.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f889a080640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889406c4e0 con 0x7f8894144550 2024-09-13T18:50:43.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f889a080640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88940b6930 con 0x7f88940b55f0 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f88937fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f88940b7b10 0x7f889406b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41152/0 (socket says 172.21.15.29:41152) 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f88937fe640 1 -- 172.21.15.29:0/2419792304 learned_addr learned my addr 172.21.15.29:0/2419792304 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f8892ffd640 1 --2- 172.21.15.29:0/2419792304 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88940b55f0 0x7f8894144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f8893fff640 1 --2- 172.21.15.29:0/2419792304 >> v2:172.21.15.96:3300/0 conn(0x7f8894144550 0x7f889414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f88927fc640 1 -- 172.21.15.29:0/2419792304 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223901181 0 0) 0x7f88940b3ce0 con 0x7f88940b7b10 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f88927fc640 1 -- 172.21.15.29:0/2419792304 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8880003520 con 0x7f88940b7b10 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f8893fff640 1 -- 172.21.15.29:0/2419792304 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88940b55f0 msgr2=0x7f8894144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f8893fff640 1 --2- 172.21.15.29:0/2419792304 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88940b55f0 0x7f8894144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f88927fc640 1 -- 172.21.15.29:0/2419792304 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3195033686 0 0) 0x7f8880003520 con 0x7f88940b7b10 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f8893fff640 1 -- 172.21.15.29:0/2419792304 >> v1:172.21.15.29:6789/0 conn(0x7f88940b7b10 legacy=0x7f889406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f8893fff640 1 -- 172.21.15.29:0/2419792304 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88940b66c0 con 0x7f8894144550 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.692+0000 7f8892ffd640 1 --2- 172.21.15.29:0/2419792304 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88940b55f0 0x7f8894144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.693+0000 7f8893fff640 1 --2- 172.21.15.29:0/2419792304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8894144550 0x7f889414e170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f888c009d90 tx=0x7f888c02a4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=868094afad431ebd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.693+0000 7f88927fc640 1 -- 172.21.15.29:0/2419792304 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884001670 con 0x7f8894144550 2024-09-13T18:50:43.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.693+0000 7f88927fc640 1 -- 172.21.15.29:0/2419792304 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c02d050 con 0x7f8894144550 2024-09-13T18:50:43.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.693+0000 7f88927fc640 1 -- 172.21.15.29:0/2419792304 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c007760 con 0x7f8894144550 2024-09-13T18:50:43.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.694+0000 7f889a080640 1 -- 172.21.15.29:0/2419792304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8894144550 msgr2=0x7f889414e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.694+0000 7f889a080640 1 --2- 172.21.15.29:0/2419792304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8894144550 0x7f889414e170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f888c009d90 tx=0x7f888c02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.694+0000 7f889a080640 1 -- 172.21.15.29:0/2419792304 shutdown_connections 2024-09-13T18:50:43.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.694+0000 7f889a080640 1 --2- 172.21.15.29:0/2419792304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8894144550 0x7f889414e170 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.694+0000 7f889a080640 1 --2- 172.21.15.29:0/2419792304 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88940b55f0 0x7f8894144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.694+0000 7f889a080640 1 -- 172.21.15.29:0/2419792304 >> 172.21.15.29:0/2419792304 conn(0x7f889406a2f0 msgr2=0x7f889406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.694+0000 7f889a080640 1 -- 172.21.15.29:0/2419792304 shutdown_connections 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.694+0000 7f889a080640 1 -- 172.21.15.29:0/2419792304 wait complete. 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.695+0000 7f889a080640 1 Processor -- start 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.695+0000 7f889a080640 1 -- start start 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f889a080640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88940b55f0 0x7f889413e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f889a080640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88940b7b10 0x7f8894142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f889a080640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8894144550 0x7f88941dce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f889a080640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88941dc3f0 con 0x7f8894144550 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f889a080640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88941dc640 con 0x7f88940b7b10 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f889a080640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88941dc920 con 0x7f88940b55f0 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f8893fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8894144550 0x7f88941dce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f8893fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8894144550 0x7f88941dce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56074/0 (socket says 172.21.15.29:56074) 2024-09-13T18:50:43.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f8893fff640 1 -- 172.21.15.29:0/2142697229 learned_addr learned my addr 172.21.15.29:0/2142697229 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f8892ffd640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88940b7b10 0x7f8894142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f88937fe640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88940b55f0 0x7f889413e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f8893fff640 1 -- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88940b55f0 msgr2=0x7f889413e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f8893fff640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88940b55f0 0x7f889413e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f8893fff640 1 -- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88940b7b10 msgr2=0x7f8894142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f8893fff640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88940b7b10 0x7f8894142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f8893fff640 1 -- 172.21.15.29:0/2142697229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c009400 con 0x7f8894144550 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f8892ffd640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88940b7b10 0x7f8894142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f8893fff640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8894144550 0x7f88941dce20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f888c009d90 tx=0x7f888c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f888bfff640 1 -- 172.21.15.29:0/2142697229 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c03c830 con 0x7f8894144550 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f889a080640 1 -- 172.21.15.29:0/2142697229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888c009a70 con 0x7f8894144550 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f888bfff640 1 -- 172.21.15.29:0/2142697229 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c03c990 con 0x7f8894144550 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.696+0000 7f888bfff640 1 -- 172.21.15.29:0/2142697229 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c03cd00 con 0x7f8894144550 2024-09-13T18:50:43.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.697+0000 7f889a080640 1 -- 172.21.15.29:0/2142697229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88941418b0 con 0x7f8894144550 2024-09-13T18:50:43.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.697+0000 7f889a080640 1 -- 172.21.15.29:0/2142697229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f88940adcb0 con 0x7f8894144550 2024-09-13T18:50:43.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.698+0000 7f888bfff640 1 -- 172.21.15.29:0/2142697229 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f888c031400 con 0x7f8894144550 2024-09-13T18:50:43.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.698+0000 7f888bfff640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f887406ac30 0x7f887406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.698+0000 7f888bfff640 1 -- 172.21.15.29:0/2142697229 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f888c0aaee0 con 0x7f8894144550 2024-09-13T18:50:43.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.699+0000 7f88937fe640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f887406ac30 0x7f887406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.699+0000 7f888bfff640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] conn(0x7f8874074490 0x7f8874076930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.699+0000 7f888bfff640 1 -- 172.21.15.29:0/2142697229 --> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8874077000 con 0x7f8874074490 2024-09-13T18:50:43.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.699+0000 7f888bfff640 1 -- 172.21.15.29:0/2142697229 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f888c0ad4c0 con 0x7f8894144550 2024-09-13T18:50:43.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.699+0000 7f8892ffd640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] conn(0x7f8874074490 0x7f8874076930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.699+0000 7f88937fe640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f887406ac30 0x7f887406d0f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8884000f60 tx=0x7f8884009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.699+0000 7f8892ffd640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] conn(0x7f8874074490 0x7f8874076930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.700+0000 7f888bfff640 1 -- 172.21.15.29:0/2142697229 <== osd.5 v2:172.21.15.96:6824/1577126037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8874077000 con 0x7f8874074490 2024-09-13T18:50:43.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.712+0000 7f889a080640 1 -- 172.21.15.29:0/2142697229 --> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f88941437c0 con 0x7f8874074490 2024-09-13T18:50:43.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.713+0000 7f888bfff640 1 -- 172.21.15.29:0/2142697229 <== osd.5 v2:172.21.15.96:6824/1577126037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f88941437c0 con 0x7f8874074490 2024-09-13T18:50:43.715 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-13T18:50:43.715 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:50:43.715 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-13T18:50:43.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.713+0000 7f889a080640 1 -- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] conn(0x7f8874074490 msgr2=0x7f8874076930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.713+0000 7f889a080640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:6824/1577126037,v1:172.21.15.96:6825/1577126037] conn(0x7f8874074490 0x7f8874076930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.713+0000 7f889a080640 1 -- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f887406ac30 msgr2=0x7f887406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.713+0000 7f889a080640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f887406ac30 0x7f887406d0f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8884000f60 tx=0x7f8884009040 comp rx=0 tx=0).stop 2024-09-13T18:50:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.713+0000 7f889a080640 1 -- 172.21.15.29:0/2142697229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8894144550 msgr2=0x7f88941dce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.713+0000 7f889a080640 1 --2- 172.21.15.29:0/2142697229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8894144550 0x7f88941dce20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f888c009d90 tx=0x7f888c004a40 comp rx=0 tx=0).stop 2024-09-13T18:50:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.713+0000 7f8893fff640 1 -- 172.21.15.29:0/2142697229 reap_dead start 2024-09-13T18:50:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.713+0000 7f889a080640 1 -- 172.21.15.29:0/2142697229 shutdown_connections 2024-09-13T18:50:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.713+0000 7f889a080640 1 -- 172.21.15.29:0/2142697229 >> 172.21.15.29:0/2142697229 conn(0x7f889406a2f0 msgr2=0x7f88940ac810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.713+0000 7f889a080640 1 -- 172.21.15.29:0/2142697229 shutdown_connections 2024-09-13T18:50:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.713+0000 7f889a080640 1 -- 172.21.15.29:0/2142697229 wait complete. 2024-09-13T18:50:43.726 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T18:50:43.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.825+0000 7f1392872640 1 Processor -- start 2024-09-13T18:50:43.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.825+0000 7f1392872640 1 -- start start 2024-09-13T18:50:43.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.826+0000 7f1392872640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f138c0b55f0 0x7f138c144010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.826+0000 7f1392872640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138c0b3ce0 con 0x7f138c0b7b10 2024-09-13T18:50:43.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.826+0000 7f1392872640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138c06c4e0 con 0x7f138c144550 2024-09-13T18:50:43.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.826+0000 7f1392872640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138c0b6930 con 0x7f138c0b55f0 2024-09-13T18:50:43.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.826+0000 7f138bfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f138c0b7b10 0x7f138c06b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41160/0 (socket says 172.21.15.29:41160) 2024-09-13T18:50:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.826+0000 7f138b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f138c0b55f0 0x7f138c144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.826+0000 7f138bfff640 1 -- 172.21.15.29:0/2632992165 learned_addr learned my addr 172.21.15.29:0/2632992165 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.826+0000 7f138b7fe640 1 -- 172.21.15.29:0/2632992165 >> v1:172.21.15.96:6789/0 conn(0x7f138c144550 legacy=0x7f138c14e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.826+0000 7f138b7fe640 1 -- 172.21.15.29:0/2632992165 >> v1:172.21.15.29:6789/0 conn(0x7f138c0b7b10 legacy=0x7f138c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.826+0000 7f138b7fe640 1 -- 172.21.15.29:0/2632992165 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c0b66c0 con 0x7f138c0b55f0 2024-09-13T18:50:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.826+0000 7f138affd640 1 -- 172.21.15.29:0/2632992165 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815065773 0 0) 0x7f138c0b3ce0 con 0x7f138c0b7b10 2024-09-13T18:50:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.827+0000 7f138b7fe640 1 --2- 172.21.15.29:0/2632992165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138c0b55f0 0x7f138c144010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f13800097a0 tx=0x7f138002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf483fb483b4d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.827+0000 7f138affd640 1 -- 172.21.15.29:0/2632992165 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138002ae60 con 0x7f138c0b55f0 2024-09-13T18:50:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.827+0000 7f138affd640 1 -- 172.21.15.29:0/2632992165 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1380032440 con 0x7f138c0b55f0 2024-09-13T18:50:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.827+0000 7f138affd640 1 -- 172.21.15.29:0/2632992165 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13800327d0 con 0x7f138c0b55f0 2024-09-13T18:50:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.828+0000 7f1392872640 1 -- 172.21.15.29:0/2632992165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138c0b55f0 msgr2=0x7f138c144010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.828+0000 7f1392872640 1 --2- 172.21.15.29:0/2632992165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138c0b55f0 0x7f138c144010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f13800097a0 tx=0x7f138002a110 comp rx=0 tx=0).stop 2024-09-13T18:50:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.828+0000 7f1392872640 1 -- 172.21.15.29:0/2632992165 shutdown_connections 2024-09-13T18:50:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.828+0000 7f1392872640 1 --2- 172.21.15.29:0/2632992165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138c0b55f0 0x7f138c144010 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.828+0000 7f1392872640 1 -- 172.21.15.29:0/2632992165 >> 172.21.15.29:0/2632992165 conn(0x7f138c06a2f0 msgr2=0x7f138c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.828+0000 7f1392872640 1 -- 172.21.15.29:0/2632992165 shutdown_connections 2024-09-13T18:50:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.828+0000 7f1392872640 1 -- 172.21.15.29:0/2632992165 wait complete. 2024-09-13T18:50:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.829+0000 7f1392872640 1 Processor -- start 2024-09-13T18:50:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.829+0000 7f1392872640 1 -- start start 2024-09-13T18:50:43.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f1392872640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f138c0b55f0 0x7f138c13fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f1392872640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138c0b7b10 0x7f138c0704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f1392872640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f138c144550 0x7f138c06f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f1392872640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c06e790 con 0x7f138c0b7b10 2024-09-13T18:50:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f1392872640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c070fb0 con 0x7f138c0b55f0 2024-09-13T18:50:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f1392872640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c071290 con 0x7f138c144550 2024-09-13T18:50:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f138b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138c0b7b10 0x7f138c0704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f138b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138c0b7b10 0x7f138c0704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56088/0 (socket says 172.21.15.29:56088) 2024-09-13T18:50:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f138b7fe640 1 -- 172.21.15.29:0/3994672949 learned_addr learned my addr 172.21.15.29:0/3994672949 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f138bfff640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f138c0b55f0 0x7f138c13fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f1390e0f640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f138c144550 0x7f138c06f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f138b7fe640 1 -- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f138c144550 msgr2=0x7f138c06f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f138b7fe640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f138c144550 0x7f138c06f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f138b7fe640 1 -- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f138c0b55f0 msgr2=0x7f138c13fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f138b7fe640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f138c0b55f0 0x7f138c13fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f138b7fe640 1 -- 172.21.15.29:0/3994672949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380009400 con 0x7f138c0b7b10 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f1390e0f640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f138c144550 0x7f138c06f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f138b7fe640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138c0b7b10 0x7f138c0704c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1380000c00 tx=0x7f13800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f1388ff9640 1 -- 172.21.15.29:0/3994672949 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380030a10 con 0x7f138c0b7b10 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f1388ff9640 1 -- 172.21.15.29:0/3994672949 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1380030b70 con 0x7f138c0b7b10 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f1392872640 1 -- 172.21.15.29:0/3994672949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c0afce0 con 0x7f138c0b7b10 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.830+0000 7f1388ff9640 1 -- 172.21.15.29:0/3994672949 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138003d420 con 0x7f138c0b7b10 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.831+0000 7f1392872640 1 -- 172.21.15.29:0/3994672949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c070a00 con 0x7f138c0b7b10 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.831+0000 7f1392872640 1 -- 172.21.15.29:0/3994672949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c06f570 con 0x7f138c0b7b10 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.832+0000 7f1388ff9640 1 -- 172.21.15.29:0/3994672949 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1380039040 con 0x7f138c0b7b10 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.832+0000 7f1388ff9640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f137806ac00 0x7f137806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.832+0000 7f1388ff9640 1 -- 172.21.15.29:0/3994672949 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f13800aa2f0 con 0x7f138c0b7b10 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.833+0000 7f138bfff640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f137806ac00 0x7f137806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.833+0000 7f138bfff640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f137806ac00 0x7f137806d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f137c007f70 tx=0x7f137c007f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:43.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:43.837+0000 7f1388ff9640 1 -- 172.21.15.29:0/3994672949 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f138c06f570 con 0x7f138c0b7b10 2024-09-13T18:50:44.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.006+0000 7f1392872640 1 -- 172.21.15.29:0/3994672949 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f138c0b18b0 con 0x7f137806ac00 2024-09-13T18:50:44.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.007+0000 7f1388ff9640 1 -- 172.21.15.29:0/3994672949 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f137c004c70 con 0x7f137806ac00 2024-09-13T18:50:44.010 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T18:50:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.008+0000 7f1392872640 1 -- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f137806ac00 msgr2=0x7f137806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.008+0000 7f1392872640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f137806ac00 0x7f137806d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f137c007f70 tx=0x7f137c007f00 comp rx=0 tx=0).stop 2024-09-13T18:50:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.008+0000 7f1392872640 1 -- 172.21.15.29:0/3994672949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138c0b7b10 msgr2=0x7f138c0704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.008+0000 7f1392872640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138c0b7b10 0x7f138c0704c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1380000c00 tx=0x7f13800046c0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.008+0000 7f1392872640 1 -- 172.21.15.29:0/3994672949 shutdown_connections 2024-09-13T18:50:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.008+0000 7f1392872640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f137806ac00 0x7f137806d0c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.008+0000 7f1392872640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f138c144550 0x7f138c06f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.008+0000 7f1392872640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138c0b7b10 0x7f138c0704c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.008+0000 7f1392872640 1 --2- 172.21.15.29:0/3994672949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f138c0b55f0 0x7f138c13fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.008+0000 7f1392872640 1 -- 172.21.15.29:0/3994672949 >> 172.21.15.29:0/3994672949 conn(0x7f138c06a2f0 msgr2=0x7f138c099210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:44.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.009+0000 7f1392872640 1 -- 172.21.15.29:0/3994672949 shutdown_connections 2024-09-13T18:50:44.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.009+0000 7f1392872640 1 -- 172.21.15.29:0/3994672949 wait complete. 2024-09-13T18:50:44.023 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T18:50:44.023 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:50:44.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.127+0000 7f6b0c9fe640 1 Processor -- start 2024-09-13T18:50:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.127+0000 7f6b0c9fe640 1 -- start start 2024-09-13T18:50:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b0c9fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b08146190 0x7f6b080b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b0c9fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6b080b4e20 0x7f6b08142560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b0c9fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b080b3e40 con 0x7f6b0806d750 2024-09-13T18:50:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b0c9fe640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b080b44c0 con 0x7f6b080b4e20 2024-09-13T18:50:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b0c9fe640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0806db30 con 0x7f6b08146190 2024-09-13T18:50:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b06d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6b0806d750 0x7f6b08145a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60106/0 (socket says 172.21.15.29:60106) 2024-09-13T18:50:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b06d9d640 1 -- 172.21.15.29:0/2430200178 learned_addr learned my addr 172.21.15.29:0/2430200178 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b0759e640 1 --2- 172.21.15.29:0/2430200178 >> v2:172.21.15.96:3300/0 conn(0x7f6b080b4e20 0x7f6b08142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b0659c640 1 --2- 172.21.15.29:0/2430200178 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b08146190 0x7f6b080b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b05d9b640 1 -- 172.21.15.29:0/2430200178 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115956340 0 0) 0x7f6b080b3e40 con 0x7f6b0806d750 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b05d9b640 1 -- 172.21.15.29:0/2430200178 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6af0003520 con 0x7f6b0806d750 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b0759e640 1 -- 172.21.15.29:0/2430200178 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b08146190 msgr2=0x7f6b080b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b0759e640 1 --2- 172.21.15.29:0/2430200178 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b08146190 0x7f6b080b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b0759e640 1 -- 172.21.15.29:0/2430200178 >> v1:172.21.15.29:6789/0 conn(0x7f6b0806d750 legacy=0x7f6b08145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.128+0000 7f6b0759e640 1 -- 172.21.15.29:0/2430200178 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080b5480 con 0x7f6b080b4e20 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.129+0000 7f6b0759e640 1 --2- 172.21.15.29:0/2430200178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b080b4e20 0x7f6b08142560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009d90 tx=0x7f6b0002a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=935a5a98547c9c46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.129+0000 7f6b05d9b640 1 -- 172.21.15.29:0/2430200178 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00007740 con 0x7f6b080b4e20 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.129+0000 7f6b05d9b640 1 -- 172.21.15.29:0/2430200178 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0002d050 con 0x7f6b080b4e20 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.129+0000 7f6b05d9b640 1 -- 172.21.15.29:0/2430200178 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00007aa0 con 0x7f6b080b4e20 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.130+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2430200178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b080b4e20 msgr2=0x7f6b08142560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.130+0000 7f6b0c9fe640 1 --2- 172.21.15.29:0/2430200178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b080b4e20 0x7f6b08142560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009d90 tx=0x7f6b0002a530 comp rx=0 tx=0).stop 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.130+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2430200178 shutdown_connections 2024-09-13T18:50:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.130+0000 7f6b0c9fe640 1 --2- 172.21.15.29:0/2430200178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b080b4e20 0x7f6b08142560 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.130+0000 7f6b0c9fe640 1 --2- 172.21.15.29:0/2430200178 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b08146190 0x7f6b080b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.130+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2430200178 >> 172.21.15.29:0/2430200178 conn(0x7f6b0809b150 msgr2=0x7f6b0809b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.130+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2430200178 shutdown_connections 2024-09-13T18:50:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.130+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2430200178 wait complete. 2024-09-13T18:50:44.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.131+0000 7f6b0c9fe640 1 Processor -- start 2024-09-13T18:50:44.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.131+0000 7f6b0c9fe640 1 -- start start 2024-09-13T18:50:44.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b0c9fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b0806d750 0x7f6b081de060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b0c9fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b080b4e20 0x7f6b08141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b0c9fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b08146190 0x7f6b08141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b0c9fe640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08141fd0 con 0x7f6b0806d750 2024-09-13T18:50:44.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b0c9fe640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080b0ae0 con 0x7f6b08146190 2024-09-13T18:50:44.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b0c9fe640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080b07e0 con 0x7f6b080b4e20 2024-09-13T18:50:44.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b06d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b0806d750 0x7f6b081de060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b06d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b0806d750 0x7f6b081de060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58184/0 (socket says 172.21.15.29:58184) 2024-09-13T18:50:44.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b06d9d640 1 -- 172.21.15.29:0/2018771815 learned_addr learned my addr 172.21.15.29:0/2018771815 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:44.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b0759e640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b08146190 0x7f6b08141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b0659c640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b080b4e20 0x7f6b08141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b06d9d640 1 -- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b080b4e20 msgr2=0x7f6b08141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b06d9d640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b080b4e20 0x7f6b08141550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.132+0000 7f6b06d9d640 1 -- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b08146190 msgr2=0x7f6b08141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.133+0000 7f6b06d9d640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b08146190 0x7f6b08141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.133+0000 7f6b06d9d640 1 -- 172.21.15.29:0/2018771815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b00009a70 con 0x7f6b0806d750 2024-09-13T18:50:44.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.133+0000 7f6b0759e640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b08146190 0x7f6b08141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:44.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.133+0000 7f6b06d9d640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b0806d750 0x7f6b081de060 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c460 tx=0x7f6af800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.133+0000 7f6aef7fe640 1 -- 172.21.15.29:0/2018771815 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8005ce0 con 0x7f6b0806d750 2024-09-13T18:50:44.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.133+0000 7f6aef7fe640 1 -- 172.21.15.29:0/2018771815 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8005e40 con 0x7f6b0806d750 2024-09-13T18:50:44.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.133+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2018771815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b081de9e0 con 0x7f6b0806d750 2024-09-13T18:50:44.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.133+0000 7f6aef7fe640 1 -- 172.21.15.29:0/2018771815 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8007290 con 0x7f6b0806d750 2024-09-13T18:50:44.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.133+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2018771815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0809f390 con 0x7f6b0806d750 2024-09-13T18:50:44.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.134+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2018771815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b081431d0 con 0x7f6b0806d750 2024-09-13T18:50:44.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.134+0000 7f6aef7fe640 1 -- 172.21.15.29:0/2018771815 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6af80073f0 con 0x7f6b0806d750 2024-09-13T18:50:44.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.135+0000 7f6aef7fe640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6af406ac00 0x7f6af406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.135+0000 7f6aef7fe640 1 -- 172.21.15.29:0/2018771815 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6af8088c10 con 0x7f6b0806d750 2024-09-13T18:50:44.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.135+0000 7f6aef7fe640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] conn(0x7f6af40744e0 0x7f6af4076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.135+0000 7f6aef7fe640 1 -- 172.21.15.29:0/2018771815 --> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6af4077050 con 0x7f6af40744e0 2024-09-13T18:50:44.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.135+0000 7f6aef7fe640 1 -- 172.21.15.29:0/2018771815 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6af808e2a0 con 0x7f6b0806d750 2024-09-13T18:50:44.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.135+0000 7f6b0659c640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6af406ac00 0x7f6af406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.135+0000 7f6b0759e640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] conn(0x7f6af40744e0 0x7f6af4076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.136+0000 7f6b0659c640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6af406ac00 0x7f6af406d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b080b8d30 tx=0x7f6afc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.136+0000 7f6b0759e640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] conn(0x7f6af40744e0 0x7f6af4076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.136+0000 7f6aef7fe640 1 -- 172.21.15.29:0/2018771815 <== osd.6 v2:172.21.15.96:6800/2433452864 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6af4077050 con 0x7f6af40744e0 2024-09-13T18:50:44.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.148+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2018771815 --> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6b080b0920 con 0x7f6af40744e0 2024-09-13T18:50:44.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.149+0000 7f6aef7fe640 1 -- 172.21.15.29:0/2018771815 <== osd.6 v2:172.21.15.96:6800/2433452864 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6b080b0920 con 0x7f6af40744e0 2024-09-13T18:50:44.153 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-13T18:50:44.153 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:50:44.153 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-13T18:50:44.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.150+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] conn(0x7f6af40744e0 msgr2=0x7f6af4076980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.150+0000 7f6b0c9fe640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:6800/2433452864,v1:172.21.15.96:6801/2433452864] conn(0x7f6af40744e0 0x7f6af4076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.150+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6af406ac00 msgr2=0x7f6af406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.150+0000 7f6b0c9fe640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f6af406ac00 0x7f6af406d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b080b8d30 tx=0x7f6afc008040 comp rx=0 tx=0).stop 2024-09-13T18:50:44.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.150+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2018771815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b0806d750 msgr2=0x7f6b081de060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.150+0000 7f6b0c9fe640 1 --2- 172.21.15.29:0/2018771815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b0806d750 0x7f6b081de060 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c460 tx=0x7f6af800c920 comp rx=0 tx=0).stop 2024-09-13T18:50:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.150+0000 7f6b0759e640 1 -- 172.21.15.29:0/2018771815 reap_dead start 2024-09-13T18:50:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.150+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2018771815 shutdown_connections 2024-09-13T18:50:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.150+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2018771815 >> 172.21.15.29:0/2018771815 conn(0x7f6b0809b150 msgr2=0x7f6b080afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.150+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2018771815 shutdown_connections 2024-09-13T18:50:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.150+0000 7f6b0c9fe640 1 -- 172.21.15.29:0/2018771815 wait complete. 2024-09-13T18:50:44.163 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T18:50:44.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.263+0000 7fe7111ce640 1 Processor -- start 2024-09-13T18:50:44.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.263+0000 7fe7111ce640 1 -- start start 2024-09-13T18:50:44.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe7111ce640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe70c0b7b10 0x7fe70c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe7111ce640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe70c0b4310 0x7fe70c145e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe7111ce640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe70c146370 0x7fe70c146800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe7111ce640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c072580 con 0x7fe70c0b4310 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe7111ce640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c0b6b80 con 0x7fe70c0b7b10 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe7111ce640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b39a0 con 0x7fe70c146370 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe70a59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe70c0b4310 0x7fe70c145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe70a59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe70c0b4310 0x7fe70c145e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58200/0 (socket says 172.21.15.29:58200) 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe70a59c640 1 -- 172.21.15.29:0/3781213974 learned_addr learned my addr 172.21.15.29:0/3781213974 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe70ad9d640 1 --2- 172.21.15.29:0/3781213974 >> v2:172.21.15.96:3300/0 conn(0x7fe70c0b7b10 0x7fe70c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe70b59e640 1 --2- 172.21.15.29:0/3781213974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe70c146370 0x7fe70c146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe70a59c640 1 -- 172.21.15.29:0/3781213974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe70c146370 msgr2=0x7fe70c146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe70a59c640 1 --2- 172.21.15.29:0/3781213974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe70c146370 0x7fe70c146800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe70a59c640 1 -- 172.21.15.29:0/3781213974 >> v2:172.21.15.96:3300/0 conn(0x7fe70c0b7b10 msgr2=0x7fe70c0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe70a59c640 1 --2- 172.21.15.29:0/3781213974 >> v2:172.21.15.96:3300/0 conn(0x7fe70c0b7b10 0x7fe70c0b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.264+0000 7fe70a59c640 1 -- 172.21.15.29:0/3781213974 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c09d7e0 con 0x7fe70c0b4310 2024-09-13T18:50:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.265+0000 7fe70a59c640 1 --2- 172.21.15.29:0/3781213974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70c0b4310 0x7fe70c145e30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe70c06cf80 tx=0x7fe70002c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85d915c4c71769b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.265+0000 7fe709d9b640 1 -- 172.21.15.29:0/3781213974 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70002cea0 con 0x7fe70c0b4310 2024-09-13T18:50:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.265+0000 7fe709d9b640 1 -- 172.21.15.29:0/3781213974 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700034640 con 0x7fe70c0b4310 2024-09-13T18:50:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.265+0000 7fe709d9b640 1 -- 172.21.15.29:0/3781213974 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000349d0 con 0x7fe70c0b4310 2024-09-13T18:50:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.266+0000 7fe7111ce640 1 -- 172.21.15.29:0/3781213974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70c0b4310 msgr2=0x7fe70c145e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.266+0000 7fe7111ce640 1 --2- 172.21.15.29:0/3781213974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70c0b4310 0x7fe70c145e30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe70c06cf80 tx=0x7fe70002c390 comp rx=0 tx=0).stop 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.266+0000 7fe7111ce640 1 -- 172.21.15.29:0/3781213974 shutdown_connections 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.266+0000 7fe7111ce640 1 --2- 172.21.15.29:0/3781213974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe70c146370 0x7fe70c146800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.266+0000 7fe7111ce640 1 --2- 172.21.15.29:0/3781213974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70c0b4310 0x7fe70c145e30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.266+0000 7fe7111ce640 1 --2- 172.21.15.29:0/3781213974 >> v2:172.21.15.96:3300/0 conn(0x7fe70c0b7b10 0x7fe70c0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.266+0000 7fe7111ce640 1 -- 172.21.15.29:0/3781213974 >> 172.21.15.29:0/3781213974 conn(0x7fe70c06a2f0 msgr2=0x7fe70c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.266+0000 7fe7111ce640 1 -- 172.21.15.29:0/3781213974 shutdown_connections 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.266+0000 7fe7111ce640 1 -- 172.21.15.29:0/3781213974 wait complete. 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.267+0000 7fe7111ce640 1 Processor -- start 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.267+0000 7fe7111ce640 1 -- start start 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe7111ce640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe70c0b4310 0x7fe70c070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe7111ce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70c0b7b10 0x7fe70c08f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe7111ce640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe70c146370 0x7fe70c144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe7111ce640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c099f80 con 0x7fe70c0b7b10 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe7111ce640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1debe0 con 0x7fe70c146370 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe7111ce640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c093ab0 con 0x7fe70c0b4310 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe70a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70c0b7b10 0x7fe70c08f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe70a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70c0b7b10 0x7fe70c08f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58208/0 (socket says 172.21.15.29:58208) 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe70a59c640 1 -- 172.21.15.29:0/193726019 learned_addr learned my addr 172.21.15.29:0/193726019 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe70b59e640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe70c146370 0x7fe70c144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe70ad9d640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe70c0b4310 0x7fe70c070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe70a59c640 1 -- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe70c0b4310 msgr2=0x7fe70c070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe70a59c640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe70c0b4310 0x7fe70c070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe70a59c640 1 -- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe70c146370 msgr2=0x7fe70c144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe70a59c640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe70c146370 0x7fe70c144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe70a59c640 1 -- 172.21.15.29:0/193726019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7000094d0 con 0x7fe70c0b7b10 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe70a59c640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70c0b7b10 0x7fe70c08f430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe700000c00 tx=0x7fe7000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.268+0000 7fe6f37fe640 1 -- 172.21.15.29:0/193726019 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70002cea0 con 0x7fe70c0b7b10 2024-09-13T18:50:44.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.269+0000 7fe6f37fe640 1 -- 172.21.15.29:0/193726019 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700032980 con 0x7fe70c0b7b10 2024-09-13T18:50:44.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.269+0000 7fe6f37fe640 1 -- 172.21.15.29:0/193726019 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700032d30 con 0x7fe70c0b7b10 2024-09-13T18:50:44.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.269+0000 7fe7111ce640 1 -- 172.21.15.29:0/193726019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c1de520 con 0x7fe70c0b7b10 2024-09-13T18:50:44.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.269+0000 7fe7111ce640 1 -- 172.21.15.29:0/193726019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c1df000 con 0x7fe70c0b7b10 2024-09-13T18:50:44.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.270+0000 7fe7111ce640 1 -- 172.21.15.29:0/193726019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c1ded20 con 0x7fe70c0b7b10 2024-09-13T18:50:44.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.270+0000 7fe6f37fe640 1 -- 172.21.15.29:0/193726019 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe700048460 con 0x7fe70c0b7b10 2024-09-13T18:50:44.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.271+0000 7fe6f37fe640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe6f806ac00 0x7fe6f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.271+0000 7fe6f37fe640 1 -- 172.21.15.29:0/193726019 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe7000aa140 con 0x7fe70c0b7b10 2024-09-13T18:50:44.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.271+0000 7fe70ad9d640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe6f806ac00 0x7fe6f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.272+0000 7fe70ad9d640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe6f806ac00 0x7fe6f806d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc006fd0 tx=0x7fe6fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.275+0000 7fe6f37fe640 1 -- 172.21.15.29:0/193726019 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe70c1ded20 con 0x7fe70c0b7b10 2024-09-13T18:50:44.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.448+0000 7fe7111ce640 1 -- 172.21.15.29:0/193726019 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fe70c0b3510 con 0x7fe6f806ac00 2024-09-13T18:50:44.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.449+0000 7fe6f37fe640 1 -- 172.21.15.29:0/193726019 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe6fc004020 con 0x7fe6f806ac00 2024-09-13T18:50:44.451 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T18:50:44.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.451+0000 7fe7111ce640 1 -- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe6f806ac00 msgr2=0x7fe6f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.451+0000 7fe7111ce640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe6f806ac00 0x7fe6f806d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc006fd0 tx=0x7fe6fc008040 comp rx=0 tx=0).stop 2024-09-13T18:50:44.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.451+0000 7fe7111ce640 1 -- 172.21.15.29:0/193726019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70c0b7b10 msgr2=0x7fe70c08f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.451+0000 7fe7111ce640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70c0b7b10 0x7fe70c08f430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe700000c00 tx=0x7fe7000046c0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.451+0000 7fe7111ce640 1 -- 172.21.15.29:0/193726019 shutdown_connections 2024-09-13T18:50:44.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.451+0000 7fe7111ce640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe6f806ac00 0x7fe6f806d0c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.451+0000 7fe7111ce640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe70c146370 0x7fe70c144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.451+0000 7fe7111ce640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70c0b7b10 0x7fe70c08f430 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.451+0000 7fe7111ce640 1 --2- 172.21.15.29:0/193726019 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe70c0b4310 0x7fe70c070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.451+0000 7fe7111ce640 1 -- 172.21.15.29:0/193726019 >> 172.21.15.29:0/193726019 conn(0x7fe70c06a2f0 msgr2=0x7fe70c09aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:44.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.451+0000 7fe7111ce640 1 -- 172.21.15.29:0/193726019 shutdown_connections 2024-09-13T18:50:44.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.451+0000 7fe7111ce640 1 -- 172.21.15.29:0/193726019 wait complete. 2024-09-13T18:50:44.465 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T18:50:44.465 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:50:44.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.569+0000 7f80ecb08640 1 Processor -- start 2024-09-13T18:50:44.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.569+0000 7f80ecb08640 1 -- start start 2024-09-13T18:50:44.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.569+0000 7f80ecb08640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e814f280 0x7f80e8151670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.569+0000 7f80ecb08640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e806bf50 con 0x7f80e813f7b0 2024-09-13T18:50:44.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.569+0000 7f80ecb08640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e80b4400 con 0x7f80e80b9cf0 2024-09-13T18:50:44.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.569+0000 7f80ecb08640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80ba0d0 con 0x7f80e814f280 2024-09-13T18:50:44.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e5d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f80e813f7b0 0x7f80e813fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60120/0 (socket says 172.21.15.29:60120) 2024-09-13T18:50:44.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e5d9b640 1 -- 172.21.15.29:0/415275506 learned_addr learned my addr 172.21.15.29:0/415275506 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:44.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703597665 0 0) 0x7f80e806bf50 con 0x7f80e813f7b0 2024-09-13T18:50:44.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80d0003520 con 0x7f80e813f7b0 2024-09-13T18:50:44.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e6d9d640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e814f280 0x7f80e8151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 342343889 0 0) 0x7f80d0003520 con 0x7f80e813f7b0 2024-09-13T18:50:44.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e814f280 msgr2=0x7f80e8151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:44.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e814f280 0x7f80e8151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 >> v1:172.21.15.96:6789/0 conn(0x7f80e80b9cf0 legacy=0x7f80e806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80b5c00 con 0x7f80e813f7b0 2024-09-13T18:50:44.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f80dc001670 con 0x7f80e813f7b0 2024-09-13T18:50:44.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 >> v1:172.21.15.29:6789/0 conn(0x7f80e813f7b0 legacy=0x7f80e813fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d00039a0 0x7f80d0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e814f280 0x7f80d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80d0004d00 0x7f80d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80ba0d0 con 0x7f80d0004d00 2024-09-13T18:50:44.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d000ba60 con 0x7f80d00039a0 2024-09-13T18:50:44.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d000bc20 con 0x7f80e814f280 2024-09-13T18:50:44.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e6d9d640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80d0004d00 0x7f80d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e5d9b640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e814f280 0x7f80d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.570+0000 7f80e659c640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d00039a0 0x7f80d0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.571+0000 7f80e6d9d640 1 -- 172.21.15.29:0/415275506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e814f280 msgr2=0x7f80d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:44.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.571+0000 7f80e6d9d640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e814f280 0x7f80d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.571+0000 7f80e6d9d640 1 -- 172.21.15.29:0/415275506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d00039a0 msgr2=0x7f80d0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:44.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.571+0000 7f80e6d9d640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d00039a0 0x7f80d0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.571+0000 7f80e6d9d640 1 -- 172.21.15.29:0/415275506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0003520 con 0x7f80d0004d00 2024-09-13T18:50:44.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.571+0000 7f80e5d9b640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e814f280 0x7f80d00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:44.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.571+0000 7f80e6d9d640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80d0004d00 0x7f80d0005180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f80e80b53b0 tx=0x7f80d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93a261b6c527559 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.571+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0032600 con 0x7f80d0004d00 2024-09-13T18:50:44.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.572+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e002e050 con 0x7f80d0004d00 2024-09-13T18:50:44.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.572+0000 7f80e559a640 1 -- 172.21.15.29:0/415275506 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0032980 con 0x7f80d0004d00 2024-09-13T18:50:44.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.572+0000 7f80ecb08640 1 -- 172.21.15.29:0/415275506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80d0004d00 msgr2=0x7f80d0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.572+0000 7f80ecb08640 1 --2- 172.21.15.29:0/415275506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80d0004d00 0x7f80d0005180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f80e80b53b0 tx=0x7f80d00057f0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.572+0000 7f80e6d9d640 1 -- 172.21.15.29:0/415275506 reap_dead start 2024-09-13T18:50:44.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.572+0000 7f80ecb08640 1 -- 172.21.15.29:0/415275506 shutdown_connections 2024-09-13T18:50:44.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.572+0000 7f80ecb08640 1 -- 172.21.15.29:0/415275506 >> 172.21.15.29:0/415275506 conn(0x7f80e806a560 msgr2=0x7f80e80b9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:44.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.572+0000 7f80ecb08640 1 -- 172.21.15.29:0/415275506 shutdown_connections 2024-09-13T18:50:44.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.572+0000 7f80ecb08640 1 -- 172.21.15.29:0/415275506 wait complete. 2024-09-13T18:50:44.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.573+0000 7f80ecb08640 1 Processor -- start 2024-09-13T18:50:44.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.573+0000 7f80ecb08640 1 -- start start 2024-09-13T18:50:44.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80ecb08640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d0004d00 0x7f80e80b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80ecb08640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e81dc140 0x7f80e81de9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80ecb08640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80e81def00 0x7f80e81df380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80ecb08640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e81db450 con 0x7f80e81def00 2024-09-13T18:50:44.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80ecb08640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8147bc0 con 0x7f80d0004d00 2024-09-13T18:50:44.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80ecb08640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e81480f0 con 0x7f80e81dc140 2024-09-13T18:50:44.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80e6d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80e81def00 0x7f80e81df380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80e6d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80e81def00 0x7f80e81df380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58226/0 (socket says 172.21.15.29:58226) 2024-09-13T18:50:44.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80e6d9d640 1 -- 172.21.15.29:0/1477396306 learned_addr learned my addr 172.21.15.29:0/1477396306 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:44.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80e659c640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d0004d00 0x7f80e80b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80e5d9b640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e81dc140 0x7f80e81de9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80e6d9d640 1 -- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e81dc140 msgr2=0x7f80e81de9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80e6d9d640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e81dc140 0x7f80e81de9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80e6d9d640 1 -- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d0004d00 msgr2=0x7f80e80b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80e6d9d640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d0004d00 0x7f80e80b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80e6d9d640 1 -- 172.21.15.29:0/1477396306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e81db660 con 0x7f80e81def00 2024-09-13T18:50:44.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80e5d9b640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80e81dc140 0x7f80e81de9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:44.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.574+0000 7f80e659c640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d0004d00 0x7f80e80b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:44.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.575+0000 7f80e6d9d640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80e81def00 0x7f80e81df380 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f80e0035040 tx=0x7f80e0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.575+0000 7f80d6ffd640 1 -- 172.21.15.29:0/1477396306 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e003c810 con 0x7f80e81def00 2024-09-13T18:50:44.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.575+0000 7f80d6ffd640 1 -- 172.21.15.29:0/1477396306 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e000f040 con 0x7f80e81def00 2024-09-13T18:50:44.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.575+0000 7f80ecb08640 1 -- 172.21.15.29:0/1477396306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e81db940 con 0x7f80e81def00 2024-09-13T18:50:44.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.575+0000 7f80d6ffd640 1 -- 172.21.15.29:0/1477396306 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e003cbd0 con 0x7f80e81def00 2024-09-13T18:50:44.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.575+0000 7f80ecb08640 1 -- 172.21.15.29:0/1477396306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e8147e10 con 0x7f80e81def00 2024-09-13T18:50:44.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.576+0000 7f80ecb08640 1 -- 172.21.15.29:0/1477396306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f80e806afe0 con 0x7f80e81def00 2024-09-13T18:50:44.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.576+0000 7f80d6ffd640 1 -- 172.21.15.29:0/1477396306 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f80e003cd30 con 0x7f80e81def00 2024-09-13T18:50:44.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.577+0000 7f80d6ffd640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f80c806ac00 0x7f80c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.577+0000 7f80d6ffd640 1 -- 172.21.15.29:0/1477396306 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f80e00aa190 con 0x7f80e81def00 2024-09-13T18:50:44.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.577+0000 7f80d6ffd640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] conn(0x7f80c80744e0 0x7f80c8076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.577+0000 7f80d6ffd640 1 -- 172.21.15.29:0/1477396306 --> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80c8077050 con 0x7f80c80744e0 2024-09-13T18:50:44.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.577+0000 7f80d6ffd640 1 -- 172.21.15.29:0/1477396306 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80e00ac770 con 0x7f80e81def00 2024-09-13T18:50:44.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.577+0000 7f80e659c640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f80c806ac00 0x7f80c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.577+0000 7f80e5d9b640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] conn(0x7f80c80744e0 0x7f80c8076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.577+0000 7f80e659c640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f80c806ac00 0x7f80c806d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f80e813bd60 tx=0x7f80d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.578+0000 7f80e5d9b640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] conn(0x7f80c80744e0 0x7f80c8076980 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.578+0000 7f80d6ffd640 1 -- 172.21.15.29:0/1477396306 <== osd.7 v2:172.21.15.96:6816/1178210252 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f80c8077050 con 0x7f80c80744e0 2024-09-13T18:50:44.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.591+0000 7f80ecb08640 1 -- 172.21.15.29:0/1477396306 --> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f80e8072490 con 0x7f80c80744e0 2024-09-13T18:50:44.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.592+0000 7f80d6ffd640 1 -- 172.21.15.29:0/1477396306 <== osd.7 v2:172.21.15.96:6816/1178210252 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f80dc0015e0 con 0x7f80c80744e0 2024-09-13T18:50:44.603 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-13T18:50:44.603 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:50:44.603 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-13T18:50:44.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.592+0000 7f80ecb08640 1 -- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] conn(0x7f80c80744e0 msgr2=0x7f80c8076980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.592+0000 7f80ecb08640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:6816/1178210252,v1:172.21.15.96:6817/1178210252] conn(0x7f80c80744e0 0x7f80c8076980 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.592+0000 7f80ecb08640 1 -- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f80c806ac00 msgr2=0x7f80c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.592+0000 7f80ecb08640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f80c806ac00 0x7f80c806d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f80e813bd60 tx=0x7f80d8009040 comp rx=0 tx=0).stop 2024-09-13T18:50:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.592+0000 7f80ecb08640 1 -- 172.21.15.29:0/1477396306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80e81def00 msgr2=0x7f80e81df380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.592+0000 7f80ecb08640 1 --2- 172.21.15.29:0/1477396306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80e81def00 0x7f80e81df380 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f80e0035040 tx=0x7f80e0009750 comp rx=0 tx=0).stop 2024-09-13T18:50:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.592+0000 7f80e6d9d640 1 -- 172.21.15.29:0/1477396306 reap_dead start 2024-09-13T18:50:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.592+0000 7f80ecb08640 1 -- 172.21.15.29:0/1477396306 shutdown_connections 2024-09-13T18:50:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.592+0000 7f80ecb08640 1 -- 172.21.15.29:0/1477396306 >> 172.21.15.29:0/1477396306 conn(0x7f80e806a560 msgr2=0x7f80e80b5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.592+0000 7f80ecb08640 1 -- 172.21.15.29:0/1477396306 shutdown_connections 2024-09-13T18:50:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.592+0000 7f80ecb08640 1 -- 172.21.15.29:0/1477396306 wait complete. 2024-09-13T18:50:44.608 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T18:50:44.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.707+0000 7fe636620640 1 Processor -- start 2024-09-13T18:50:44.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.707+0000 7fe636620640 1 -- start start 2024-09-13T18:50:44.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.708+0000 7fe636620640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe6300b4260 0x7fe6300b5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.708+0000 7fe636620640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6300b1ec0 0x7fe6300b2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.708+0000 7fe636620640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6300b4640 con 0x7fe6300b4ed0 2024-09-13T18:50:44.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.708+0000 7fe636620640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6300b5c50 con 0x7fe6300b4260 2024-09-13T18:50:44.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.708+0000 7fe636620640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300b9b20 con 0x7fe6300b1ec0 2024-09-13T18:50:44.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.708+0000 7fe62f7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe6300b4ed0 0x7fe6301409e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60126/0 (socket says 172.21.15.29:60126) 2024-09-13T18:50:44.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.708+0000 7fe62f7fe640 1 -- 172.21.15.29:0/100626544 learned_addr learned my addr 172.21.15.29:0/100626544 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:50:44.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.708+0000 7fe634bbd640 1 --2- 172.21.15.29:0/100626544 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6300b1ec0 0x7fe6300b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.708+0000 7fe62ffff640 1 --2- 172.21.15.29:0/100626544 >> v2:172.21.15.96:3300/0 conn(0x7fe6300b4260 0x7fe6300b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.708+0000 7fe62effd640 1 -- 172.21.15.29:0/100626544 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396382783 0 0) 0x7fe6300b4640 con 0x7fe6300b4ed0 2024-09-13T18:50:44.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.709+0000 7fe62effd640 1 -- 172.21.15.29:0/100626544 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe618003520 con 0x7fe6300b4ed0 2024-09-13T18:50:44.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.709+0000 7fe62effd640 1 -- 172.21.15.29:0/100626544 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4142062523 0 0) 0x7fe618003520 con 0x7fe6300b4ed0 2024-09-13T18:50:44.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.709+0000 7fe62ffff640 1 -- 172.21.15.29:0/100626544 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6300b1ec0 msgr2=0x7fe6300b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:44.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.709+0000 7fe62ffff640 1 --2- 172.21.15.29:0/100626544 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6300b1ec0 0x7fe6300b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.709+0000 7fe62ffff640 1 -- 172.21.15.29:0/100626544 >> v1:172.21.15.29:6789/0 conn(0x7fe6300b4ed0 legacy=0x7fe6301409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.709+0000 7fe62ffff640 1 -- 172.21.15.29:0/100626544 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6300b9e00 con 0x7fe6300b4260 2024-09-13T18:50:44.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.709+0000 7fe62ffff640 1 --2- 172.21.15.29:0/100626544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6300b4260 0x7fe6300b5630 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe6200097a0 tx=0x7fe62002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a201e44dcc65afc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.710+0000 7fe62effd640 1 -- 172.21.15.29:0/100626544 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624001670 con 0x7fe6300b4260 2024-09-13T18:50:44.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.710+0000 7fe62effd640 1 -- 172.21.15.29:0/100626544 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62002ab10 con 0x7fe6300b4260 2024-09-13T18:50:44.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.710+0000 7fe62effd640 1 -- 172.21.15.29:0/100626544 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62002aea0 con 0x7fe6300b4260 2024-09-13T18:50:44.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.710+0000 7fe636620640 1 -- 172.21.15.29:0/100626544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6300b4260 msgr2=0x7fe6300b5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.710+0000 7fe636620640 1 --2- 172.21.15.29:0/100626544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6300b4260 0x7fe6300b5630 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe6200097a0 tx=0x7fe62002a080 comp rx=0 tx=0).stop 2024-09-13T18:50:44.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.710+0000 7fe636620640 1 -- 172.21.15.29:0/100626544 shutdown_connections 2024-09-13T18:50:44.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.710+0000 7fe636620640 1 --2- 172.21.15.29:0/100626544 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6300b1ec0 0x7fe6300b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.710+0000 7fe636620640 1 --2- 172.21.15.29:0/100626544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6300b4260 0x7fe6300b5630 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.710+0000 7fe636620640 1 -- 172.21.15.29:0/100626544 >> 172.21.15.29:0/100626544 conn(0x7fe63006a560 msgr2=0x7fe6300b9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:44.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.710+0000 7fe636620640 1 -- 172.21.15.29:0/100626544 shutdown_connections 2024-09-13T18:50:44.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.710+0000 7fe636620640 1 -- 172.21.15.29:0/100626544 wait complete. 2024-09-13T18:50:44.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.711+0000 7fe636620640 1 Processor -- start 2024-09-13T18:50:44.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.712+0000 7fe636620640 1 -- start start 2024-09-13T18:50:44.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.712+0000 7fe636620640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6300b1ec0 0x7fe630139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.712+0000 7fe636620640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6300b4260 0x7fe630138b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.712+0000 7fe636620640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6300b4ed0 0x7fe6300b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.712+0000 7fe636620640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63013a2e0 con 0x7fe6300b4260 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.712+0000 7fe636620640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6301372e0 con 0x7fe6300b1ec0 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.712+0000 7fe636620640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6301375c0 con 0x7fe6300b4ed0 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.712+0000 7fe62f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6300b4260 0x7fe630138b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.712+0000 7fe62f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6300b4260 0x7fe630138b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58234/0 (socket says 172.21.15.29:58234) 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.712+0000 7fe62f7fe640 1 -- 172.21.15.29:0/3531406867 learned_addr learned my addr 172.21.15.29:0/3531406867 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe634bbd640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6300b4ed0 0x7fe6300b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe62ffff640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6300b1ec0 0x7fe630139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe62f7fe640 1 -- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6300b4ed0 msgr2=0x7fe6300b7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe62f7fe640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6300b4ed0 0x7fe6300b7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe62f7fe640 1 -- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6300b1ec0 msgr2=0x7fe630139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe62f7fe640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6300b1ec0 0x7fe630139da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe62f7fe640 1 -- 172.21.15.29:0/3531406867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620009400 con 0x7fe6300b4260 2024-09-13T18:50:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe62f7fe640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6300b4260 0x7fe630138b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe6240011e0 tx=0x7fe62400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe62cff9640 1 -- 172.21.15.29:0/3531406867 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624005ad0 con 0x7fe6300b4260 2024-09-13T18:50:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe62cff9640 1 -- 172.21.15.29:0/3531406867 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe624005c50 con 0x7fe6300b4260 2024-09-13T18:50:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe636620640 1 -- 172.21.15.29:0/3531406867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6301378a0 con 0x7fe6300b4260 2024-09-13T18:50:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe62cff9640 1 -- 172.21.15.29:0/3531406867 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624007070 con 0x7fe6300b4260 2024-09-13T18:50:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.713+0000 7fe636620640 1 -- 172.21.15.29:0/3531406867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe630139050 con 0x7fe6300b4260 2024-09-13T18:50:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.714+0000 7fe636620640 1 -- 172.21.15.29:0/3531406867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe630137dc0 con 0x7fe6300b4260 2024-09-13T18:50:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.715+0000 7fe62cff9640 1 -- 172.21.15.29:0/3531406867 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe6240071d0 con 0x7fe6300b4260 2024-09-13T18:50:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.715+0000 7fe62cff9640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe61c06ac00 0x7fe61c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.715+0000 7fe62cff9640 1 -- 172.21.15.29:0/3531406867 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe624088cc0 con 0x7fe6300b4260 2024-09-13T18:50:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.715+0000 7fe62ffff640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe61c06ac00 0x7fe61c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:44.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.716+0000 7fe62ffff640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe61c06ac00 0x7fe61c06d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe620034000 tx=0x7fe62002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:44.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.719+0000 7fe62cff9640 1 -- 172.21.15.29:0/3531406867 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe630137dc0 con 0x7fe6300b4260 2024-09-13T18:50:44.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.890+0000 7fe636620640 1 -- 172.21.15.29:0/3531406867 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6300b08e0 con 0x7fe61c06ac00 2024-09-13T18:50:44.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.890+0000 7fe62cff9640 1 -- 172.21.15.29:0/3531406867 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe6200326b0 con 0x7fe61c06ac00 2024-09-13T18:50:44.893 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T18:50:44.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.892+0000 7fe636620640 1 -- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe61c06ac00 msgr2=0x7fe61c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.892+0000 7fe636620640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe61c06ac00 0x7fe61c06d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe620034000 tx=0x7fe62002e000 comp rx=0 tx=0).stop 2024-09-13T18:50:44.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.893+0000 7fe636620640 1 -- 172.21.15.29:0/3531406867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6300b4260 msgr2=0x7fe630138b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:44.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.893+0000 7fe636620640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6300b4260 0x7fe630138b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe6240011e0 tx=0x7fe62400cbe0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.893+0000 7fe636620640 1 -- 172.21.15.29:0/3531406867 shutdown_connections 2024-09-13T18:50:44.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.893+0000 7fe636620640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe61c06ac00 0x7fe61c06d0c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.893+0000 7fe636620640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6300b4ed0 0x7fe6300b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.893+0000 7fe636620640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6300b4260 0x7fe630138b10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.893+0000 7fe636620640 1 --2- 172.21.15.29:0/3531406867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6300b1ec0 0x7fe630139da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:44.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.893+0000 7fe636620640 1 -- 172.21.15.29:0/3531406867 >> 172.21.15.29:0/3531406867 conn(0x7fe63006a560 msgr2=0x7fe63013c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:44.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.893+0000 7fe636620640 1 -- 172.21.15.29:0/3531406867 shutdown_connections 2024-09-13T18:50:44.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:44.893+0000 7fe636620640 1 -- 172.21.15.29:0/3531406867 wait complete. 2024-09-13T18:50:44.906 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:50:45.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.004+0000 7fac15133640 1 Processor -- start 2024-09-13T18:50:45.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.004+0000 7fac15133640 1 -- start start 2024-09-13T18:50:45.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.005+0000 7fac15133640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac100b35b0 0x7fac101498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:45.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.005+0000 7fac15133640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fac1013f8e0 0x7fac1013fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:45.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.005+0000 7fac15133640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac10149410 con 0x7fac100b31d0 2024-09-13T18:50:45.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.005+0000 7fac15133640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac10140290 con 0x7fac1013f8e0 2024-09-13T18:50:45.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.005+0000 7fac15133640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac100b4810 con 0x7fac100b35b0 2024-09-13T18:50:45.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.005+0000 7fac0f59e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fac1013f8e0 0x7fac1013fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:45.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.005+0000 7fac0f59e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fac1013f8e0 0x7fac1013fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58240/0 (socket says 172.21.15.29:58240) 2024-09-13T18:50:45.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.005+0000 7fac0f59e640 1 -- 172.21.15.29:0/2885911822 learned_addr learned my addr 172.21.15.29:0/2885911822 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:45.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.005+0000 7fac0e59c640 1 --2- 172.21.15.29:0/2885911822 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac100b35b0 0x7fac101498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:45.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.006+0000 7fac0f59e640 1 -- 172.21.15.29:0/2885911822 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac100b35b0 msgr2=0x7fac101498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:45.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.006+0000 7fac0f59e640 1 --2- 172.21.15.29:0/2885911822 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac100b35b0 0x7fac101498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:45.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.006+0000 7fac0f59e640 1 -- 172.21.15.29:0/2885911822 >> v1:172.21.15.96:6789/0 conn(0x7fac100b31d0 legacy=0x7fac100b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:45.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.006+0000 7fac0f59e640 1 -- 172.21.15.29:0/2885911822 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac101490a0 con 0x7fac1013f8e0 2024-09-13T18:50:45.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.006+0000 7fac0e59c640 1 --2- 172.21.15.29:0/2885911822 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac100b35b0 0x7fac101498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:45.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.006+0000 7fac0f59e640 1 --2- 172.21.15.29:0/2885911822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1013f8e0 0x7fac1013fd50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac08009e50 tx=0x7fac0802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caada9dff4241b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:45.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.006+0000 7fac0dd9b640 1 -- 172.21.15.29:0/2885911822 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0802aea0 con 0x7fac1013f8e0 2024-09-13T18:50:45.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.007+0000 7fac0dd9b640 1 -- 172.21.15.29:0/2885911822 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0802d050 con 0x7fac1013f8e0 2024-09-13T18:50:45.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.007+0000 7fac0dd9b640 1 -- 172.21.15.29:0/2885911822 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08031820 con 0x7fac1013f8e0 2024-09-13T18:50:45.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.007+0000 7fac15133640 1 -- 172.21.15.29:0/2885911822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1013f8e0 msgr2=0x7fac1013fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:45.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.007+0000 7fac15133640 1 --2- 172.21.15.29:0/2885911822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1013f8e0 0x7fac1013fd50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac08009e50 tx=0x7fac0802a680 comp rx=0 tx=0).stop 2024-09-13T18:50:45.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.007+0000 7fac15133640 1 -- 172.21.15.29:0/2885911822 shutdown_connections 2024-09-13T18:50:45.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.007+0000 7fac15133640 1 --2- 172.21.15.29:0/2885911822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac1013f8e0 0x7fac1013fd50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:45.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.007+0000 7fac15133640 1 --2- 172.21.15.29:0/2885911822 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac100b35b0 0x7fac101498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:45.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.007+0000 7fac15133640 1 -- 172.21.15.29:0/2885911822 >> 172.21.15.29:0/2885911822 conn(0x7fac100bb590 msgr2=0x7fac100bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:45.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.007+0000 7fac15133640 1 -- 172.21.15.29:0/2885911822 shutdown_connections 2024-09-13T18:50:45.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.007+0000 7fac15133640 1 -- 172.21.15.29:0/2885911822 wait complete. 2024-09-13T18:50:45.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.008+0000 7fac15133640 1 Processor -- start 2024-09-13T18:50:45.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.008+0000 7fac15133640 1 -- start start 2024-09-13T18:50:45.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac15133640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac100b31d0 0x7fac100a7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:45.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac15133640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac100b35b0 0x7fac101de560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:45.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac15133640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac1013f8e0 0x7fac101deaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:45.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac15133640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac10142b00 con 0x7fac100b35b0 2024-09-13T18:50:45.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac15133640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac100a95e0 con 0x7fac100b31d0 2024-09-13T18:50:45.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac15133640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac100a89a0 con 0x7fac1013f8e0 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac0e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac100b35b0 0x7fac101de560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac0e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac100b35b0 0x7fac101de560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58252/0 (socket says 172.21.15.29:58252) 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac0e59c640 1 -- 172.21.15.29:0/1620674885 learned_addr learned my addr 172.21.15.29:0/1620674885 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac0ed9d640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac100b31d0 0x7fac100a7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac0f59e640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac1013f8e0 0x7fac101deaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac0e59c640 1 -- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac1013f8e0 msgr2=0x7fac101deaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac0e59c640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac1013f8e0 0x7fac101deaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac0e59c640 1 -- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac100b31d0 msgr2=0x7fac100a7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.009+0000 7fac0e59c640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac100b31d0 0x7fac100a7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.010+0000 7fac0e59c640 1 -- 172.21.15.29:0/1620674885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08009b30 con 0x7fac100b35b0 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.010+0000 7fac0e59c640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac100b35b0 0x7fac101de560 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fac0400e810 tx=0x7fac0400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.010+0000 7fabf77fe640 1 -- 172.21.15.29:0/1620674885 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0400c6d0 con 0x7fac100b35b0 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.010+0000 7fabf77fe640 1 -- 172.21.15.29:0/1620674885 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0400c830 con 0x7fac100b35b0 2024-09-13T18:50:45.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.010+0000 7fac15133640 1 -- 172.21.15.29:0/1620674885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac10142720 con 0x7fac100b35b0 2024-09-13T18:50:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.010+0000 7fabf77fe640 1 -- 172.21.15.29:0/1620674885 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0400cbe0 con 0x7fac100b35b0 2024-09-13T18:50:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.010+0000 7fac15133640 1 -- 172.21.15.29:0/1620674885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac101469a0 con 0x7fac100b35b0 2024-09-13T18:50:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.011+0000 7fac15133640 1 -- 172.21.15.29:0/1620674885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac10067300 con 0x7fac100b35b0 2024-09-13T18:50:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.011+0000 7fabf77fe640 1 -- 172.21.15.29:0/1620674885 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac0400cd40 con 0x7fac100b35b0 2024-09-13T18:50:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.012+0000 7fabf77fe640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fabfc06ac00 0x7fabfc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.012+0000 7fabf77fe640 1 -- 172.21.15.29:0/1620674885 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac040893e0 con 0x7fac100b35b0 2024-09-13T18:50:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.012+0000 7fac0ed9d640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fabfc06ac00 0x7fabfc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.012+0000 7fac0ed9d640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fabfc06ac00 0x7fabfc06d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fac00000f60 tx=0x7fac00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:45.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.016+0000 7fabf77fe640 1 -- 172.21.15.29:0/1620674885 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fac04054340 con 0x7fac100b35b0 2024-09-13T18:50:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.182+0000 7fac15133640 1 -- 172.21.15.29:0/1620674885 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac100b5f10 con 0x7fabfc06ac00 2024-09-13T18:50:45.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.191+0000 7fabf77fe640 1 -- 172.21.15.29:0/1620674885 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370598 (secure 0 0 0) 0x7fac000014a0 con 0x7fabfc06ac00 2024-09-13T18:50:45.198 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:50:45.200 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-13T18:50:45.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.195+0000 7fac15133640 1 -- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fabfc06ac00 msgr2=0x7fabfc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:45.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.195+0000 7fac15133640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fabfc06ac00 0x7fabfc06d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fac00000f60 tx=0x7fac00009040 comp rx=0 tx=0).stop 2024-09-13T18:50:45.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.195+0000 7fac15133640 1 -- 172.21.15.29:0/1620674885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac100b35b0 msgr2=0x7fac101de560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:45.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.195+0000 7fac15133640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac100b35b0 0x7fac101de560 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fac0400e810 tx=0x7fac0400ecd0 comp rx=0 tx=0).stop 2024-09-13T18:50:45.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.195+0000 7fac15133640 1 -- 172.21.15.29:0/1620674885 shutdown_connections 2024-09-13T18:50:45.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.195+0000 7fac15133640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fabfc06ac00 0x7fabfc06d0c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:45.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.195+0000 7fac15133640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac1013f8e0 0x7fac101deaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:45.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.195+0000 7fac15133640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac100b35b0 0x7fac101de560 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:45.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.195+0000 7fac15133640 1 --2- 172.21.15.29:0/1620674885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac100b31d0 0x7fac100a7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:45.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.195+0000 7fac15133640 1 -- 172.21.15.29:0/1620674885 >> 172.21.15.29:0/1620674885 conn(0x7fac100bb590 msgr2=0x7fac1013ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:45.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.195+0000 7fac15133640 1 -- 172.21.15.29:0/1620674885 shutdown_connections 2024-09-13T18:50:45.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:50:45.195+0000 7fac15133640 1 -- 172.21.15.29:0/1620674885 wait complete. 2024-09-13T18:50:45.208 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-13T18:50:43.671604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1544628,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":156,"num_read_kb":140,"num_write":437,"num_write_kb":3501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":961,"ondisk_log_size":961,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235616,"kb_used_data":3104,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739104,"statfs":{"total":773094113280,"available":772852842496,"internally_reserved":0,"allocated":3178496,"data_stored":3995022,"data_compressed":310028,"data_compressed_allocated":385024,"data_compressed_original":2588672,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31337,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002857"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.613132+0000","last_change":"2024-09-13T18:45:21.668274+0000","last_active":"2024-09-13T18:47:26.613132+0000","last_peered":"2024-09-13T18:47:26.613132+0000","last_clean":"2024-09-13T18:47:26.613132+0000","last_became_active":"2024-09-13T18:45:21.667985+0000","last_became_peered":"2024-09-13T18:45:21.667985+0000","last_unstale":"2024-09-13T18:47:26.613132+0000","last_undegraded":"2024-09-13T18:47:26.613132+0000","last_fullsized":"2024-09-13T18:47:26.613132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:45.703424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'7","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.710442+0000","last_change":"2024-09-13T18:45:22.034389+0000","last_active":"2024-09-13T18:50:38.710442+0000","last_peered":"2024-09-13T18:50:38.710442+0000","last_clean":"2024-09-13T18:50:38.710442+0000","last_became_active":"2024-09-13T18:45:22.034125+0000","last_became_peered":"2024-09-13T18:45:22.034125+0000","last_unstale":"2024-09-13T18:50:38.710442+0000","last_undegraded":"2024-09-13T18:50:38.710442+0000","last_fullsized":"2024-09-13T18:50:38.710442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617386+0000","last_change":"2024-09-13T18:45:26.253118+0000","last_active":"2024-09-13T18:47:51.617386+0000","last_peered":"2024-09-13T18:47:51.617386+0000","last_clean":"2024-09-13T18:47:51.617386+0000","last_became_active":"2024-09-13T18:45:26.252747+0000","last_became_peered":"2024-09-13T18:45:26.252747+0000","last_unstale":"2024-09-13T18:47:51.617386+0000","last_undegraded":"2024-09-13T18:47:51.617386+0000","last_fullsized":"2024-09-13T18:47:51.617386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:11.065130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.089694+0000","last_change":"2024-09-13T18:45:21.666664+0000","last_active":"2024-09-13T18:47:47.089694+0000","last_peered":"2024-09-13T18:47:47.089694+0000","last_clean":"2024-09-13T18:47:47.089694+0000","last_became_active":"2024-09-13T18:45:21.666398+0000","last_became_peered":"2024-09-13T18:45:21.666398+0000","last_unstale":"2024-09-13T18:47:47.089694+0000","last_undegraded":"2024-09-13T18:47:47.089694+0000","last_fullsized":"2024-09-13T18:47:47.089694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:06.210838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720276+0000","last_change":"2024-09-13T18:45:22.024774+0000","last_active":"2024-09-13T18:50:38.720276+0000","last_peered":"2024-09-13T18:50:38.720276+0000","last_clean":"2024-09-13T18:50:38.720276+0000","last_became_active":"2024-09-13T18:45:22.024424+0000","last_became_peered":"2024-09-13T18:45:22.024424+0000","last_unstale":"2024-09-13T18:50:38.720276+0000","last_undegraded":"2024-09-13T18:50:38.720276+0000","last_fullsized":"2024-09-13T18:50:38.720276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616742+0000","last_change":"2024-09-13T18:45:26.050411+0000","last_active":"2024-09-13T18:47:51.616742+0000","last_peered":"2024-09-13T18:47:51.616742+0000","last_clean":"2024-09-13T18:47:51.616742+0000","last_became_active":"2024-09-13T18:45:26.049414+0000","last_became_peered":"2024-09-13T18:45:26.049414+0000","last_unstale":"2024-09-13T18:47:51.616742+0000","last_undegraded":"2024-09-13T18:47:51.616742+0000","last_fullsized":"2024-09-13T18:47:51.616742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616880+0000","last_change":"2024-09-13T18:45:21.667928+0000","last_active":"2024-09-13T18:47:51.616880+0000","last_peered":"2024-09-13T18:47:51.616880+0000","last_clean":"2024-09-13T18:47:51.616880+0000","last_became_active":"2024-09-13T18:45:21.667602+0000","last_became_peered":"2024-09-13T18:45:21.667602+0000","last_unstale":"2024-09-13T18:47:51.616880+0000","last_undegraded":"2024-09-13T18:47:51.616880+0000","last_fullsized":"2024-09-13T18:47:51.616880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:53.936326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720942+0000","last_change":"2024-09-13T18:45:22.036952+0000","last_active":"2024-09-13T18:50:38.720942+0000","last_peered":"2024-09-13T18:50:38.720942+0000","last_clean":"2024-09-13T18:50:38.720942+0000","last_became_active":"2024-09-13T18:45:22.035790+0000","last_became_peered":"2024-09-13T18:45:22.035790+0000","last_unstale":"2024-09-13T18:50:38.720942+0000","last_undegraded":"2024-09-13T18:50:38.720942+0000","last_fullsized":"2024-09-13T18:50:38.720942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617541+0000","last_change":"2024-09-13T18:45:26.052333+0000","last_active":"2024-09-13T18:47:56.617541+0000","last_peered":"2024-09-13T18:47:56.617541+0000","last_clean":"2024-09-13T18:47:56.617541+0000","last_became_active":"2024-09-13T18:45:26.051873+0000","last_became_peered":"2024-09-13T18:45:26.051873+0000","last_unstale":"2024-09-13T18:47:56.617541+0000","last_undegraded":"2024-09-13T18:47:56.617541+0000","last_fullsized":"2024-09-13T18:47:56.617541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:03.925946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:37.145855+0000","last_change":"2024-09-13T18:45:21.669914+0000","last_active":"2024-09-13T18:49:37.145855+0000","last_peered":"2024-09-13T18:49:37.145855+0000","last_clean":"2024-09-13T18:49:37.145855+0000","last_became_active":"2024-09-13T18:45:21.669622+0000","last_became_peered":"2024-09-13T18:45:21.669622+0000","last_unstale":"2024-09-13T18:49:37.145855+0000","last_undegraded":"2024-09-13T18:49:37.145855+0000","last_fullsized":"2024-09-13T18:49:37.145855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.765670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'14","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720143+0000","last_change":"2024-09-13T18:45:22.035675+0000","last_active":"2024-09-13T18:50:38.720143+0000","last_peered":"2024-09-13T18:50:38.720143+0000","last_clean":"2024-09-13T18:50:38.720143+0000","last_became_active":"2024-09-13T18:45:22.034431+0000","last_became_peered":"2024-09-13T18:45:22.034431+0000","last_unstale":"2024-09-13T18:50:38.720143+0000","last_undegraded":"2024-09-13T18:50:38.720143+0000","last_fullsized":"2024-09-13T18:50:38.720143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617499+0000","last_change":"2024-09-13T18:45:26.052892+0000","last_active":"2024-09-13T18:47:56.617499+0000","last_peered":"2024-09-13T18:47:56.617499+0000","last_clean":"2024-09-13T18:47:56.617499+0000","last_became_active":"2024-09-13T18:45:26.052441+0000","last_became_peered":"2024-09-13T18:45:26.052441+0000","last_unstale":"2024-09-13T18:47:56.617499+0000","last_undegraded":"2024-09-13T18:47:56.617499+0000","last_fullsized":"2024-09-13T18:47:56.617499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:26.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'7","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.704757+0000","last_change":"2024-09-13T18:45:22.017741+0000","last_active":"2024-09-13T18:50:38.704757+0000","last_peered":"2024-09-13T18:50:38.704757+0000","last_clean":"2024-09-13T18:50:38.704757+0000","last_became_active":"2024-09-13T18:45:22.015758+0000","last_became_peered":"2024-09-13T18:45:22.015758+0000","last_unstale":"2024-09-13T18:50:38.704757+0000","last_undegraded":"2024-09-13T18:50:38.704757+0000","last_fullsized":"2024-09-13T18:50:38.704757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.103891+0000","last_change":"2024-09-13T18:45:21.672627+0000","last_active":"2024-09-13T18:48:12.103891+0000","last_peered":"2024-09-13T18:48:12.103891+0000","last_clean":"2024-09-13T18:48:12.103891+0000","last_became_active":"2024-09-13T18:45:21.672388+0000","last_became_peered":"2024-09-13T18:45:21.672388+0000","last_unstale":"2024-09-13T18:48:12.103891+0000","last_undegraded":"2024-09-13T18:48:12.103891+0000","last_fullsized":"2024-09-13T18:48:12.103891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615702+0000","last_change":"2024-09-13T18:46:11.150163+0000","last_active":"2024-09-13T18:47:41.615702+0000","last_peered":"2024-09-13T18:47:41.615702+0000","last_clean":"2024-09-13T18:47:41.615702+0000","last_became_active":"2024-09-13T18:46:11.149623+0000","last_became_peered":"2024-09-13T18:46:11.149623+0000","last_unstale":"2024-09-13T18:47:41.615702+0000","last_undegraded":"2024-09-13T18:47:41.615702+0000","last_fullsized":"2024-09-13T18:47:41.615702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:18.721386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'9","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.714806+0000","last_change":"2024-09-13T18:45:22.028858+0000","last_active":"2024-09-13T18:50:38.714806+0000","last_peered":"2024-09-13T18:50:38.714806+0000","last_clean":"2024-09-13T18:50:38.714806+0000","last_became_active":"2024-09-13T18:45:22.028336+0000","last_became_peered":"2024-09-13T18:45:22.028336+0000","last_unstale":"2024-09-13T18:50:38.714806+0000","last_undegraded":"2024-09-13T18:50:38.714806+0000","last_fullsized":"2024-09-13T18:50:38.714806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.618669+0000","last_change":"2024-09-13T18:45:21.667983+0000","last_active":"2024-09-13T18:47:31.618669+0000","last_peered":"2024-09-13T18:47:31.618669+0000","last_clean":"2024-09-13T18:47:31.618669+0000","last_became_active":"2024-09-13T18:45:21.667625+0000","last_became_peered":"2024-09-13T18:45:21.667625+0000","last_unstale":"2024-09-13T18:47:31.618669+0000","last_undegraded":"2024-09-13T18:47:31.618669+0000","last_fullsized":"2024-09-13T18:47:31.618669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615662+0000","last_change":"2024-09-13T18:45:26.050576+0000","last_active":"2024-09-13T18:47:41.615662+0000","last_peered":"2024-09-13T18:47:41.615662+0000","last_clean":"2024-09-13T18:47:41.615662+0000","last_became_active":"2024-09-13T18:45:26.049129+0000","last_became_peered":"2024-09-13T18:45:26.049129+0000","last_unstale":"2024-09-13T18:47:41.615662+0000","last_undegraded":"2024-09-13T18:47:41.615662+0000","last_fullsized":"2024-09-13T18:47:41.615662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'6","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.710351+0000","last_change":"2024-09-13T18:46:11.149400+0000","last_active":"2024-09-13T18:50:38.710351+0000","last_peered":"2024-09-13T18:50:38.710351+0000","last_clean":"2024-09-13T18:50:38.710351+0000","last_became_active":"2024-09-13T18:46:11.149036+0000","last_became_peered":"2024-09-13T18:46:11.149036+0000","last_unstale":"2024-09-13T18:50:38.710351+0000","last_undegraded":"2024-09-13T18:50:38.710351+0000","last_fullsized":"2024-09-13T18:50:38.710351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:06.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.104292+0000","last_change":"2024-09-13T18:45:21.668525+0000","last_active":"2024-09-13T18:48:12.104292+0000","last_peered":"2024-09-13T18:48:12.104292+0000","last_clean":"2024-09-13T18:48:12.104292+0000","last_became_active":"2024-09-13T18:45:21.668242+0000","last_became_peered":"2024-09-13T18:45:21.668242+0000","last_unstale":"2024-09-13T18:48:12.104292+0000","last_undegraded":"2024-09-13T18:48:12.104292+0000","last_fullsized":"2024-09-13T18:48:12.104292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.620048+0000","last_change":"2024-09-13T18:45:26.255263+0000","last_active":"2024-09-13T18:47:41.620048+0000","last_peered":"2024-09-13T18:47:41.620048+0000","last_clean":"2024-09-13T18:47:41.620048+0000","last_became_active":"2024-09-13T18:45:26.254886+0000","last_became_peered":"2024-09-13T18:45:26.254886+0000","last_unstale":"2024-09-13T18:47:41.620048+0000","last_undegraded":"2024-09-13T18:47:41.620048+0000","last_fullsized":"2024-09-13T18:47:41.620048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.696603+0000","last_change":"2024-09-13T18:45:22.029624+0000","last_active":"2024-09-13T18:50:38.696603+0000","last_peered":"2024-09-13T18:50:38.696603+0000","last_clean":"2024-09-13T18:50:38.696603+0000","last_became_active":"2024-09-13T18:45:22.027835+0000","last_became_peered":"2024-09-13T18:45:22.027835+0000","last_unstale":"2024-09-13T18:50:38.696603+0000","last_undegraded":"2024-09-13T18:50:38.696603+0000","last_fullsized":"2024-09-13T18:50:38.696603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:16.317986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.107659+0000","last_change":"2024-09-13T18:45:21.669073+0000","last_active":"2024-09-13T18:48:17.107659+0000","last_peered":"2024-09-13T18:48:17.107659+0000","last_clean":"2024-09-13T18:48:17.107659+0000","last_became_active":"2024-09-13T18:45:21.668765+0000","last_became_peered":"2024-09-13T18:45:21.668765+0000","last_unstale":"2024-09-13T18:48:17.107659+0000","last_undegraded":"2024-09-13T18:48:17.107659+0000","last_fullsized":"2024-09-13T18:48:17.107659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615720+0000","last_change":"2024-09-13T18:45:26.050623+0000","last_active":"2024-09-13T18:47:41.615720+0000","last_peered":"2024-09-13T18:47:41.615720+0000","last_clean":"2024-09-13T18:47:41.615720+0000","last_became_active":"2024-09-13T18:45:26.049408+0000","last_became_peered":"2024-09-13T18:45:26.049408+0000","last_unstale":"2024-09-13T18:47:41.615720+0000","last_undegraded":"2024-09-13T18:47:41.615720+0000","last_fullsized":"2024-09-13T18:47:41.615720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:14.574386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'5","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.712620+0000","last_change":"2024-09-13T18:45:22.022220+0000","last_active":"2024-09-13T18:50:38.712620+0000","last_peered":"2024-09-13T18:50:38.712620+0000","last_clean":"2024-09-13T18:50:38.712620+0000","last_became_active":"2024-09-13T18:45:22.021976+0000","last_became_peered":"2024-09-13T18:45:22.021976+0000","last_unstale":"2024-09-13T18:50:38.712620+0000","last_undegraded":"2024-09-13T18:50:38.712620+0000","last_fullsized":"2024-09-13T18:50:38.712620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:32.113775+0000","last_change":"2024-09-13T18:45:21.667931+0000","last_active":"2024-09-13T18:48:32.113775+0000","last_peered":"2024-09-13T18:48:32.113775+0000","last_clean":"2024-09-13T18:48:32.113775+0000","last_became_active":"2024-09-13T18:45:21.667680+0000","last_became_peered":"2024-09-13T18:45:21.667680+0000","last_unstale":"2024-09-13T18:48:32.113775+0000","last_undegraded":"2024-09-13T18:48:32.113775+0000","last_fullsized":"2024-09-13T18:48:32.113775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.614135+0000","last_change":"2024-09-13T18:45:26.255088+0000","last_active":"2024-09-13T18:47:31.614135+0000","last_peered":"2024-09-13T18:47:31.614135+0000","last_clean":"2024-09-13T18:47:31.614135+0000","last_became_active":"2024-09-13T18:45:26.254662+0000","last_became_peered":"2024-09-13T18:45:26.254662+0000","last_unstale":"2024-09-13T18:47:31.614135+0000","last_undegraded":"2024-09-13T18:47:31.614135+0000","last_fullsized":"2024-09-13T18:47:31.614135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:22.924167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'6","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.717482+0000","last_change":"2024-09-13T18:45:22.026678+0000","last_active":"2024-09-13T18:50:38.717482+0000","last_peered":"2024-09-13T18:50:38.717482+0000","last_clean":"2024-09-13T18:50:38.717482+0000","last_became_active":"2024-09-13T18:45:22.026419+0000","last_became_peered":"2024-09-13T18:45:22.026419+0000","last_unstale":"2024-09-13T18:50:38.717482+0000","last_undegraded":"2024-09-13T18:50:38.717482+0000","last_fullsized":"2024-09-13T18:50:38.717482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'37","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:36.174015+0000","last_change":"2024-09-13T18:45:21.664622+0000","last_active":"2024-09-13T18:50:36.174015+0000","last_peered":"2024-09-13T18:50:36.174015+0000","last_clean":"2024-09-13T18:50:36.174015+0000","last_became_active":"2024-09-13T18:45:21.664066+0000","last_became_peered":"2024-09-13T18:45:21.664066+0000","last_unstale":"2024-09-13T18:50:36.174015+0000","last_undegraded":"2024-09-13T18:50:36.174015+0000","last_fullsized":"2024-09-13T18:50:36.174015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.614068+0000","last_change":"2024-09-13T18:45:26.253888+0000","last_active":"2024-09-13T18:47:26.614068+0000","last_peered":"2024-09-13T18:47:26.614068+0000","last_clean":"2024-09-13T18:47:26.614068+0000","last_became_active":"2024-09-13T18:45:26.253488+0000","last_became_peered":"2024-09-13T18:45:26.253488+0000","last_unstale":"2024-09-13T18:47:26.614068+0000","last_undegraded":"2024-09-13T18:47:26.614068+0000","last_fullsized":"2024-09-13T18:47:26.614068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:44.826493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'11","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.710022+0000","last_change":"2024-09-13T18:45:22.022940+0000","last_active":"2024-09-13T18:50:38.710022+0000","last_peered":"2024-09-13T18:50:38.710022+0000","last_clean":"2024-09-13T18:50:38.710022+0000","last_became_active":"2024-09-13T18:45:22.022628+0000","last_became_peered":"2024-09-13T18:45:22.022628+0000","last_unstale":"2024-09-13T18:50:38.710022+0000","last_undegraded":"2024-09-13T18:50:38.710022+0000","last_fullsized":"2024-09-13T18:50:38.710022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.085981+0000","last_change":"2024-09-13T18:45:21.668903+0000","last_active":"2024-09-13T18:47:42.085981+0000","last_peered":"2024-09-13T18:47:42.085981+0000","last_clean":"2024-09-13T18:47:42.085981+0000","last_became_active":"2024-09-13T18:45:21.668645+0000","last_became_peered":"2024-09-13T18:45:21.668645+0000","last_unstale":"2024-09-13T18:47:42.085981+0000","last_undegraded":"2024-09-13T18:47:42.085981+0000","last_fullsized":"2024-09-13T18:47:42.085981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:33.143804+0000","last_change":"2024-09-13T18:46:11.658745+0000","last_active":"2024-09-13T18:49:33.143804+0000","last_peered":"2024-09-13T18:49:33.143804+0000","last_clean":"2024-09-13T18:49:33.143804+0000","last_became_active":"2024-09-13T18:46:11.658190+0000","last_became_peered":"2024-09-13T18:46:11.658190+0000","last_unstale":"2024-09-13T18:49:33.143804+0000","last_undegraded":"2024-09-13T18:49:33.143804+0000","last_fullsized":"2024-09-13T18:49:33.143804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:44.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'6","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.701722+0000","last_change":"2024-09-13T18:46:11.145972+0000","last_active":"2024-09-13T18:50:38.701722+0000","last_peered":"2024-09-13T18:50:38.701722+0000","last_clean":"2024-09-13T18:50:38.701722+0000","last_became_active":"2024-09-13T18:46:11.145524+0000","last_became_peered":"2024-09-13T18:46:11.145524+0000","last_unstale":"2024-09-13T18:50:38.701722+0000","last_undegraded":"2024-09-13T18:50:38.701722+0000","last_fullsized":"2024-09-13T18:50:38.701722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:45.878704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.617963+0000","last_change":"2024-09-13T18:45:21.661117+0000","last_active":"2024-09-13T18:47:26.617963+0000","last_peered":"2024-09-13T18:47:26.617963+0000","last_clean":"2024-09-13T18:47:26.617963+0000","last_became_active":"2024-09-13T18:45:21.660577+0000","last_became_peered":"2024-09-13T18:45:21.660577+0000","last_unstale":"2024-09-13T18:47:26.617963+0000","last_undegraded":"2024-09-13T18:47:26.617963+0000","last_fullsized":"2024-09-13T18:47:26.617963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.618646+0000","last_change":"2024-09-13T18:45:26.056021+0000","last_active":"2024-09-13T18:47:31.618646+0000","last_peered":"2024-09-13T18:47:31.618646+0000","last_clean":"2024-09-13T18:47:31.618646+0000","last_became_active":"2024-09-13T18:45:26.053877+0000","last_became_peered":"2024-09-13T18:45:26.053877+0000","last_unstale":"2024-09-13T18:47:31.618646+0000","last_undegraded":"2024-09-13T18:47:31.618646+0000","last_fullsized":"2024-09-13T18:47:31.618646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:51.489422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.696469+0000","last_change":"2024-09-13T18:45:22.029936+0000","last_active":"2024-09-13T18:50:38.696469+0000","last_peered":"2024-09-13T18:50:38.696469+0000","last_clean":"2024-09-13T18:50:38.696469+0000","last_became_active":"2024-09-13T18:45:22.028714+0000","last_became_peered":"2024-09-13T18:45:22.028714+0000","last_unstale":"2024-09-13T18:50:38.696469+0000","last_undegraded":"2024-09-13T18:50:38.696469+0000","last_fullsized":"2024-09-13T18:50:38.696469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:35.746368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:52.092714+0000","last_change":"2024-09-13T18:45:21.667926+0000","last_active":"2024-09-13T18:47:52.092714+0000","last_peered":"2024-09-13T18:47:52.092714+0000","last_clean":"2024-09-13T18:47:52.092714+0000","last_became_active":"2024-09-13T18:45:21.667320+0000","last_became_peered":"2024-09-13T18:45:21.667320+0000","last_unstale":"2024-09-13T18:47:52.092714+0000","last_undegraded":"2024-09-13T18:47:52.092714+0000","last_fullsized":"2024-09-13T18:47:52.092714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:33.926106+0000","last_change":"2024-09-13T18:46:11.148369+0000","last_active":"2024-09-13T18:50:33.926106+0000","last_peered":"2024-09-13T18:50:33.926106+0000","last_clean":"2024-09-13T18:50:33.926106+0000","last_became_active":"2024-09-13T18:46:11.147801+0000","last_became_peered":"2024-09-13T18:46:11.147801+0000","last_unstale":"2024-09-13T18:50:33.926106+0000","last_undegraded":"2024-09-13T18:50:33.926106+0000","last_fullsized":"2024-09-13T18:50:33.926106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:54.923780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.709131+0000","last_change":"2024-09-13T18:45:22.023623+0000","last_active":"2024-09-13T18:50:38.709131+0000","last_peered":"2024-09-13T18:50:38.709131+0000","last_clean":"2024-09-13T18:50:38.709131+0000","last_became_active":"2024-09-13T18:45:22.023357+0000","last_became_peered":"2024-09-13T18:45:22.023357+0000","last_unstale":"2024-09-13T18:50:38.709131+0000","last_undegraded":"2024-09-13T18:50:38.709131+0000","last_fullsized":"2024-09-13T18:50:38.709131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:16.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'46","reported_seq":104,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:37.172494+0000","last_change":"2024-09-13T18:45:21.668065+0000","last_active":"2024-09-13T18:50:37.172494+0000","last_peered":"2024-09-13T18:50:37.172494+0000","last_clean":"2024-09-13T18:50:37.172494+0000","last_became_active":"2024-09-13T18:45:21.667768+0000","last_became_peered":"2024-09-13T18:45:21.667768+0000","last_unstale":"2024-09-13T18:50:37.172494+0000","last_undegraded":"2024-09-13T18:50:37.172494+0000","last_fullsized":"2024-09-13T18:50:37.172494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":40,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.619282+0000","last_change":"2024-09-13T18:45:26.057274+0000","last_active":"2024-09-13T18:47:36.619282+0000","last_peered":"2024-09-13T18:47:36.619282+0000","last_clean":"2024-09-13T18:47:36.619282+0000","last_became_active":"2024-09-13T18:45:26.056850+0000","last_became_peered":"2024-09-13T18:45:26.056850+0000","last_unstale":"2024-09-13T18:47:36.619282+0000","last_undegraded":"2024-09-13T18:47:36.619282+0000","last_fullsized":"2024-09-13T18:47:36.619282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.971516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'5","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720952+0000","last_change":"2024-09-13T18:45:22.020577+0000","last_active":"2024-09-13T18:50:38.720952+0000","last_peered":"2024-09-13T18:50:38.720952+0000","last_clean":"2024-09-13T18:50:38.720952+0000","last_became_active":"2024-09-13T18:45:22.020317+0000","last_became_peered":"2024-09-13T18:45:22.020317+0000","last_unstale":"2024-09-13T18:50:38.720952+0000","last_undegraded":"2024-09-13T18:50:38.720952+0000","last_fullsized":"2024-09-13T18:50:38.720952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112381+0000","last_change":"2024-09-13T18:45:21.667753+0000","last_active":"2024-09-13T18:48:27.112381+0000","last_peered":"2024-09-13T18:48:27.112381+0000","last_clean":"2024-09-13T18:48:27.112381+0000","last_became_active":"2024-09-13T18:45:21.667483+0000","last_became_peered":"2024-09-13T18:45:21.667483+0000","last_unstale":"2024-09-13T18:48:27.112381+0000","last_undegraded":"2024-09-13T18:48:27.112381+0000","last_fullsized":"2024-09-13T18:48:27.112381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:22.171336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614460+0000","last_change":"2024-09-13T18:45:26.254703+0000","last_active":"2024-09-13T18:47:36.614460+0000","last_peered":"2024-09-13T18:47:36.614460+0000","last_clean":"2024-09-13T18:47:36.614460+0000","last_became_active":"2024-09-13T18:45:26.253533+0000","last_became_peered":"2024-09-13T18:45:26.253533+0000","last_unstale":"2024-09-13T18:47:36.614460+0000","last_undegraded":"2024-09-13T18:47:36.614460+0000","last_fullsized":"2024-09-13T18:47:36.614460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.719324+0000","last_change":"2024-09-13T18:45:22.032365+0000","last_active":"2024-09-13T18:50:38.719324+0000","last_peered":"2024-09-13T18:50:38.719324+0000","last_clean":"2024-09-13T18:50:38.719324+0000","last_became_active":"2024-09-13T18:45:22.032109+0000","last_became_peered":"2024-09-13T18:45:22.032109+0000","last_unstale":"2024-09-13T18:50:38.719324+0000","last_undegraded":"2024-09-13T18:50:38.719324+0000","last_fullsized":"2024-09-13T18:50:38.719324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.110221+0000","last_change":"2024-09-13T18:45:21.662636+0000","last_active":"2024-09-13T18:48:22.110221+0000","last_peered":"2024-09-13T18:48:22.110221+0000","last_clean":"2024-09-13T18:48:22.110221+0000","last_became_active":"2024-09-13T18:45:21.662344+0000","last_became_peered":"2024-09-13T18:45:21.662344+0000","last_unstale":"2024-09-13T18:48:22.110221+0000","last_undegraded":"2024-09-13T18:48:22.110221+0000","last_fullsized":"2024-09-13T18:48:22.110221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.742069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:21.613035+0000","last_change":"2024-09-13T18:45:19.778048+0000","last_active":"2024-09-13T18:47:21.613035+0000","last_peered":"2024-09-13T18:47:21.613035+0000","last_clean":"2024-09-13T18:47:21.613035+0000","last_became_active":"2024-09-13T18:45:19.777172+0000","last_became_peered":"2024-09-13T18:45:19.777172+0000","last_unstale":"2024-09-13T18:47:21.613035+0000","last_undegraded":"2024-09-13T18:47:21.613035+0000","last_fullsized":"2024-09-13T18:47:21.613035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:17.981407+0000","last_clean_scrub_stamp":"2024-09-13T18:45:17.981407+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:51.905955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615939+0000","last_change":"2024-09-13T18:45:26.253260+0000","last_active":"2024-09-13T18:47:31.615939+0000","last_peered":"2024-09-13T18:47:31.615939+0000","last_clean":"2024-09-13T18:47:31.615939+0000","last_became_active":"2024-09-13T18:45:26.252890+0000","last_became_peered":"2024-09-13T18:45:26.252890+0000","last_unstale":"2024-09-13T18:47:31.615939+0000","last_undegraded":"2024-09-13T18:47:31.615939+0000","last_fullsized":"2024-09-13T18:47:31.615939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'5","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.717801+0000","last_change":"2024-09-13T18:45:22.036446+0000","last_active":"2024-09-13T18:50:38.717801+0000","last_peered":"2024-09-13T18:50:38.717801+0000","last_clean":"2024-09-13T18:50:38.717801+0000","last_became_active":"2024-09-13T18:45:22.036153+0000","last_became_peered":"2024-09-13T18:45:22.036153+0000","last_unstale":"2024-09-13T18:50:38.717801+0000","last_undegraded":"2024-09-13T18:50:38.717801+0000","last_fullsized":"2024-09-13T18:50:38.717801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:51.629396+0000","last_change":"2024-09-13T18:45:21.665847+0000","last_active":"2024-09-13T18:49:51.629396+0000","last_peered":"2024-09-13T18:49:51.629396+0000","last_clean":"2024-09-13T18:49:51.629396+0000","last_became_active":"2024-09-13T18:45:21.665582+0000","last_became_peered":"2024-09-13T18:45:21.665582+0000","last_unstale":"2024-09-13T18:49:51.629396+0000","last_undegraded":"2024-09-13T18:49:51.629396+0000","last_fullsized":"2024-09-13T18:49:51.629396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.616410+0000","last_change":"2024-09-13T18:45:26.250391+0000","last_active":"2024-09-13T18:47:36.616410+0000","last_peered":"2024-09-13T18:47:36.616410+0000","last_clean":"2024-09-13T18:47:36.616410+0000","last_became_active":"2024-09-13T18:45:26.249986+0000","last_became_peered":"2024-09-13T18:45:26.249986+0000","last_unstale":"2024-09-13T18:47:36.616410+0000","last_undegraded":"2024-09-13T18:47:36.616410+0000","last_fullsized":"2024-09-13T18:47:36.616410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:04.081305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'7","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.718230+0000","last_change":"2024-09-13T18:45:22.037142+0000","last_active":"2024-09-13T18:50:38.718230+0000","last_peered":"2024-09-13T18:50:38.718230+0000","last_clean":"2024-09-13T18:50:38.718230+0000","last_became_active":"2024-09-13T18:45:22.036523+0000","last_became_peered":"2024-09-13T18:45:22.036523+0000","last_unstale":"2024-09-13T18:50:38.718230+0000","last_undegraded":"2024-09-13T18:50:38.718230+0000","last_fullsized":"2024-09-13T18:50:38.718230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.109845+0000","last_change":"2024-09-13T18:45:21.662924+0000","last_active":"2024-09-13T18:48:22.109845+0000","last_peered":"2024-09-13T18:48:22.109845+0000","last_clean":"2024-09-13T18:48:22.109845+0000","last_became_active":"2024-09-13T18:45:21.662405+0000","last_became_peered":"2024-09-13T18:45:21.662405+0000","last_unstale":"2024-09-13T18:48:22.109845+0000","last_undegraded":"2024-09-13T18:48:22.109845+0000","last_fullsized":"2024-09-13T18:48:22.109845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615002+0000","last_change":"2024-09-13T18:45:26.055309+0000","last_active":"2024-09-13T18:47:41.615002+0000","last_peered":"2024-09-13T18:47:41.615002+0000","last_clean":"2024-09-13T18:47:41.615002+0000","last_became_active":"2024-09-13T18:45:26.054449+0000","last_became_peered":"2024-09-13T18:45:26.054449+0000","last_unstale":"2024-09-13T18:47:41.615002+0000","last_undegraded":"2024-09-13T18:47:41.615002+0000","last_fullsized":"2024-09-13T18:47:41.615002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:18.188235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'9","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.707258+0000","last_change":"2024-09-13T18:46:11.150958+0000","last_active":"2024-09-13T18:50:38.707258+0000","last_peered":"2024-09-13T18:50:38.707258+0000","last_clean":"2024-09-13T18:50:38.707258+0000","last_became_active":"2024-09-13T18:46:11.150605+0000","last_became_peered":"2024-09-13T18:46:11.150605+0000","last_unstale":"2024-09-13T18:50:38.707258+0000","last_undegraded":"2024-09-13T18:50:38.707258+0000","last_fullsized":"2024-09-13T18:50:38.707258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:51.536838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.107379+0000","last_change":"2024-09-13T18:45:21.667622+0000","last_active":"2024-09-13T18:48:17.107379+0000","last_peered":"2024-09-13T18:48:17.107379+0000","last_clean":"2024-09-13T18:48:17.107379+0000","last_became_active":"2024-09-13T18:45:21.667340+0000","last_became_peered":"2024-09-13T18:45:21.667340+0000","last_unstale":"2024-09-13T18:48:17.107379+0000","last_undegraded":"2024-09-13T18:48:17.107379+0000","last_fullsized":"2024-09-13T18:48:17.107379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:04.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.615280+0000","last_change":"2024-09-13T18:45:26.250450+0000","last_active":"2024-09-13T18:47:36.615280+0000","last_peered":"2024-09-13T18:47:36.615280+0000","last_clean":"2024-09-13T18:47:36.615280+0000","last_became_active":"2024-09-13T18:45:26.250020+0000","last_became_peered":"2024-09-13T18:45:26.250020+0000","last_unstale":"2024-09-13T18:47:36.615280+0000","last_undegraded":"2024-09-13T18:47:36.615280+0000","last_fullsized":"2024-09-13T18:47:36.615280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:46.567482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'6","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.723111+0000","last_change":"2024-09-13T18:45:22.030584+0000","last_active":"2024-09-13T18:50:38.723111+0000","last_peered":"2024-09-13T18:50:38.723111+0000","last_clean":"2024-09-13T18:50:38.723111+0000","last_became_active":"2024-09-13T18:45:22.030275+0000","last_became_peered":"2024-09-13T18:45:22.030275+0000","last_unstale":"2024-09-13T18:50:38.723111+0000","last_undegraded":"2024-09-13T18:50:38.723111+0000","last_fullsized":"2024-09-13T18:50:38.723111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112091+0000","last_change":"2024-09-13T18:45:21.662490+0000","last_active":"2024-09-13T18:48:27.112091+0000","last_peered":"2024-09-13T18:48:27.112091+0000","last_clean":"2024-09-13T18:48:27.112091+0000","last_became_active":"2024-09-13T18:45:21.662210+0000","last_became_peered":"2024-09-13T18:45:21.662210+0000","last_unstale":"2024-09-13T18:48:27.112091+0000","last_undegraded":"2024-09-13T18:48:27.112091+0000","last_fullsized":"2024-09-13T18:48:27.112091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.614925+0000","last_change":"2024-09-13T18:45:26.053575+0000","last_active":"2024-09-13T18:47:36.614925+0000","last_peered":"2024-09-13T18:47:36.614925+0000","last_clean":"2024-09-13T18:47:36.614925+0000","last_became_active":"2024-09-13T18:45:26.053195+0000","last_became_peered":"2024-09-13T18:45:26.053195+0000","last_unstale":"2024-09-13T18:47:36.614925+0000","last_undegraded":"2024-09-13T18:47:36.614925+0000","last_fullsized":"2024-09-13T18:47:36.614925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:28.745002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'7","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.723089+0000","last_change":"2024-09-13T18:45:22.031817+0000","last_active":"2024-09-13T18:50:38.723089+0000","last_peered":"2024-09-13T18:50:38.723089+0000","last_clean":"2024-09-13T18:50:38.723089+0000","last_became_active":"2024-09-13T18:45:22.031312+0000","last_became_peered":"2024-09-13T18:45:22.031312+0000","last_unstale":"2024-09-13T18:50:38.723089+0000","last_undegraded":"2024-09-13T18:50:38.723089+0000","last_fullsized":"2024-09-13T18:50:38.723089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'12","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:01.630247+0000","last_change":"2024-09-13T18:45:21.655353+0000","last_active":"2024-09-13T18:50:01.630247+0000","last_peered":"2024-09-13T18:50:01.630247+0000","last_clean":"2024-09-13T18:50:01.630247+0000","last_became_active":"2024-09-13T18:45:21.654844+0000","last_became_peered":"2024-09-13T18:45:21.654844+0000","last_unstale":"2024-09-13T18:50:01.630247+0000","last_undegraded":"2024-09-13T18:50:01.630247+0000","last_fullsized":"2024-09-13T18:50:01.630247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.616249+0000","last_change":"2024-09-13T18:45:26.056440+0000","last_active":"2024-09-13T18:47:51.616249+0000","last_peered":"2024-09-13T18:47:51.616249+0000","last_clean":"2024-09-13T18:47:51.616249+0000","last_became_active":"2024-09-13T18:45:26.055955+0000","last_became_peered":"2024-09-13T18:45:26.055955+0000","last_unstale":"2024-09-13T18:47:51.616249+0000","last_undegraded":"2024-09-13T18:47:51.616249+0000","last_fullsized":"2024-09-13T18:47:51.616249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:38.309349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'9","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.715437+0000","last_change":"2024-09-13T18:45:22.027821+0000","last_active":"2024-09-13T18:50:38.715437+0000","last_peered":"2024-09-13T18:50:38.715437+0000","last_clean":"2024-09-13T18:50:38.715437+0000","last_became_active":"2024-09-13T18:45:22.027172+0000","last_became_peered":"2024-09-13T18:45:22.027172+0000","last_unstale":"2024-09-13T18:50:38.715437+0000","last_undegraded":"2024-09-13T18:50:38.715437+0000","last_fullsized":"2024-09-13T18:50:38.715437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.107256+0000","last_change":"2024-09-13T18:45:21.664084+0000","last_active":"2024-09-13T18:48:17.107256+0000","last_peered":"2024-09-13T18:48:17.107256+0000","last_clean":"2024-09-13T18:48:17.107256+0000","last_became_active":"2024-09-13T18:45:21.663746+0000","last_became_peered":"2024-09-13T18:45:21.663746+0000","last_unstale":"2024-09-13T18:48:17.107256+0000","last_undegraded":"2024-09-13T18:48:17.107256+0000","last_fullsized":"2024-09-13T18:48:17.107256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617500+0000","last_change":"2024-09-13T18:45:26.253221+0000","last_active":"2024-09-13T18:47:51.617500+0000","last_peered":"2024-09-13T18:47:51.617500+0000","last_clean":"2024-09-13T18:47:51.617500+0000","last_became_active":"2024-09-13T18:45:26.252841+0000","last_became_peered":"2024-09-13T18:45:26.252841+0000","last_unstale":"2024-09-13T18:47:51.617500+0000","last_undegraded":"2024-09-13T18:47:51.617500+0000","last_fullsized":"2024-09-13T18:47:51.617500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:26.396713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'20","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.723734+0000","last_change":"2024-09-13T18:45:22.033554+0000","last_active":"2024-09-13T18:50:38.723734+0000","last_peered":"2024-09-13T18:50:38.723734+0000","last_clean":"2024-09-13T18:50:38.723734+0000","last_became_active":"2024-09-13T18:45:22.032862+0000","last_became_peered":"2024-09-13T18:45:22.032862+0000","last_unstale":"2024-09-13T18:50:38.723734+0000","last_undegraded":"2024-09-13T18:50:38.723734+0000","last_fullsized":"2024-09-13T18:50:38.723734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'8","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112563+0000","last_change":"2024-09-13T18:45:21.668025+0000","last_active":"2024-09-13T18:48:27.112563+0000","last_peered":"2024-09-13T18:48:27.112563+0000","last_clean":"2024-09-13T18:48:27.112563+0000","last_became_active":"2024-09-13T18:45:21.667457+0000","last_became_peered":"2024-09-13T18:45:21.667457+0000","last_unstale":"2024-09-13T18:48:27.112563+0000","last_undegraded":"2024-09-13T18:48:27.112563+0000","last_fullsized":"2024-09-13T18:48:27.112563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616601+0000","last_change":"2024-09-13T18:45:26.250464+0000","last_active":"2024-09-13T18:47:46.616601+0000","last_peered":"2024-09-13T18:47:46.616601+0000","last_clean":"2024-09-13T18:47:46.616601+0000","last_became_active":"2024-09-13T18:45:26.250041+0000","last_became_peered":"2024-09-13T18:45:26.250041+0000","last_unstale":"2024-09-13T18:47:46.616601+0000","last_undegraded":"2024-09-13T18:47:46.616601+0000","last_fullsized":"2024-09-13T18:47:46.616601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:20.013806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'6","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.712846+0000","last_change":"2024-09-13T18:45:22.024133+0000","last_active":"2024-09-13T18:50:38.712846+0000","last_peered":"2024-09-13T18:50:38.712846+0000","last_clean":"2024-09-13T18:50:38.712846+0000","last_became_active":"2024-09-13T18:45:22.023882+0000","last_became_peered":"2024-09-13T18:45:22.023882+0000","last_unstale":"2024-09-13T18:50:38.712846+0000","last_undegraded":"2024-09-13T18:50:38.712846+0000","last_fullsized":"2024-09-13T18:50:38.712846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:41.615027+0000","last_change":"2024-09-13T18:45:21.663297+0000","last_active":"2024-09-13T18:47:41.615027+0000","last_peered":"2024-09-13T18:47:41.615027+0000","last_clean":"2024-09-13T18:47:41.615027+0000","last_became_active":"2024-09-13T18:45:21.662980+0000","last_became_peered":"2024-09-13T18:45:21.662980+0000","last_unstale":"2024-09-13T18:47:41.615027+0000","last_undegraded":"2024-09-13T18:47:41.615027+0000","last_fullsized":"2024-09-13T18:47:41.615027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:51.753367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617186+0000","last_change":"2024-09-13T18:45:26.253184+0000","last_active":"2024-09-13T18:47:51.617186+0000","last_peered":"2024-09-13T18:47:51.617186+0000","last_clean":"2024-09-13T18:47:51.617186+0000","last_became_active":"2024-09-13T18:45:26.252786+0000","last_became_peered":"2024-09-13T18:45:26.252786+0000","last_unstale":"2024-09-13T18:47:51.617186+0000","last_undegraded":"2024-09-13T18:47:51.617186+0000","last_fullsized":"2024-09-13T18:47:51.617186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'6","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.716361+0000","last_change":"2024-09-13T18:45:22.035052+0000","last_active":"2024-09-13T18:50:38.716361+0000","last_peered":"2024-09-13T18:50:38.716361+0000","last_clean":"2024-09-13T18:50:38.716361+0000","last_became_active":"2024-09-13T18:45:22.034765+0000","last_became_peered":"2024-09-13T18:45:22.034765+0000","last_unstale":"2024-09-13T18:50:38.716361+0000","last_undegraded":"2024-09-13T18:50:38.716361+0000","last_fullsized":"2024-09-13T18:50:38.716361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:28.674827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'102","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.725465+0000","last_change":"2024-09-13T18:45:21.668054+0000","last_active":"2024-09-13T18:50:38.725465+0000","last_peered":"2024-09-13T18:50:38.725465+0000","last_clean":"2024-09-13T18:50:38.725465+0000","last_became_active":"2024-09-13T18:45:21.667587+0000","last_became_peered":"2024-09-13T18:45:21.667587+0000","last_unstale":"2024-09-13T18:50:38.725465+0000","last_undegraded":"2024-09-13T18:50:38.725465+0000","last_fullsized":"2024-09-13T18:50:38.725465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:00.370329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":942437,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.620478+0000","last_change":"2024-09-13T18:45:26.052997+0000","last_active":"2024-09-13T18:47:46.620478+0000","last_peered":"2024-09-13T18:47:46.620478+0000","last_clean":"2024-09-13T18:47:46.620478+0000","last_became_active":"2024-09-13T18:45:26.052614+0000","last_became_peered":"2024-09-13T18:45:26.052614+0000","last_unstale":"2024-09-13T18:47:46.620478+0000","last_undegraded":"2024-09-13T18:47:46.620478+0000","last_fullsized":"2024-09-13T18:47:46.620478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'12","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720601+0000","last_change":"2024-09-13T18:45:22.020754+0000","last_active":"2024-09-13T18:50:38.720601+0000","last_peered":"2024-09-13T18:50:38.720601+0000","last_clean":"2024-09-13T18:50:38.720601+0000","last_became_active":"2024-09-13T18:45:22.020461+0000","last_became_peered":"2024-09-13T18:45:22.020461+0000","last_unstale":"2024-09-13T18:50:38.720601+0000","last_undegraded":"2024-09-13T18:50:38.720601+0000","last_fullsized":"2024-09-13T18:50:38.720601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'29","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:36.175588+0000","last_change":"2024-09-13T18:45:21.664387+0000","last_active":"2024-09-13T18:50:36.175588+0000","last_peered":"2024-09-13T18:50:36.175588+0000","last_clean":"2024-09-13T18:50:36.175588+0000","last_became_active":"2024-09-13T18:45:21.663941+0000","last_became_peered":"2024-09-13T18:45:21.663941+0000","last_unstale":"2024-09-13T18:50:36.175588+0000","last_undegraded":"2024-09-13T18:50:36.175588+0000","last_fullsized":"2024-09-13T18:50:36.175588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:43.230340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616153+0000","last_change":"2024-09-13T18:45:26.051227+0000","last_active":"2024-09-13T18:47:46.616153+0000","last_peered":"2024-09-13T18:47:46.616153+0000","last_clean":"2024-09-13T18:47:46.616153+0000","last_became_active":"2024-09-13T18:45:26.050757+0000","last_became_peered":"2024-09-13T18:45:26.050757+0000","last_unstale":"2024-09-13T18:47:46.616153+0000","last_undegraded":"2024-09-13T18:47:46.616153+0000","last_fullsized":"2024-09-13T18:47:46.616153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:59.045390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'9","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720368+0000","last_change":"2024-09-13T18:45:22.025223+0000","last_active":"2024-09-13T18:50:38.720368+0000","last_peered":"2024-09-13T18:50:38.720368+0000","last_clean":"2024-09-13T18:50:38.720368+0000","last_became_active":"2024-09-13T18:45:22.024972+0000","last_became_peered":"2024-09-13T18:45:22.024972+0000","last_unstale":"2024-09-13T18:50:38.720368+0000","last_undegraded":"2024-09-13T18:50:38.720368+0000","last_fullsized":"2024-09-13T18:50:38.720368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'7","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.104828+0000","last_change":"2024-09-13T18:45:21.666814+0000","last_active":"2024-09-13T18:48:12.104828+0000","last_peered":"2024-09-13T18:48:12.104828+0000","last_clean":"2024-09-13T18:48:12.104828+0000","last_became_active":"2024-09-13T18:45:21.666516+0000","last_became_peered":"2024-09-13T18:45:21.666516+0000","last_unstale":"2024-09-13T18:48:12.104828+0000","last_undegraded":"2024-09-13T18:48:12.104828+0000","last_fullsized":"2024-09-13T18:48:12.104828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616514+0000","last_change":"2024-09-13T18:45:26.057746+0000","last_active":"2024-09-13T18:47:46.616514+0000","last_peered":"2024-09-13T18:47:46.616514+0000","last_clean":"2024-09-13T18:47:46.616514+0000","last_became_active":"2024-09-13T18:45:26.057285+0000","last_became_peered":"2024-09-13T18:45:26.057285+0000","last_unstale":"2024-09-13T18:47:46.616514+0000","last_undegraded":"2024-09-13T18:47:46.616514+0000","last_fullsized":"2024-09-13T18:47:46.616514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:07.327040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.716754+0000","last_change":"2024-09-13T18:45:22.031653+0000","last_active":"2024-09-13T18:50:38.716754+0000","last_peered":"2024-09-13T18:50:38.716754+0000","last_clean":"2024-09-13T18:50:38.716754+0000","last_became_active":"2024-09-13T18:45:22.031341+0000","last_became_peered":"2024-09-13T18:45:22.031341+0000","last_unstale":"2024-09-13T18:50:38.716754+0000","last_undegraded":"2024-09-13T18:50:38.716754+0000","last_fullsized":"2024-09-13T18:50:38.716754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112682+0000","last_change":"2024-09-13T18:45:21.664695+0000","last_active":"2024-09-13T18:48:27.112682+0000","last_peered":"2024-09-13T18:48:27.112682+0000","last_clean":"2024-09-13T18:48:27.112682+0000","last_became_active":"2024-09-13T18:45:21.664401+0000","last_became_peered":"2024-09-13T18:45:21.664401+0000","last_unstale":"2024-09-13T18:48:27.112682+0000","last_undegraded":"2024-09-13T18:48:27.112682+0000","last_fullsized":"2024-09-13T18:48:27.112682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:15.313688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.616542+0000","last_change":"2024-09-13T18:45:26.254041+0000","last_active":"2024-09-13T18:47:46.616542+0000","last_peered":"2024-09-13T18:47:46.616542+0000","last_clean":"2024-09-13T18:47:46.616542+0000","last_became_active":"2024-09-13T18:45:26.253579+0000","last_became_peered":"2024-09-13T18:45:26.253579+0000","last_unstale":"2024-09-13T18:47:46.616542+0000","last_undegraded":"2024-09-13T18:47:46.616542+0000","last_fullsized":"2024-09-13T18:47:46.616542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:19.171737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.613048+0000","last_change":"2024-09-13T18:45:26.253962+0000","last_active":"2024-09-13T18:47:26.613048+0000","last_peered":"2024-09-13T18:47:26.613048+0000","last_clean":"2024-09-13T18:47:26.613048+0000","last_became_active":"2024-09-13T18:45:26.252979+0000","last_became_peered":"2024-09-13T18:45:26.252979+0000","last_unstale":"2024-09-13T18:47:26.613048+0000","last_undegraded":"2024-09-13T18:47:26.613048+0000","last_fullsized":"2024-09-13T18:47:26.613048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:06.193778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'11","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.712424+0000","last_change":"2024-09-13T18:45:22.030919+0000","last_active":"2024-09-13T18:50:38.712424+0000","last_peered":"2024-09-13T18:50:38.712424+0000","last_clean":"2024-09-13T18:50:38.712424+0000","last_became_active":"2024-09-13T18:45:22.030453+0000","last_became_peered":"2024-09-13T18:45:22.030453+0000","last_unstale":"2024-09-13T18:50:38.712424+0000","last_undegraded":"2024-09-13T18:50:38.712424+0000","last_fullsized":"2024-09-13T18:50:38.712424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:27.112562+0000","last_change":"2024-09-13T18:45:21.664824+0000","last_active":"2024-09-13T18:48:27.112562+0000","last_peered":"2024-09-13T18:48:27.112562+0000","last_clean":"2024-09-13T18:48:27.112562+0000","last_became_active":"2024-09-13T18:45:21.664571+0000","last_became_peered":"2024-09-13T18:45:21.664571+0000","last_unstale":"2024-09-13T18:48:27.112562+0000","last_undegraded":"2024-09-13T18:48:27.112562+0000","last_fullsized":"2024-09-13T18:48:27.112562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:31.615970+0000","last_change":"2024-09-13T18:45:26.054920+0000","last_active":"2024-09-13T18:47:31.615970+0000","last_peered":"2024-09-13T18:47:31.615970+0000","last_clean":"2024-09-13T18:47:31.615970+0000","last_became_active":"2024-09-13T18:45:26.054510+0000","last_became_peered":"2024-09-13T18:45:26.054510+0000","last_unstale":"2024-09-13T18:47:31.615970+0000","last_undegraded":"2024-09-13T18:47:31.615970+0000","last_fullsized":"2024-09-13T18:47:31.615970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:32.061769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'6","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.713425+0000","last_change":"2024-09-13T18:45:22.028321+0000","last_active":"2024-09-13T18:50:38.713425+0000","last_peered":"2024-09-13T18:50:38.713425+0000","last_clean":"2024-09-13T18:50:38.713425+0000","last_became_active":"2024-09-13T18:45:22.028062+0000","last_became_peered":"2024-09-13T18:45:22.028062+0000","last_unstale":"2024-09-13T18:50:38.713425+0000","last_undegraded":"2024-09-13T18:50:38.713425+0000","last_fullsized":"2024-09-13T18:50:38.713425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.109768+0000","last_change":"2024-09-13T18:45:21.672763+0000","last_active":"2024-09-13T18:48:22.109768+0000","last_peered":"2024-09-13T18:48:22.109768+0000","last_clean":"2024-09-13T18:48:22.109768+0000","last_became_active":"2024-09-13T18:45:21.672470+0000","last_became_peered":"2024-09-13T18:45:21.672470+0000","last_unstale":"2024-09-13T18:48:22.109768+0000","last_undegraded":"2024-09-13T18:48:22.109768+0000","last_fullsized":"2024-09-13T18:48:22.109768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:37.626371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.098429+0000","last_change":"2024-09-13T18:45:21.660195+0000","last_active":"2024-09-13T18:48:02.098429+0000","last_peered":"2024-09-13T18:48:02.098429+0000","last_clean":"2024-09-13T18:48:02.098429+0000","last_became_active":"2024-09-13T18:45:21.659912+0000","last_became_peered":"2024-09-13T18:45:21.659912+0000","last_unstale":"2024-09-13T18:48:02.098429+0000","last_undegraded":"2024-09-13T18:48:02.098429+0000","last_fullsized":"2024-09-13T18:48:02.098429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'7","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720864+0000","last_change":"2024-09-13T18:45:22.024571+0000","last_active":"2024-09-13T18:50:38.720864+0000","last_peered":"2024-09-13T18:50:38.720864+0000","last_clean":"2024-09-13T18:50:38.720864+0000","last_became_active":"2024-09-13T18:45:22.024305+0000","last_became_peered":"2024-09-13T18:45:22.024305+0000","last_unstale":"2024-09-13T18:50:38.720864+0000","last_undegraded":"2024-09-13T18:50:38.720864+0000","last_fullsized":"2024-09-13T18:50:38.720864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.617977+0000","last_change":"2024-09-13T18:45:26.056207+0000","last_active":"2024-09-13T18:47:56.617977+0000","last_peered":"2024-09-13T18:47:56.617977+0000","last_clean":"2024-09-13T18:47:56.617977+0000","last_became_active":"2024-09-13T18:45:26.055794+0000","last_became_peered":"2024-09-13T18:45:26.055794+0000","last_unstale":"2024-09-13T18:47:56.617977+0000","last_undegraded":"2024-09-13T18:47:56.617977+0000","last_fullsized":"2024-09-13T18:47:56.617977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:29.520825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.617441+0000","last_change":"2024-09-13T18:45:21.670376+0000","last_active":"2024-09-13T18:47:51.617441+0000","last_peered":"2024-09-13T18:47:51.617441+0000","last_clean":"2024-09-13T18:47:51.617441+0000","last_became_active":"2024-09-13T18:45:21.670083+0000","last_became_peered":"2024-09-13T18:45:21.670083+0000","last_unstale":"2024-09-13T18:47:51.617441+0000","last_undegraded":"2024-09-13T18:47:51.617441+0000","last_fullsized":"2024-09-13T18:47:51.617441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.909219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'7","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.698571+0000","last_change":"2024-09-13T18:45:22.021774+0000","last_active":"2024-09-13T18:50:38.698571+0000","last_peered":"2024-09-13T18:50:38.698571+0000","last_clean":"2024-09-13T18:50:38.698571+0000","last_became_active":"2024-09-13T18:45:22.021496+0000","last_became_peered":"2024-09-13T18:45:22.021496+0000","last_unstale":"2024-09-13T18:50:38.698571+0000","last_undegraded":"2024-09-13T18:50:38.698571+0000","last_fullsized":"2024-09-13T18:50:38.698571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:44.234639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.618047+0000","last_change":"2024-09-13T18:45:26.050478+0000","last_active":"2024-09-13T18:47:56.618047+0000","last_peered":"2024-09-13T18:47:56.618047+0000","last_clean":"2024-09-13T18:47:56.618047+0000","last_became_active":"2024-09-13T18:45:26.050095+0000","last_became_peered":"2024-09-13T18:45:26.050095+0000","last_unstale":"2024-09-13T18:47:56.618047+0000","last_undegraded":"2024-09-13T18:47:56.618047+0000","last_fullsized":"2024-09-13T18:47:56.618047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:28.276515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.715158+0000","last_change":"2024-09-13T18:45:22.028025+0000","last_active":"2024-09-13T18:50:38.715158+0000","last_peered":"2024-09-13T18:50:38.715158+0000","last_clean":"2024-09-13T18:50:38.715158+0000","last_became_active":"2024-09-13T18:45:22.027528+0000","last_became_peered":"2024-09-13T18:45:22.027528+0000","last_unstale":"2024-09-13T18:50:38.715158+0000","last_undegraded":"2024-09-13T18:50:38.715158+0000","last_fullsized":"2024-09-13T18:50:38.715158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.719324+0000","last_change":"2024-09-13T18:45:22.024615+0000","last_active":"2024-09-13T18:50:38.719324+0000","last_peered":"2024-09-13T18:50:38.719324+0000","last_clean":"2024-09-13T18:50:38.719324+0000","last_became_active":"2024-09-13T18:45:22.024369+0000","last_became_peered":"2024-09-13T18:45:22.024369+0000","last_unstale":"2024-09-13T18:50:38.719324+0000","last_undegraded":"2024-09-13T18:50:38.719324+0000","last_fullsized":"2024-09-13T18:50:38.719324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:54.940624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720312+0000","last_change":"2024-09-13T18:45:22.035861+0000","last_active":"2024-09-13T18:50:38.720312+0000","last_peered":"2024-09-13T18:50:38.720312+0000","last_clean":"2024-09-13T18:50:38.720312+0000","last_became_active":"2024-09-13T18:45:22.034318+0000","last_became_peered":"2024-09-13T18:45:22.034318+0000","last_unstale":"2024-09-13T18:50:38.720312+0000","last_undegraded":"2024-09-13T18:50:38.720312+0000","last_fullsized":"2024-09-13T18:50:38.720312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:11.683595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'5","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.711841+0000","last_change":"2024-09-13T18:45:22.033266+0000","last_active":"2024-09-13T18:50:38.711841+0000","last_peered":"2024-09-13T18:50:38.711841+0000","last_clean":"2024-09-13T18:50:38.711841+0000","last_became_active":"2024-09-13T18:45:22.032851+0000","last_became_peered":"2024-09-13T18:45:22.032851+0000","last_unstale":"2024-09-13T18:50:38.711841+0000","last_undegraded":"2024-09-13T18:50:38.711841+0000","last_fullsized":"2024-09-13T18:50:38.711841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'6","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.703385+0000","last_change":"2024-09-13T18:45:22.033500+0000","last_active":"2024-09-13T18:50:38.703385+0000","last_peered":"2024-09-13T18:50:38.703385+0000","last_clean":"2024-09-13T18:50:38.703385+0000","last_became_active":"2024-09-13T18:45:22.033156+0000","last_became_peered":"2024-09-13T18:45:22.033156+0000","last_unstale":"2024-09-13T18:50:38.703385+0000","last_undegraded":"2024-09-13T18:50:38.703385+0000","last_fullsized":"2024-09-13T18:50:38.703385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:22.772719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.711596+0000","last_change":"2024-09-13T18:45:22.029906+0000","last_active":"2024-09-13T18:50:38.711596+0000","last_peered":"2024-09-13T18:50:38.711596+0000","last_clean":"2024-09-13T18:50:38.711596+0000","last_became_active":"2024-09-13T18:45:22.029654+0000","last_became_peered":"2024-09-13T18:45:22.029654+0000","last_unstale":"2024-09-13T18:50:38.711596+0000","last_undegraded":"2024-09-13T18:50:38.711596+0000","last_fullsized":"2024-09-13T18:50:38.711596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'13","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.717656+0000","last_change":"2024-09-13T18:45:22.028396+0000","last_active":"2024-09-13T18:50:38.717656+0000","last_peered":"2024-09-13T18:50:38.717656+0000","last_clean":"2024-09-13T18:50:38.717656+0000","last_became_active":"2024-09-13T18:45:22.028031+0000","last_became_peered":"2024-09-13T18:45:22.028031+0000","last_unstale":"2024-09-13T18:50:38.717656+0000","last_undegraded":"2024-09-13T18:50:38.717656+0000","last_fullsized":"2024-09-13T18:50:38.717656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'7","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.702752+0000","last_change":"2024-09-13T18:45:22.032816+0000","last_active":"2024-09-13T18:50:38.702752+0000","last_peered":"2024-09-13T18:50:38.702752+0000","last_clean":"2024-09-13T18:50:38.702752+0000","last_became_active":"2024-09-13T18:45:22.032561+0000","last_became_peered":"2024-09-13T18:45:22.032561+0000","last_unstale":"2024-09-13T18:50:38.702752+0000","last_undegraded":"2024-09-13T18:50:38.702752+0000","last_fullsized":"2024-09-13T18:50:38.702752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'9","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.718408+0000","last_change":"2024-09-13T18:45:22.036615+0000","last_active":"2024-09-13T18:50:38.718408+0000","last_peered":"2024-09-13T18:50:38.718408+0000","last_clean":"2024-09-13T18:50:38.718408+0000","last_became_active":"2024-09-13T18:45:22.036380+0000","last_became_peered":"2024-09-13T18:45:22.036380+0000","last_unstale":"2024-09-13T18:50:38.718408+0000","last_undegraded":"2024-09-13T18:50:38.718408+0000","last_fullsized":"2024-09-13T18:50:38.718408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'9","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.706549+0000","last_change":"2024-09-13T18:45:22.035082+0000","last_active":"2024-09-13T18:50:38.706549+0000","last_peered":"2024-09-13T18:50:38.706549+0000","last_clean":"2024-09-13T18:50:38.706549+0000","last_became_active":"2024-09-13T18:45:22.034646+0000","last_became_peered":"2024-09-13T18:45:22.034646+0000","last_unstale":"2024-09-13T18:50:38.706549+0000","last_undegraded":"2024-09-13T18:50:38.706549+0000","last_fullsized":"2024-09-13T18:50:38.706549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'13","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.716718+0000","last_change":"2024-09-13T18:45:22.029195+0000","last_active":"2024-09-13T18:50:38.716718+0000","last_peered":"2024-09-13T18:50:38.716718+0000","last_clean":"2024-09-13T18:50:38.716718+0000","last_became_active":"2024-09-13T18:45:22.028430+0000","last_became_peered":"2024-09-13T18:45:22.028430+0000","last_unstale":"2024-09-13T18:50:38.716718+0000","last_undegraded":"2024-09-13T18:50:38.716718+0000","last_fullsized":"2024-09-13T18:50:38.716718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'11","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.715643+0000","last_change":"2024-09-13T18:45:22.019974+0000","last_active":"2024-09-13T18:50:38.715643+0000","last_peered":"2024-09-13T18:50:38.715643+0000","last_clean":"2024-09-13T18:50:38.715643+0000","last_became_active":"2024-09-13T18:45:22.019733+0000","last_became_peered":"2024-09-13T18:45:22.019733+0000","last_unstale":"2024-09-13T18:50:38.715643+0000","last_undegraded":"2024-09-13T18:50:38.715643+0000","last_fullsized":"2024-09-13T18:50:38.715643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:34.117345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.717835+0000","last_change":"2024-09-13T18:45:22.016110+0000","last_active":"2024-09-13T18:50:38.717835+0000","last_peered":"2024-09-13T18:50:38.717835+0000","last_clean":"2024-09-13T18:50:38.717835+0000","last_became_active":"2024-09-13T18:45:22.015868+0000","last_became_peered":"2024-09-13T18:45:22.015868+0000","last_unstale":"2024-09-13T18:50:38.717835+0000","last_undegraded":"2024-09-13T18:50:38.717835+0000","last_fullsized":"2024-09-13T18:50:38.717835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'7","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.715689+0000","last_change":"2024-09-13T18:45:22.034477+0000","last_active":"2024-09-13T18:50:38.715689+0000","last_peered":"2024-09-13T18:50:38.715689+0000","last_clean":"2024-09-13T18:50:38.715689+0000","last_became_active":"2024-09-13T18:45:22.034019+0000","last_became_peered":"2024-09-13T18:45:22.034019+0000","last_unstale":"2024-09-13T18:50:38.715689+0000","last_undegraded":"2024-09-13T18:50:38.715689+0000","last_fullsized":"2024-09-13T18:50:38.715689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:52.333022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'12","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.711228+0000","last_change":"2024-09-13T18:45:22.021787+0000","last_active":"2024-09-13T18:50:38.711228+0000","last_peered":"2024-09-13T18:50:38.711228+0000","last_clean":"2024-09-13T18:50:38.711228+0000","last_became_active":"2024-09-13T18:45:22.020415+0000","last_became_peered":"2024-09-13T18:45:22.020415+0000","last_unstale":"2024-09-13T18:50:38.711228+0000","last_undegraded":"2024-09-13T18:50:38.711228+0000","last_fullsized":"2024-09-13T18:50:38.711228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.706535+0000","last_change":"2024-09-13T18:45:22.035941+0000","last_active":"2024-09-13T18:50:38.706535+0000","last_peered":"2024-09-13T18:50:38.706535+0000","last_clean":"2024-09-13T18:50:38.706535+0000","last_became_active":"2024-09-13T18:45:22.035491+0000","last_became_peered":"2024-09-13T18:45:22.035491+0000","last_unstale":"2024-09-13T18:50:38.706535+0000","last_undegraded":"2024-09-13T18:50:38.706535+0000","last_fullsized":"2024-09-13T18:50:38.706535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:12.690762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'11","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.714710+0000","last_change":"2024-09-13T18:46:11.147145+0000","last_active":"2024-09-13T18:50:38.714710+0000","last_peered":"2024-09-13T18:50:38.714710+0000","last_clean":"2024-09-13T18:50:38.714710+0000","last_became_active":"2024-09-13T18:46:11.146859+0000","last_became_peered":"2024-09-13T18:46:11.146859+0000","last_unstale":"2024-09-13T18:50:38.714710+0000","last_undegraded":"2024-09-13T18:50:38.714710+0000","last_fullsized":"2024-09-13T18:50:38.714710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:36.388621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.706201+0000","last_change":"2024-09-13T18:45:22.021298+0000","last_active":"2024-09-13T18:50:38.706201+0000","last_peered":"2024-09-13T18:50:38.706201+0000","last_clean":"2024-09-13T18:50:38.706201+0000","last_became_active":"2024-09-13T18:45:22.021042+0000","last_became_peered":"2024-09-13T18:45:22.021042+0000","last_unstale":"2024-09-13T18:50:38.706201+0000","last_undegraded":"2024-09-13T18:50:38.706201+0000","last_fullsized":"2024-09-13T18:50:38.706201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:26.133883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'5","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.712418+0000","last_change":"2024-09-13T18:45:22.021628+0000","last_active":"2024-09-13T18:50:38.712418+0000","last_peered":"2024-09-13T18:50:38.712418+0000","last_clean":"2024-09-13T18:50:38.712418+0000","last_became_active":"2024-09-13T18:45:22.021366+0000","last_became_peered":"2024-09-13T18:45:22.021366+0000","last_unstale":"2024-09-13T18:50:38.712418+0000","last_undegraded":"2024-09-13T18:50:38.712418+0000","last_fullsized":"2024-09-13T18:50:38.712418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:21.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'10","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.709596+0000","last_change":"2024-09-13T18:45:22.029051+0000","last_active":"2024-09-13T18:50:38.709596+0000","last_peered":"2024-09-13T18:50:38.709596+0000","last_clean":"2024-09-13T18:50:38.709596+0000","last_became_active":"2024-09-13T18:45:22.028594+0000","last_became_peered":"2024-09-13T18:45:22.028594+0000","last_unstale":"2024-09-13T18:50:38.709596+0000","last_undegraded":"2024-09-13T18:50:38.709596+0000","last_fullsized":"2024-09-13T18:50:38.709596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:08.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.708857+0000","last_change":"2024-09-13T18:45:22.016996+0000","last_active":"2024-09-13T18:50:38.708857+0000","last_peered":"2024-09-13T18:50:38.708857+0000","last_clean":"2024-09-13T18:50:38.708857+0000","last_became_active":"2024-09-13T18:45:22.016731+0000","last_became_peered":"2024-09-13T18:45:22.016731+0000","last_unstale":"2024-09-13T18:50:38.708857+0000","last_undegraded":"2024-09-13T18:50:38.708857+0000","last_fullsized":"2024-09-13T18:50:38.708857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:23.175634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.713243+0000","last_change":"2024-09-13T18:45:22.028649+0000","last_active":"2024-09-13T18:50:38.713243+0000","last_peered":"2024-09-13T18:50:38.713243+0000","last_clean":"2024-09-13T18:50:38.713243+0000","last_became_active":"2024-09-13T18:45:22.027899+0000","last_became_peered":"2024-09-13T18:45:22.027899+0000","last_unstale":"2024-09-13T18:50:38.713243+0000","last_undegraded":"2024-09-13T18:50:38.713243+0000","last_fullsized":"2024-09-13T18:50:38.713243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:43.057400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'16","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.714321+0000","last_change":"2024-09-13T18:45:22.024291+0000","last_active":"2024-09-13T18:50:38.714321+0000","last_peered":"2024-09-13T18:50:38.714321+0000","last_clean":"2024-09-13T18:50:38.714321+0000","last_became_active":"2024-09-13T18:45:22.024014+0000","last_became_peered":"2024-09-13T18:45:22.024014+0000","last_unstale":"2024-09-13T18:50:38.714321+0000","last_undegraded":"2024-09-13T18:50:38.714321+0000","last_fullsized":"2024-09-13T18:50:38.714321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.416639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'9","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.717838+0000","last_change":"2024-09-13T18:45:22.036551+0000","last_active":"2024-09-13T18:50:38.717838+0000","last_peered":"2024-09-13T18:50:38.717838+0000","last_clean":"2024-09-13T18:50:38.717838+0000","last_became_active":"2024-09-13T18:45:22.036269+0000","last_became_peered":"2024-09-13T18:45:22.036269+0000","last_unstale":"2024-09-13T18:50:38.717838+0000","last_undegraded":"2024-09-13T18:50:38.717838+0000","last_fullsized":"2024-09-13T18:50:38.717838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:46.615310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'6","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.719209+0000","last_change":"2024-09-13T18:45:22.032392+0000","last_active":"2024-09-13T18:50:38.719209+0000","last_peered":"2024-09-13T18:50:38.719209+0000","last_clean":"2024-09-13T18:50:38.719209+0000","last_became_active":"2024-09-13T18:45:22.027605+0000","last_became_peered":"2024-09-13T18:45:22.027605+0000","last_unstale":"2024-09-13T18:50:38.719209+0000","last_undegraded":"2024-09-13T18:50:38.719209+0000","last_fullsized":"2024-09-13T18:50:38.719209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'5","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.713583+0000","last_change":"2024-09-13T18:45:22.029307+0000","last_active":"2024-09-13T18:50:38.713583+0000","last_peered":"2024-09-13T18:50:38.713583+0000","last_clean":"2024-09-13T18:50:38.713583+0000","last_became_active":"2024-09-13T18:45:22.029018+0000","last_became_peered":"2024-09-13T18:45:22.029018+0000","last_unstale":"2024-09-13T18:50:38.713583+0000","last_undegraded":"2024-09-13T18:50:38.713583+0000","last_fullsized":"2024-09-13T18:50:38.713583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:16.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.713247+0000","last_change":"2024-09-13T18:45:22.029061+0000","last_active":"2024-09-13T18:50:38.713247+0000","last_peered":"2024-09-13T18:50:38.713247+0000","last_clean":"2024-09-13T18:50:38.713247+0000","last_became_active":"2024-09-13T18:45:22.028758+0000","last_became_peered":"2024-09-13T18:45:22.028758+0000","last_unstale":"2024-09-13T18:50:38.713247+0000","last_undegraded":"2024-09-13T18:50:38.713247+0000","last_fullsized":"2024-09-13T18:50:38.713247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:38.113427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'6","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720357+0000","last_change":"2024-09-13T18:45:22.029690+0000","last_active":"2024-09-13T18:50:38.720357+0000","last_peered":"2024-09-13T18:50:38.720357+0000","last_clean":"2024-09-13T18:50:38.720357+0000","last_became_active":"2024-09-13T18:45:22.029403+0000","last_became_peered":"2024-09-13T18:45:22.029403+0000","last_unstale":"2024-09-13T18:50:38.720357+0000","last_undegraded":"2024-09-13T18:50:38.720357+0000","last_fullsized":"2024-09-13T18:50:38.720357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:40.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.718258+0000","last_change":"2024-09-13T18:45:22.038483+0000","last_active":"2024-09-13T18:50:38.718258+0000","last_peered":"2024-09-13T18:50:38.718258+0000","last_clean":"2024-09-13T18:50:38.718258+0000","last_became_active":"2024-09-13T18:45:22.036877+0000","last_became_peered":"2024-09-13T18:45:22.036877+0000","last_unstale":"2024-09-13T18:50:38.718258+0000","last_undegraded":"2024-09-13T18:50:38.718258+0000","last_fullsized":"2024-09-13T18:50:38.718258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:11.187445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.713973+0000","last_change":"2024-09-13T18:45:22.022846+0000","last_active":"2024-09-13T18:50:38.713973+0000","last_peered":"2024-09-13T18:50:38.713973+0000","last_clean":"2024-09-13T18:50:38.713973+0000","last_became_active":"2024-09-13T18:45:22.022618+0000","last_became_peered":"2024-09-13T18:45:22.022618+0000","last_unstale":"2024-09-13T18:50:38.713973+0000","last_undegraded":"2024-09-13T18:50:38.713973+0000","last_fullsized":"2024-09-13T18:50:38.713973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:16.592108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.704677+0000","last_change":"2024-09-13T18:45:22.028545+0000","last_active":"2024-09-13T18:50:38.704677+0000","last_peered":"2024-09-13T18:50:38.704677+0000","last_clean":"2024-09-13T18:50:38.704677+0000","last_became_active":"2024-09-13T18:45:22.028291+0000","last_became_peered":"2024-09-13T18:45:22.028291+0000","last_unstale":"2024-09-13T18:50:38.704677+0000","last_undegraded":"2024-09-13T18:50:38.704677+0000","last_fullsized":"2024-09-13T18:50:38.704677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:02.641197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'10","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.716211+0000","last_change":"2024-09-13T18:45:22.034460+0000","last_active":"2024-09-13T18:50:38.716211+0000","last_peered":"2024-09-13T18:50:38.716211+0000","last_clean":"2024-09-13T18:50:38.716211+0000","last_became_active":"2024-09-13T18:45:22.033974+0000","last_became_peered":"2024-09-13T18:45:22.033974+0000","last_unstale":"2024-09-13T18:50:38.716211+0000","last_undegraded":"2024-09-13T18:50:38.716211+0000","last_fullsized":"2024-09-13T18:50:38.716211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:31.404964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":954260,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":272,"num_write_kb":1081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":1908520,"data_compressed":245052,"data_compressed_allocated":294912,"data_compressed_original":1441792,"omap_allocated":0,"internal_metadata":0},"log_size":335,"ondisk_log_size":335,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":704313,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.42399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.754},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.46999999999999997},"min":{"1min":0.36199999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.65400000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49099999999999999,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70799999999999996,"5min":0.749,"15min":0.749},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.432,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67300000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66200000000000003,"5min":0.755,"15min":0.755},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.48099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.47099999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47299999999999998,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60399999999999998,"5min":0.748,"15min":0.748},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.52100000000000002},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.54300000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73099999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.57199999999999995},"min":{"1min":0.41199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.50800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":655360,"data_stored":1055800,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.67600000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.746,"15min":0.746},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67700000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70699999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47299999999999998},"min":{"1min":0.33100000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63600000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.42799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.443},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.41399999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.629},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.40000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":113453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.32600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.626,"5min":0.87,"15min":0.87},"last":0.496}]},{"osd":1,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78700000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67600000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54000000000000004,"15min":0.56299999999999994},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.55200000000000005},"min":{"1min":0.36899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76100000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.33000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33800000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59999999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.34100000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71999999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.40200000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.436}]},{"osd":7,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68600000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.39900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.50900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":113489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.377,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.67400000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.499,"15min":0.499},"min":{"1min":0.35099999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.374}]},{"osd":1,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.255,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66500000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.443},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.56200000000000006},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.435,"5min":0.25,"15min":0.25},"max":{"1min":0.747,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.41199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.40400000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59099999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47599999999999998,"15min":0.497},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53300000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72299999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.51700000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":1.075,"15min":1.075},"last":0.497}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":667648,"data_stored":1065687,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.63600000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.375,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.498,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.318}]},{"osd":1,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.40600000000000003},"min":{"1min":0.251,"5min":0.223,"15min":0.223},"max":{"1min":0.753,"5min":1.121,"15min":1.121},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67200000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.46800000000000003},"min":{"1min":0.314,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61299999999999999,"15min":0.58999999999999997},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59699999999999998,"15min":0.623},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.437}]},{"osd":5,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.45500000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81000000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73199999999999998,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63,"15min":0.67300000000000004},"min":{"1min":0.41899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":290816,"data_stored":124388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.35899999999999999},"min":{"1min":0.20899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.377,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70899999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40600000000000003,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54300000000000004,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.313},{"interface":"front","average":{"1min":0.441,"5min":0.432,"15min":0.41199999999999998},"min":{"1min":0.27400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.437},"min":{"1min":0.33000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.376},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.438},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70499999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77100000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.442},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.627},"min":{"1min":0.46500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.38900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76700000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.432},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.82099999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.45600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.995,"15min":0.995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.49199999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63400000000000001,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83699999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.45100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83299999999999996,"5min":0.874,"15min":0.874},"last":0.46300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":113523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.23599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.56200000000000006,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36399999999999999,"15min":0.34799999999999998},"min":{"1min":0.23499999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.314}]},{"osd":2,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.22500000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.52900000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.435,"15min":0.42299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.57499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.38800000000000001},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.28599999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.74299999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79700000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.504}]},{"osd":5,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72499999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74199999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52800000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77000000000000002,"5min":0.872,"15min":0.872},"last":0.47199999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80200000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574915,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":356352,"data_stored":704369,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39900000000000002,"15min":0.42299999999999999},"min":{"1min":0.23300000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.629,"5min":1.496,"15min":1.496},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.40300000000000002},"min":{"1min":0.252,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56699999999999995,"5min":1.024,"15min":1.024},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.26900000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.76300000000000001,"5min":1.518,"15min":1.518},"last":0.374},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.29399999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83699999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.315}]},{"osd":3,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":1.294,"15min":1.294},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.64800000000000002},"min":{"1min":0.439,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91500000000000004,"5min":1.198,"15min":1.198},"last":0.627},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73899999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.69399999999999995},"min":{"1min":0.42499999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61699999999999999,"15min":0.64800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96899999999999997,"5min":1.143,"15min":1.143},"last":0.65400000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60799999999999998,"15min":0.65100000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.72699999999999998,"5min":1.391,"15min":1.391},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66100000000000003,"15min":0.72899999999999998},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84999999999999998,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67900000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63,"15min":0.68000000000000005},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.82099999999999995,"5min":1.363,"15min":1.363},"last":0.67300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":11025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":953462,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":942437,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:50:45.219 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.219 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.219 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.220 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.220 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.220 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.220 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.220 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.220 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.220 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.220 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.220 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.221 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.221 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.221 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.221 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.221 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.221 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.221 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.221 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.222 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.222 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.222 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.222 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.222 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.222 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.222 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.222 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.222 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.222 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.223 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.223 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.223 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.223 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.223 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.223 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.223 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.223 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.224 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.224 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.224 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.224 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.224 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.224 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.224 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.224 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.224 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.225 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T18:45:17.981407+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.225 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.225 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.225 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.225 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.225 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.225 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.226 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.226 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.226 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.226 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.226 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.226 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.226 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.226 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.226 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.226 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.227 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.227 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.227 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.227 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.227 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.227 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.227 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.227 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.227 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.228 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.228 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.228 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.228 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.228 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.228 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.228 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.228 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.228 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.229 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.229 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.229 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.229 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.229 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.229 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.229 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.229 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.229 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.230 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.230 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.230 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.230 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.230 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.231 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.231 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.231 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.231 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.231 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.231 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.231 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.231 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.231 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.232 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.232 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.232 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.232 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.232 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.232 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.233 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.233 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.233 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.233 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.233 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.233 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.233 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.233 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.234 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.234 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.234 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.234 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.234 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.234 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.234 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.235 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.235 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.235 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:50:45.235 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:51:05.236 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:51:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.349+0000 7fb569c5a640 1 Processor -- start 2024-09-13T18:51:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.349+0000 7fb569c5a640 1 -- start start 2024-09-13T18:51:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.350+0000 7fb569c5a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb5640b2850 0x7fb56413be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.350+0000 7fb569c5a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5640b0e10 con 0x7fb5640b0330 2024-09-13T18:51:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.350+0000 7fb569c5a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56406e920 con 0x7fb56413c390 2024-09-13T18:51:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.350+0000 7fb569c5a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5640b2c30 con 0x7fb5640b2850 2024-09-13T18:51:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.350+0000 7fb5637fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb5640b2850 0x7fb56413be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.350+0000 7fb563fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb5640b0330 0x7fb56414c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57360/0 (socket says 172.21.15.29:57360) 2024-09-13T18:51:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.350+0000 7fb563fff640 1 -- 172.21.15.29:0/1518029467 learned_addr learned my addr 172.21.15.29:0/1518029467 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:51:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.351+0000 7fb5637fe640 1 -- 172.21.15.29:0/1518029467 >> v1:172.21.15.96:6789/0 conn(0x7fb56413c390 legacy=0x7fb564145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.351+0000 7fb5637fe640 1 -- 172.21.15.29:0/1518029467 >> v1:172.21.15.29:6789/0 conn(0x7fb5640b0330 legacy=0x7fb56414c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.351+0000 7fb5637fe640 1 -- 172.21.15.29:0/1518029467 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640b0850 con 0x7fb5640b2850 2024-09-13T18:51:05.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.351+0000 7fb5637fe640 1 --2- 172.21.15.29:0/1518029467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5640b2850 0x7fb56413be50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb55400a940 tx=0x7fb55402b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10158b542c86946e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:05.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.352+0000 7fb562ffd640 1 -- 172.21.15.29:0/1518029467 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554033640 con 0x7fb5640b2850 2024-09-13T18:51:05.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.352+0000 7fb562ffd640 1 -- 172.21.15.29:0/1518029467 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5540337a0 con 0x7fb5640b2850 2024-09-13T18:51:05.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.352+0000 7fb562ffd640 1 -- 172.21.15.29:0/1518029467 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554033b30 con 0x7fb5640b2850 2024-09-13T18:51:05.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.352+0000 7fb569c5a640 1 -- 172.21.15.29:0/1518029467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5640b2850 msgr2=0x7fb56413be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.352+0000 7fb569c5a640 1 --2- 172.21.15.29:0/1518029467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5640b2850 0x7fb56413be50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb55400a940 tx=0x7fb55402b3d0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.352+0000 7fb569c5a640 1 -- 172.21.15.29:0/1518029467 shutdown_connections 2024-09-13T18:51:05.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.352+0000 7fb569c5a640 1 --2- 172.21.15.29:0/1518029467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5640b2850 0x7fb56413be50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.352+0000 7fb569c5a640 1 -- 172.21.15.29:0/1518029467 >> 172.21.15.29:0/1518029467 conn(0x7fb56406a890 msgr2=0x7fb5640b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:05.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.352+0000 7fb569c5a640 1 -- 172.21.15.29:0/1518029467 shutdown_connections 2024-09-13T18:51:05.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.352+0000 7fb569c5a640 1 -- 172.21.15.29:0/1518029467 wait complete. 2024-09-13T18:51:05.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.353+0000 7fb569c5a640 1 Processor -- start 2024-09-13T18:51:05.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.354+0000 7fb569c5a640 1 -- start start 2024-09-13T18:51:05.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.354+0000 7fb569c5a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5640b0330 0x7fb564070d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.354+0000 7fb569c5a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb5640b2850 0x7fb564141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.354+0000 7fb569c5a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb56413c390 0x7fb564141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.354+0000 7fb569c5a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb564071830 con 0x7fb56413c390 2024-09-13T18:51:05.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.354+0000 7fb569c5a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56406ffb0 con 0x7fb5640b0330 2024-09-13T18:51:05.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.354+0000 7fb569c5a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb564071f10 con 0x7fb5640b2850 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.354+0000 7fb563fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb56413c390 0x7fb564141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.354+0000 7fb5637fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5640b0330 0x7fb564070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.354+0000 7fb563fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb56413c390 0x7fb564141540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45458/0 (socket says 172.21.15.29:45458) 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.354+0000 7fb563fff640 1 -- 172.21.15.29:0/3118896043 learned_addr learned my addr 172.21.15.29:0/3118896043 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.354+0000 7fb55affd640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb5640b2850 0x7fb564141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.355+0000 7fb563fff640 1 -- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb5640b2850 msgr2=0x7fb564141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.355+0000 7fb563fff640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb5640b2850 0x7fb564141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.355+0000 7fb563fff640 1 -- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5640b0330 msgr2=0x7fb564070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.355+0000 7fb563fff640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5640b0330 0x7fb564070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.355+0000 7fb563fff640 1 -- 172.21.15.29:0/3118896043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55400a5a0 con 0x7fb56413c390 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.355+0000 7fb563fff640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb56413c390 0x7fb564141540 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00caf0 tx=0x7fb55c0020b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.355+0000 7fb560ff9640 1 -- 172.21.15.29:0/3118896043 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c00a6e0 con 0x7fb56413c390 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.355+0000 7fb560ff9640 1 -- 172.21.15.29:0/3118896043 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c00a840 con 0x7fb56413c390 2024-09-13T18:51:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.355+0000 7fb569c5a640 1 -- 172.21.15.29:0/3118896043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56413cbd0 con 0x7fb56413c390 2024-09-13T18:51:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.355+0000 7fb560ff9640 1 -- 172.21.15.29:0/3118896043 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c00abf0 con 0x7fb56413c390 2024-09-13T18:51:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.355+0000 7fb569c5a640 1 -- 172.21.15.29:0/3118896043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb564142b80 con 0x7fb56413c390 2024-09-13T18:51:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.356+0000 7fb569c5a640 1 -- 172.21.15.29:0/3118896043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56413be50 con 0x7fb56413c390 2024-09-13T18:51:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.357+0000 7fb560ff9640 1 -- 172.21.15.29:0/3118896043 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb55c00ad50 con 0x7fb56413c390 2024-09-13T18:51:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.357+0000 7fb560ff9640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb54406ac00 0x7fb54406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.357+0000 7fb560ff9640 1 -- 172.21.15.29:0/3118896043 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb55c088fe0 con 0x7fb56413c390 2024-09-13T18:51:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.357+0000 7fb5637fe640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb54406ac00 0x7fb54406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.358+0000 7fb5637fe640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb54406ac00 0x7fb54406d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb554035000 tx=0x7fb554008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.362+0000 7fb560ff9640 1 -- 172.21.15.29:0/3118896043 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb55c053f40 con 0x7fb56413c390 2024-09-13T18:51:05.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.531+0000 7fb569c5a640 1 -- 172.21.15.29:0/3118896043 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb56413fad0 con 0x7fb54406ac00 2024-09-13T18:51:05.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.541+0000 7fb560ff9640 1 -- 172.21.15.29:0/3118896043 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369034 (secure 0 0 0) 0x7fb56413fad0 con 0x7fb54406ac00 2024-09-13T18:51:05.548 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:51:05.550 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-13T18:51:05.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.544+0000 7fb569c5a640 1 -- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb54406ac00 msgr2=0x7fb54406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.544+0000 7fb569c5a640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb54406ac00 0x7fb54406d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb554035000 tx=0x7fb554008040 comp rx=0 tx=0).stop 2024-09-13T18:51:05.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.544+0000 7fb569c5a640 1 -- 172.21.15.29:0/3118896043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb56413c390 msgr2=0x7fb564141540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.544+0000 7fb569c5a640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb56413c390 0x7fb564141540 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00caf0 tx=0x7fb55c0020b0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.544+0000 7fb569c5a640 1 -- 172.21.15.29:0/3118896043 shutdown_connections 2024-09-13T18:51:05.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.544+0000 7fb569c5a640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fb54406ac00 0x7fb54406d0c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.544+0000 7fb569c5a640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb56413c390 0x7fb564141540 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.544+0000 7fb569c5a640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb5640b2850 0x7fb564141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.544+0000 7fb569c5a640 1 --2- 172.21.15.29:0/3118896043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5640b0330 0x7fb564070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.544+0000 7fb569c5a640 1 -- 172.21.15.29:0/3118896043 >> 172.21.15.29:0/3118896043 conn(0x7fb56406a890 msgr2=0x7fb564145720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:05.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.545+0000 7fb569c5a640 1 -- 172.21.15.29:0/3118896043 shutdown_connections 2024-09-13T18:51:05.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:05.545+0000 7fb569c5a640 1 -- 172.21.15.29:0/3118896043 wait complete. 2024-09-13T18:51:05.559 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-13T18:51:03.677114+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1544628,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":156,"num_read_kb":140,"num_write":437,"num_write_kb":3501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":981,"ondisk_log_size":981,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235616,"kb_used_data":3104,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739104,"statfs":{"total":773094113280,"available":772852842496,"internally_reserved":0,"allocated":3178496,"data_stored":3996160,"data_compressed":310028,"data_compressed_allocated":385024,"data_compressed_original":2588672,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003611"},"pg_stats":[{"pgid":"2.1f","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.536651+0000","last_change":"2024-09-13T18:50:48.536748+0000","last_active":"2024-09-13T18:50:48.536651+0000","last_peered":"2024-09-13T18:50:48.536651+0000","last_clean":"2024-09-13T18:50:48.536651+0000","last_became_active":"2024-09-13T18:45:21.667985+0000","last_became_peered":"2024-09-13T18:45:21.667985+0000","last_unstale":"2024-09-13T18:50:48.536651+0000","last_undegraded":"2024-09-13T18:50:48.536651+0000","last_fullsized":"2024-09-13T18:50:48.536651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:48.536623+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:48.536623+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.536623+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:34.362710+0000","scrub_duration":0.0039049509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'7","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.710579+0000","last_change":"2024-09-13T18:45:22.034389+0000","last_active":"2024-09-13T18:50:38.710579+0000","last_peered":"2024-09-13T18:50:38.710579+0000","last_clean":"2024-09-13T18:50:38.710579+0000","last_became_active":"2024-09-13T18:45:22.034125+0000","last_became_peered":"2024-09-13T18:45:22.034125+0000","last_unstale":"2024-09-13T18:50:38.710579+0000","last_undegraded":"2024-09-13T18:50:38.710579+0000","last_fullsized":"2024-09-13T18:50:38.710579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:16.632775+0000","last_change":"2024-09-13T18:45:26.253118+0000","last_active":"2024-09-13T18:50:16.632775+0000","last_peered":"2024-09-13T18:50:16.632775+0000","last_clean":"2024-09-13T18:50:16.632775+0000","last_became_active":"2024-09-13T18:45:26.252747+0000","last_became_peered":"2024-09-13T18:45:26.252747+0000","last_unstale":"2024-09-13T18:50:16.632775+0000","last_undegraded":"2024-09-13T18:50:16.632775+0000","last_fullsized":"2024-09-13T18:50:16.632775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:55.822921+0000","last_change":"2024-09-13T18:50:55.823028+0000","last_active":"2024-09-13T18:50:55.822921+0000","last_peered":"2024-09-13T18:50:55.822921+0000","last_clean":"2024-09-13T18:50:55.822921+0000","last_became_active":"2024-09-13T18:45:21.666398+0000","last_became_peered":"2024-09-13T18:45:21.666398+0000","last_unstale":"2024-09-13T18:50:55.822921+0000","last_undegraded":"2024-09-13T18:50:55.822921+0000","last_fullsized":"2024-09-13T18:50:55.822921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:55.822888+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:55.822888+0000","last_clean_scrub_stamp":"2024-09-13T18:50:55.822888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:09.382112+0000","scrub_duration":0.001447315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720371+0000","last_change":"2024-09-13T18:45:22.024774+0000","last_active":"2024-09-13T18:50:38.720371+0000","last_peered":"2024-09-13T18:50:38.720371+0000","last_clean":"2024-09-13T18:50:38.720371+0000","last_became_active":"2024-09-13T18:45:22.024424+0000","last_became_peered":"2024-09-13T18:45:22.024424+0000","last_unstale":"2024-09-13T18:50:38.720371+0000","last_undegraded":"2024-09-13T18:50:38.720371+0000","last_fullsized":"2024-09-13T18:50:38.720371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:16.634244+0000","last_change":"2024-09-13T18:45:26.050411+0000","last_active":"2024-09-13T18:50:16.634244+0000","last_peered":"2024-09-13T18:50:16.634244+0000","last_clean":"2024-09-13T18:50:16.634244+0000","last_became_active":"2024-09-13T18:45:26.049414+0000","last_became_peered":"2024-09-13T18:45:26.049414+0000","last_unstale":"2024-09-13T18:50:16.634244+0000","last_undegraded":"2024-09-13T18:50:16.634244+0000","last_fullsized":"2024-09-13T18:50:16.634244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:00.920349+0000","last_change":"2024-09-13T18:51:00.920443+0000","last_active":"2024-09-13T18:51:00.920349+0000","last_peered":"2024-09-13T18:51:00.920349+0000","last_clean":"2024-09-13T18:51:00.920349+0000","last_became_active":"2024-09-13T18:45:21.667602+0000","last_became_peered":"2024-09-13T18:45:21.667602+0000","last_unstale":"2024-09-13T18:51:00.920349+0000","last_undegraded":"2024-09-13T18:51:00.920349+0000","last_fullsized":"2024-09-13T18:51:00.920349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:00.920324+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:00.920324+0000","last_clean_scrub_stamp":"2024-09-13T18:51:00.920324+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:59.320550+0000","scrub_duration":0.0027812430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'8","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.721087+0000","last_change":"2024-09-13T18:45:22.036952+0000","last_active":"2024-09-13T18:50:38.721087+0000","last_peered":"2024-09-13T18:50:38.721087+0000","last_clean":"2024-09-13T18:50:38.721087+0000","last_became_active":"2024-09-13T18:45:22.035790+0000","last_became_peered":"2024-09-13T18:45:22.035790+0000","last_unstale":"2024-09-13T18:50:38.721087+0000","last_undegraded":"2024-09-13T18:50:38.721087+0000","last_fullsized":"2024-09-13T18:50:38.721087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:26.635645+0000","last_change":"2024-09-13T18:45:26.052333+0000","last_active":"2024-09-13T18:50:26.635645+0000","last_peered":"2024-09-13T18:50:26.635645+0000","last_clean":"2024-09-13T18:50:26.635645+0000","last_became_active":"2024-09-13T18:45:26.051873+0000","last_became_peered":"2024-09-13T18:45:26.051873+0000","last_unstale":"2024-09-13T18:50:26.635645+0000","last_undegraded":"2024-09-13T18:50:26.635645+0000","last_fullsized":"2024-09-13T18:50:26.635645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.931169+0000","last_change":"2024-09-13T18:50:51.931266+0000","last_active":"2024-09-13T18:50:51.931169+0000","last_peered":"2024-09-13T18:50:51.931169+0000","last_clean":"2024-09-13T18:50:51.931169+0000","last_became_active":"2024-09-13T18:45:21.669622+0000","last_became_peered":"2024-09-13T18:45:21.669622+0000","last_unstale":"2024-09-13T18:50:51.931169+0000","last_undegraded":"2024-09-13T18:50:51.931169+0000","last_fullsized":"2024-09-13T18:50:51.931169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:51.931146+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:51.931146+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.931146+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:13.786431+0000","scrub_duration":0.0028583060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'14","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.721205+0000","last_change":"2024-09-13T18:45:22.035675+0000","last_active":"2024-09-13T18:50:38.721205+0000","last_peered":"2024-09-13T18:50:38.721205+0000","last_clean":"2024-09-13T18:50:38.721205+0000","last_became_active":"2024-09-13T18:45:22.034431+0000","last_became_peered":"2024-09-13T18:45:22.034431+0000","last_unstale":"2024-09-13T18:50:38.721205+0000","last_undegraded":"2024-09-13T18:50:38.721205+0000","last_fullsized":"2024-09-13T18:50:38.721205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:26.635594+0000","last_change":"2024-09-13T18:45:26.052892+0000","last_active":"2024-09-13T18:50:26.635594+0000","last_peered":"2024-09-13T18:50:26.635594+0000","last_clean":"2024-09-13T18:50:26.635594+0000","last_became_active":"2024-09-13T18:45:26.052441+0000","last_became_peered":"2024-09-13T18:45:26.052441+0000","last_unstale":"2024-09-13T18:50:26.635594+0000","last_undegraded":"2024-09-13T18:50:26.635594+0000","last_fullsized":"2024-09-13T18:50:26.635594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.253089+0000","last_change":"2024-09-13T18:50:53.253185+0000","last_active":"2024-09-13T18:50:53.253089+0000","last_peered":"2024-09-13T18:50:53.253089+0000","last_clean":"2024-09-13T18:50:53.253089+0000","last_became_active":"2024-09-13T18:45:22.015758+0000","last_became_peered":"2024-09-13T18:45:22.015758+0000","last_unstale":"2024-09-13T18:50:53.253089+0000","last_undegraded":"2024-09-13T18:50:53.253089+0000","last_fullsized":"2024-09-13T18:50:53.253089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:53.253065+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:53.253065+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.253065+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:15.108350+0000","scrub_duration":0.001311446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:58.974434+0000","last_change":"2024-09-13T18:50:58.974551+0000","last_active":"2024-09-13T18:50:58.974434+0000","last_peered":"2024-09-13T18:50:58.974434+0000","last_clean":"2024-09-13T18:50:58.974434+0000","last_became_active":"2024-09-13T18:45:21.672388+0000","last_became_peered":"2024-09-13T18:45:21.672388+0000","last_unstale":"2024-09-13T18:50:58.974434+0000","last_undegraded":"2024-09-13T18:50:58.974434+0000","last_fullsized":"2024-09-13T18:50:58.974434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:50:58.974396+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:50:58.974396+0000","last_clean_scrub_stamp":"2024-09-13T18:50:58.974396+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:13.454414+0000","scrub_duration":0.0026098369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:56.631766+0000","last_change":"2024-09-13T18:46:11.150163+0000","last_active":"2024-09-13T18:49:56.631766+0000","last_peered":"2024-09-13T18:49:56.631766+0000","last_clean":"2024-09-13T18:49:56.631766+0000","last_became_active":"2024-09-13T18:46:11.149623+0000","last_became_peered":"2024-09-13T18:46:11.149623+0000","last_unstale":"2024-09-13T18:49:56.631766+0000","last_undegraded":"2024-09-13T18:49:56.631766+0000","last_fullsized":"2024-09-13T18:49:56.631766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'9","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.714924+0000","last_change":"2024-09-13T18:45:22.028858+0000","last_active":"2024-09-13T18:50:38.714924+0000","last_peered":"2024-09-13T18:50:38.714924+0000","last_clean":"2024-09-13T18:50:38.714924+0000","last_became_active":"2024-09-13T18:45:22.028336+0000","last_became_peered":"2024-09-13T18:45:22.028336+0000","last_unstale":"2024-09-13T18:50:38.714924+0000","last_undegraded":"2024-09-13T18:50:38.714924+0000","last_fullsized":"2024-09-13T18:50:38.714924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.227304+0000","last_change":"2024-09-13T18:50:51.227414+0000","last_active":"2024-09-13T18:50:51.227304+0000","last_peered":"2024-09-13T18:50:51.227304+0000","last_clean":"2024-09-13T18:50:51.227304+0000","last_became_active":"2024-09-13T18:45:21.667625+0000","last_became_peered":"2024-09-13T18:45:21.667625+0000","last_unstale":"2024-09-13T18:50:51.227304+0000","last_undegraded":"2024-09-13T18:50:51.227304+0000","last_fullsized":"2024-09-13T18:50:51.227304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:51.227280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:51.227280+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.227280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:05.707299+0000","scrub_duration":0.001427123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:56.631721+0000","last_change":"2024-09-13T18:45:26.050576+0000","last_active":"2024-09-13T18:49:56.631721+0000","last_peered":"2024-09-13T18:49:56.631721+0000","last_clean":"2024-09-13T18:49:56.631721+0000","last_became_active":"2024-09-13T18:45:26.049129+0000","last_became_peered":"2024-09-13T18:45:26.049129+0000","last_unstale":"2024-09-13T18:49:56.631721+0000","last_undegraded":"2024-09-13T18:49:56.631721+0000","last_fullsized":"2024-09-13T18:49:56.631721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:54.649259+0000","last_change":"2024-09-13T18:50:54.649378+0000","last_active":"2024-09-13T18:50:54.649259+0000","last_peered":"2024-09-13T18:50:54.649259+0000","last_clean":"2024-09-13T18:50:54.649259+0000","last_became_active":"2024-09-13T18:46:11.149036+0000","last_became_peered":"2024-09-13T18:46:11.149036+0000","last_unstale":"2024-09-13T18:50:54.649259+0000","last_undegraded":"2024-09-13T18:50:54.649259+0000","last_fullsized":"2024-09-13T18:50:54.649259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:54.649236+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:54.649236+0000","last_clean_scrub_stamp":"2024-09-13T18:50:54.649236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:09.129255+0000","scrub_duration":0.001480161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:45.276110+0000","last_change":"2024-09-13T18:50:45.276213+0000","last_active":"2024-09-13T18:50:45.276110+0000","last_peered":"2024-09-13T18:50:45.276110+0000","last_clean":"2024-09-13T18:50:45.276110+0000","last_became_active":"2024-09-13T18:45:21.668242+0000","last_became_peered":"2024-09-13T18:45:21.668242+0000","last_unstale":"2024-09-13T18:50:45.276110+0000","last_undegraded":"2024-09-13T18:50:45.276110+0000","last_fullsized":"2024-09-13T18:50:45.276110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:45.276090+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:45.276090+0000","last_clean_scrub_stamp":"2024-09-13T18:50:45.276090+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:32.233036+0000","scrub_duration":0.001724461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:56.635478+0000","last_change":"2024-09-13T18:45:26.255263+0000","last_active":"2024-09-13T18:49:56.635478+0000","last_peered":"2024-09-13T18:49:56.635478+0000","last_clean":"2024-09-13T18:49:56.635478+0000","last_became_active":"2024-09-13T18:45:26.254886+0000","last_became_peered":"2024-09-13T18:45:26.254886+0000","last_unstale":"2024-09-13T18:49:56.635478+0000","last_undegraded":"2024-09-13T18:49:56.635478+0000","last_fullsized":"2024-09-13T18:49:56.635478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.741575+0000","last_change":"2024-09-13T18:50:48.741674+0000","last_active":"2024-09-13T18:50:48.741575+0000","last_peered":"2024-09-13T18:50:48.741575+0000","last_clean":"2024-09-13T18:50:48.741575+0000","last_became_active":"2024-09-13T18:45:22.027835+0000","last_became_peered":"2024-09-13T18:45:22.027835+0000","last_unstale":"2024-09-13T18:50:48.741575+0000","last_undegraded":"2024-09-13T18:50:48.741575+0000","last_fullsized":"2024-09-13T18:50:48.741575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:48.741554+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:48.741554+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.741554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:34.567640+0000","scrub_duration":0.0017755049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:41.629822+0000","last_change":"2024-09-13T18:45:21.669073+0000","last_active":"2024-09-13T18:49:41.629822+0000","last_peered":"2024-09-13T18:49:41.629822+0000","last_clean":"2024-09-13T18:49:41.629822+0000","last_became_active":"2024-09-13T18:45:21.668765+0000","last_became_peered":"2024-09-13T18:45:21.668765+0000","last_unstale":"2024-09-13T18:49:41.629822+0000","last_undegraded":"2024-09-13T18:49:41.629822+0000","last_fullsized":"2024-09-13T18:49:41.629822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:56.631785+0000","last_change":"2024-09-13T18:45:26.050623+0000","last_active":"2024-09-13T18:49:56.631785+0000","last_peered":"2024-09-13T18:49:56.631785+0000","last_clean":"2024-09-13T18:49:56.631785+0000","last_became_active":"2024-09-13T18:45:26.049408+0000","last_became_peered":"2024-09-13T18:45:26.049408+0000","last_unstale":"2024-09-13T18:49:56.631785+0000","last_undegraded":"2024-09-13T18:49:56.631785+0000","last_fullsized":"2024-09-13T18:49:56.631785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:52.560168+0000","last_change":"2024-09-13T18:50:52.560268+0000","last_active":"2024-09-13T18:50:52.560168+0000","last_peered":"2024-09-13T18:50:52.560168+0000","last_clean":"2024-09-13T18:50:52.560168+0000","last_became_active":"2024-09-13T18:45:22.021976+0000","last_became_peered":"2024-09-13T18:45:22.021976+0000","last_unstale":"2024-09-13T18:50:52.560168+0000","last_undegraded":"2024-09-13T18:50:52.560168+0000","last_fullsized":"2024-09-13T18:50:52.560168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:52.560142+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:52.560142+0000","last_clean_scrub_stamp":"2024-09-13T18:50:52.560142+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:48.429003+0000","scrub_duration":0.0016215960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.229700+0000","last_change":"2024-09-13T18:50:48.229823+0000","last_active":"2024-09-13T18:50:48.229700+0000","last_peered":"2024-09-13T18:50:48.229700+0000","last_clean":"2024-09-13T18:50:48.229700+0000","last_became_active":"2024-09-13T18:45:21.667680+0000","last_became_peered":"2024-09-13T18:45:21.667680+0000","last_unstale":"2024-09-13T18:50:48.229700+0000","last_undegraded":"2024-09-13T18:50:48.229700+0000","last_fullsized":"2024-09-13T18:50:48.229700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:48.229676+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:48.229676+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.229676+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:38.239939+0000","scrub_duration":0.0024150930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:36.629207+0000","last_change":"2024-09-13T18:45:26.255088+0000","last_active":"2024-09-13T18:49:36.629207+0000","last_peered":"2024-09-13T18:49:36.629207+0000","last_clean":"2024-09-13T18:49:36.629207+0000","last_became_active":"2024-09-13T18:45:26.254662+0000","last_became_peered":"2024-09-13T18:45:26.254662+0000","last_unstale":"2024-09-13T18:49:36.629207+0000","last_undegraded":"2024-09-13T18:49:36.629207+0000","last_fullsized":"2024-09-13T18:49:36.629207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.717611+0000","last_change":"2024-09-13T18:45:22.026678+0000","last_active":"2024-09-13T18:50:38.717611+0000","last_peered":"2024-09-13T18:50:38.717611+0000","last_clean":"2024-09-13T18:50:38.717611+0000","last_became_active":"2024-09-13T18:45:22.026419+0000","last_became_peered":"2024-09-13T18:45:22.026419+0000","last_unstale":"2024-09-13T18:50:38.717611+0000","last_undegraded":"2024-09-13T18:50:38.717611+0000","last_fullsized":"2024-09-13T18:50:38.717611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'37","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:54.195045+0000","last_change":"2024-09-13T18:50:54.195184+0000","last_active":"2024-09-13T18:50:54.195045+0000","last_peered":"2024-09-13T18:50:54.195045+0000","last_clean":"2024-09-13T18:50:54.195045+0000","last_became_active":"2024-09-13T18:45:21.664066+0000","last_became_peered":"2024-09-13T18:45:21.664066+0000","last_unstale":"2024-09-13T18:50:54.195045+0000","last_undegraded":"2024-09-13T18:50:54.195045+0000","last_fullsized":"2024-09-13T18:50:54.195045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'37","last_scrub_stamp":"2024-09-13T18:50:54.195018+0000","last_deep_scrub":"26'37","last_deep_scrub_stamp":"2024-09-13T18:50:54.195018+0000","last_clean_scrub_stamp":"2024-09-13T18:50:54.195018+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:48.625670+0000","scrub_duration":0.0018610250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:26.627621+0000","last_change":"2024-09-13T18:45:26.253888+0000","last_active":"2024-09-13T18:49:26.627621+0000","last_peered":"2024-09-13T18:49:26.627621+0000","last_clean":"2024-09-13T18:49:26.627621+0000","last_became_active":"2024-09-13T18:45:26.253488+0000","last_became_peered":"2024-09-13T18:45:26.253488+0000","last_unstale":"2024-09-13T18:49:26.627621+0000","last_undegraded":"2024-09-13T18:49:26.627621+0000","last_fullsized":"2024-09-13T18:49:26.627621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'11","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.710132+0000","last_change":"2024-09-13T18:45:22.022940+0000","last_active":"2024-09-13T18:50:38.710132+0000","last_peered":"2024-09-13T18:50:38.710132+0000","last_clean":"2024-09-13T18:50:38.710132+0000","last_became_active":"2024-09-13T18:45:22.022628+0000","last_became_peered":"2024-09-13T18:45:22.022628+0000","last_unstale":"2024-09-13T18:50:38.710132+0000","last_undegraded":"2024-09-13T18:50:38.710132+0000","last_fullsized":"2024-09-13T18:50:38.710132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:50.944196+0000","last_change":"2024-09-13T18:50:50.944283+0000","last_active":"2024-09-13T18:50:50.944196+0000","last_peered":"2024-09-13T18:50:50.944196+0000","last_clean":"2024-09-13T18:50:50.944196+0000","last_became_active":"2024-09-13T18:45:21.668645+0000","last_became_peered":"2024-09-13T18:45:21.668645+0000","last_unstale":"2024-09-13T18:50:50.944196+0000","last_undegraded":"2024-09-13T18:50:50.944196+0000","last_fullsized":"2024-09-13T18:50:50.944196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:50.944170+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:50.944170+0000","last_clean_scrub_stamp":"2024-09-13T18:50:50.944170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:50.702974+0000","scrub_duration":0.0019259710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:36.627757+0000","last_change":"2024-09-13T18:46:11.658745+0000","last_active":"2024-09-13T18:49:36.627757+0000","last_peered":"2024-09-13T18:49:36.627757+0000","last_clean":"2024-09-13T18:49:36.627757+0000","last_became_active":"2024-09-13T18:46:11.658190+0000","last_became_peered":"2024-09-13T18:46:11.658190+0000","last_unstale":"2024-09-13T18:49:36.627757+0000","last_undegraded":"2024-09-13T18:49:36.627757+0000","last_fullsized":"2024-09-13T18:49:36.627757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:56.652546+0000","last_change":"2024-09-13T18:50:56.652677+0000","last_active":"2024-09-13T18:50:56.652546+0000","last_peered":"2024-09-13T18:50:56.652546+0000","last_clean":"2024-09-13T18:50:56.652546+0000","last_became_active":"2024-09-13T18:46:11.145524+0000","last_became_peered":"2024-09-13T18:46:11.145524+0000","last_unstale":"2024-09-13T18:50:56.652546+0000","last_undegraded":"2024-09-13T18:50:56.652546+0000","last_fullsized":"2024-09-13T18:50:56.652546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:56.652521+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:56.652521+0000","last_clean_scrub_stamp":"2024-09-13T18:50:56.652521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:42.478607+0000","scrub_duration":0.0014878630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:58.294050+0000","last_change":"2024-09-13T18:50:58.294183+0000","last_active":"2024-09-13T18:50:58.294050+0000","last_peered":"2024-09-13T18:50:58.294050+0000","last_clean":"2024-09-13T18:50:58.294050+0000","last_became_active":"2024-09-13T18:45:21.660577+0000","last_became_peered":"2024-09-13T18:45:21.660577+0000","last_unstale":"2024-09-13T18:50:58.294050+0000","last_undegraded":"2024-09-13T18:50:58.294050+0000","last_fullsized":"2024-09-13T18:50:58.294050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:58.294026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:58.294026+0000","last_clean_scrub_stamp":"2024-09-13T18:50:58.294026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:54.162887+0000","scrub_duration":0.001538322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:36.633399+0000","last_change":"2024-09-13T18:45:26.056021+0000","last_active":"2024-09-13T18:49:36.633399+0000","last_peered":"2024-09-13T18:49:36.633399+0000","last_clean":"2024-09-13T18:49:36.633399+0000","last_became_active":"2024-09-13T18:45:26.053877+0000","last_became_peered":"2024-09-13T18:45:26.053877+0000","last_unstale":"2024-09-13T18:49:36.633399+0000","last_undegraded":"2024-09-13T18:49:36.633399+0000","last_fullsized":"2024-09-13T18:49:36.633399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.737249+0000","last_change":"2024-09-13T18:50:49.737342+0000","last_active":"2024-09-13T18:50:49.737249+0000","last_peered":"2024-09-13T18:50:49.737249+0000","last_clean":"2024-09-13T18:50:49.737249+0000","last_became_active":"2024-09-13T18:45:22.028714+0000","last_became_peered":"2024-09-13T18:45:22.028714+0000","last_unstale":"2024-09-13T18:50:49.737249+0000","last_undegraded":"2024-09-13T18:50:49.737249+0000","last_fullsized":"2024-09-13T18:50:49.737249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:49.737225+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:49.737225+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.737225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:11.076096+0000","scrub_duration":0.0019902909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.619923+0000","last_change":"2024-09-13T18:50:51.620039+0000","last_active":"2024-09-13T18:50:51.619923+0000","last_peered":"2024-09-13T18:50:51.619923+0000","last_clean":"2024-09-13T18:50:51.619923+0000","last_became_active":"2024-09-13T18:45:21.667320+0000","last_became_peered":"2024-09-13T18:45:21.667320+0000","last_unstale":"2024-09-13T18:50:51.619923+0000","last_undegraded":"2024-09-13T18:50:51.619923+0000","last_fullsized":"2024-09-13T18:50:51.619923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:51.619900+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:51.619900+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.619900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:12.958770+0000","scrub_duration":0.0015549559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:35.174779+0000","last_change":"2024-09-13T18:46:11.148369+0000","last_active":"2024-09-13T18:50:35.174779+0000","last_peered":"2024-09-13T18:50:35.174779+0000","last_clean":"2024-09-13T18:50:35.174779+0000","last_became_active":"2024-09-13T18:46:11.147801+0000","last_became_peered":"2024-09-13T18:46:11.147801+0000","last_unstale":"2024-09-13T18:50:35.174779+0000","last_undegraded":"2024-09-13T18:50:35.174779+0000","last_fullsized":"2024-09-13T18:50:35.174779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.265246+0000","last_change":"2024-09-13T18:51:01.265385+0000","last_active":"2024-09-13T18:51:01.265246+0000","last_peered":"2024-09-13T18:51:01.265246+0000","last_clean":"2024-09-13T18:51:01.265246+0000","last_became_active":"2024-09-13T18:45:22.023357+0000","last_became_peered":"2024-09-13T18:45:22.023357+0000","last_unstale":"2024-09-13T18:51:01.265246+0000","last_undegraded":"2024-09-13T18:51:01.265246+0000","last_fullsized":"2024-09-13T18:51:01.265246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:01.265221+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:01.265221+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.265221+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:14.824444+0000","scrub_duration":0.0015610520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'46","reported_seq":116,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.566915+0000","last_change":"2024-09-13T18:50:47.567062+0000","last_active":"2024-09-13T18:50:47.566915+0000","last_peered":"2024-09-13T18:50:47.566915+0000","last_clean":"2024-09-13T18:50:47.566915+0000","last_became_active":"2024-09-13T18:45:21.667768+0000","last_became_peered":"2024-09-13T18:45:21.667768+0000","last_unstale":"2024-09-13T18:50:47.566915+0000","last_undegraded":"2024-09-13T18:50:47.566915+0000","last_fullsized":"2024-09-13T18:50:47.566915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'46","last_scrub_stamp":"2024-09-13T18:50:47.566865+0000","last_deep_scrub":"26'46","last_deep_scrub_stamp":"2024-09-13T18:50:47.566865+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.566865+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:09.704431+0000","scrub_duration":0.0017576639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":40,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:46.634682+0000","last_change":"2024-09-13T18:45:26.057274+0000","last_active":"2024-09-13T18:49:46.634682+0000","last_peered":"2024-09-13T18:49:46.634682+0000","last_clean":"2024-09-13T18:49:46.634682+0000","last_became_active":"2024-09-13T18:45:26.056850+0000","last_became_peered":"2024-09-13T18:45:26.056850+0000","last_unstale":"2024-09-13T18:49:46.634682+0000","last_undegraded":"2024-09-13T18:49:46.634682+0000","last_fullsized":"2024-09-13T18:49:46.634682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.560269+0000","last_change":"2024-09-13T18:50:49.560377+0000","last_active":"2024-09-13T18:50:49.560269+0000","last_peered":"2024-09-13T18:50:49.560269+0000","last_clean":"2024-09-13T18:50:49.560269+0000","last_became_active":"2024-09-13T18:45:22.020317+0000","last_became_peered":"2024-09-13T18:45:22.020317+0000","last_unstale":"2024-09-13T18:50:49.560269+0000","last_undegraded":"2024-09-13T18:50:49.560269+0000","last_fullsized":"2024-09-13T18:50:49.560269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:49.560243+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:49.560243+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.560243+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:10.899114+0000","scrub_duration":0.001921554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.990686+0000","last_change":"2024-09-13T18:50:49.990780+0000","last_active":"2024-09-13T18:50:49.990686+0000","last_peered":"2024-09-13T18:50:49.990686+0000","last_clean":"2024-09-13T18:50:49.990686+0000","last_became_active":"2024-09-13T18:45:21.667483+0000","last_became_peered":"2024-09-13T18:45:21.667483+0000","last_unstale":"2024-09-13T18:50:49.990686+0000","last_undegraded":"2024-09-13T18:50:49.990686+0000","last_fullsized":"2024-09-13T18:50:49.990686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:49.990664+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:49.990664+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.990664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:12.128230+0000","scrub_duration":0.002034138,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:46.629130+0000","last_change":"2024-09-13T18:45:26.254703+0000","last_active":"2024-09-13T18:49:46.629130+0000","last_peered":"2024-09-13T18:49:46.629130+0000","last_clean":"2024-09-13T18:49:46.629130+0000","last_became_active":"2024-09-13T18:45:26.253533+0000","last_became_peered":"2024-09-13T18:45:26.253533+0000","last_unstale":"2024-09-13T18:49:46.629130+0000","last_undegraded":"2024-09-13T18:49:46.629130+0000","last_fullsized":"2024-09-13T18:49:46.629130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'8","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:45.898750+0000","last_change":"2024-09-13T18:50:45.898842+0000","last_active":"2024-09-13T18:50:45.898750+0000","last_peered":"2024-09-13T18:50:45.898750+0000","last_clean":"2024-09-13T18:50:45.898750+0000","last_became_active":"2024-09-13T18:45:22.032109+0000","last_became_peered":"2024-09-13T18:45:22.032109+0000","last_unstale":"2024-09-13T18:50:45.898750+0000","last_undegraded":"2024-09-13T18:50:45.898750+0000","last_fullsized":"2024-09-13T18:50:45.898750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:50:45.898727+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:50:45.898727+0000","last_clean_scrub_stamp":"2024-09-13T18:50:45.898727+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:31.724813+0000","scrub_duration":0.002426119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:55.584004+0000","last_change":"2024-09-13T18:50:55.584126+0000","last_active":"2024-09-13T18:50:55.584004+0000","last_peered":"2024-09-13T18:50:55.584004+0000","last_clean":"2024-09-13T18:50:55.584004+0000","last_became_active":"2024-09-13T18:45:21.662344+0000","last_became_peered":"2024-09-13T18:45:21.662344+0000","last_unstale":"2024-09-13T18:50:55.584004+0000","last_undegraded":"2024-09-13T18:50:55.584004+0000","last_fullsized":"2024-09-13T18:50:55.584004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:55.583980+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:55.583980+0000","last_clean_scrub_stamp":"2024-09-13T18:50:55.583980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.452841+0000","scrub_duration":0.0022605720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.963487+0000","last_change":"2024-09-13T18:50:47.963592+0000","last_active":"2024-09-13T18:50:47.963487+0000","last_peered":"2024-09-13T18:50:47.963487+0000","last_clean":"2024-09-13T18:50:47.963487+0000","last_became_active":"2024-09-13T18:45:19.777172+0000","last_became_peered":"2024-09-13T18:45:19.777172+0000","last_unstale":"2024-09-13T18:50:47.963487+0000","last_undegraded":"2024-09-13T18:50:47.963487+0000","last_fullsized":"2024-09-13T18:50:47.963487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-09-13T18:50:47.963462+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-09-13T18:50:47.963462+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.963462+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:32.776049+0000","scrub_duration":0.0045475369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:36.629720+0000","last_change":"2024-09-13T18:45:26.253260+0000","last_active":"2024-09-13T18:49:36.629720+0000","last_peered":"2024-09-13T18:49:36.629720+0000","last_clean":"2024-09-13T18:49:36.629720+0000","last_became_active":"2024-09-13T18:45:26.252890+0000","last_became_peered":"2024-09-13T18:45:26.252890+0000","last_unstale":"2024-09-13T18:49:36.629720+0000","last_undegraded":"2024-09-13T18:49:36.629720+0000","last_fullsized":"2024-09-13T18:49:36.629720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.719303+0000","last_change":"2024-09-13T18:45:22.036446+0000","last_active":"2024-09-13T18:50:38.719303+0000","last_peered":"2024-09-13T18:50:38.719303+0000","last_clean":"2024-09-13T18:50:38.719303+0000","last_became_active":"2024-09-13T18:45:22.036153+0000","last_became_peered":"2024-09-13T18:45:22.036153+0000","last_unstale":"2024-09-13T18:50:38.719303+0000","last_undegraded":"2024-09-13T18:50:38.719303+0000","last_fullsized":"2024-09-13T18:50:38.719303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:43.612187+0000","last_change":"2024-09-13T18:50:43.612278+0000","last_active":"2024-09-13T18:50:43.612187+0000","last_peered":"2024-09-13T18:50:43.612187+0000","last_clean":"2024-09-13T18:50:43.612187+0000","last_became_active":"2024-09-13T18:45:21.665582+0000","last_became_peered":"2024-09-13T18:45:21.665582+0000","last_unstale":"2024-09-13T18:50:43.612187+0000","last_undegraded":"2024-09-13T18:50:43.612187+0000","last_fullsized":"2024-09-13T18:50:43.612187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:43.612164+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:43.612164+0000","last_clean_scrub_stamp":"2024-09-13T18:50:43.612164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:38.969573+0000","scrub_duration":0.0020111640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:46.630845+0000","last_change":"2024-09-13T18:45:26.250391+0000","last_active":"2024-09-13T18:49:46.630845+0000","last_peered":"2024-09-13T18:49:46.630845+0000","last_clean":"2024-09-13T18:49:46.630845+0000","last_became_active":"2024-09-13T18:45:26.249986+0000","last_became_peered":"2024-09-13T18:45:26.249986+0000","last_unstale":"2024-09-13T18:49:46.630845+0000","last_undegraded":"2024-09-13T18:49:46.630845+0000","last_fullsized":"2024-09-13T18:49:46.630845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.591676+0000","last_change":"2024-09-13T18:50:48.591788+0000","last_active":"2024-09-13T18:50:48.591676+0000","last_peered":"2024-09-13T18:50:48.591676+0000","last_clean":"2024-09-13T18:50:48.591676+0000","last_became_active":"2024-09-13T18:45:22.036523+0000","last_became_peered":"2024-09-13T18:45:22.036523+0000","last_unstale":"2024-09-13T18:50:48.591676+0000","last_undegraded":"2024-09-13T18:50:48.591676+0000","last_fullsized":"2024-09-13T18:50:48.591676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:48.591652+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:48.591652+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.591652+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:03.071671+0000","scrub_duration":0.001672523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.185355+0000","last_change":"2024-09-13T18:50:53.185451+0000","last_active":"2024-09-13T18:50:53.185355+0000","last_peered":"2024-09-13T18:50:53.185355+0000","last_clean":"2024-09-13T18:50:53.185355+0000","last_became_active":"2024-09-13T18:45:21.662405+0000","last_became_peered":"2024-09-13T18:45:21.662405+0000","last_unstale":"2024-09-13T18:50:53.185355+0000","last_undegraded":"2024-09-13T18:50:53.185355+0000","last_fullsized":"2024-09-13T18:50:53.185355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:53.185332+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:53.185332+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.185332+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:51.585557+0000","scrub_duration":0.0032345479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:56.630103+0000","last_change":"2024-09-13T18:45:26.055309+0000","last_active":"2024-09-13T18:49:56.630103+0000","last_peered":"2024-09-13T18:49:56.630103+0000","last_clean":"2024-09-13T18:49:56.630103+0000","last_became_active":"2024-09-13T18:45:26.054449+0000","last_became_peered":"2024-09-13T18:45:26.054449+0000","last_unstale":"2024-09-13T18:49:56.630103+0000","last_undegraded":"2024-09-13T18:49:56.630103+0000","last_fullsized":"2024-09-13T18:49:56.630103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'9","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:41.640193+0000","last_change":"2024-09-13T18:46:11.150958+0000","last_active":"2024-09-13T18:50:41.640193+0000","last_peered":"2024-09-13T18:50:41.640193+0000","last_clean":"2024-09-13T18:50:41.640193+0000","last_became_active":"2024-09-13T18:46:11.150605+0000","last_became_peered":"2024-09-13T18:46:11.150605+0000","last_unstale":"2024-09-13T18:50:41.640193+0000","last_undegraded":"2024-09-13T18:50:41.640193+0000","last_fullsized":"2024-09-13T18:50:41.640193+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:44.581874+0000","last_change":"2024-09-13T18:50:44.581951+0000","last_active":"2024-09-13T18:50:44.581874+0000","last_peered":"2024-09-13T18:50:44.581874+0000","last_clean":"2024-09-13T18:50:44.581874+0000","last_became_active":"2024-09-13T18:45:21.667340+0000","last_became_peered":"2024-09-13T18:45:21.667340+0000","last_unstale":"2024-09-13T18:50:44.581874+0000","last_undegraded":"2024-09-13T18:50:44.581874+0000","last_fullsized":"2024-09-13T18:50:44.581874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:44.581853+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:44.581853+0000","last_clean_scrub_stamp":"2024-09-13T18:50:44.581853+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:34.592117+0000","scrub_duration":0.002403325,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:46.630965+0000","last_change":"2024-09-13T18:45:26.250450+0000","last_active":"2024-09-13T18:49:46.630965+0000","last_peered":"2024-09-13T18:49:46.630965+0000","last_clean":"2024-09-13T18:49:46.630965+0000","last_became_active":"2024-09-13T18:45:26.250020+0000","last_became_peered":"2024-09-13T18:45:26.250020+0000","last_unstale":"2024-09-13T18:49:46.630965+0000","last_undegraded":"2024-09-13T18:49:46.630965+0000","last_fullsized":"2024-09-13T18:49:46.630965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.723195+0000","last_change":"2024-09-13T18:45:22.030584+0000","last_active":"2024-09-13T18:50:38.723195+0000","last_peered":"2024-09-13T18:50:38.723195+0000","last_clean":"2024-09-13T18:50:38.723195+0000","last_became_active":"2024-09-13T18:45:22.030275+0000","last_became_peered":"2024-09-13T18:45:22.030275+0000","last_unstale":"2024-09-13T18:50:38.723195+0000","last_undegraded":"2024-09-13T18:50:38.723195+0000","last_fullsized":"2024-09-13T18:50:38.723195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:46.747039+0000","last_change":"2024-09-13T18:50:46.747141+0000","last_active":"2024-09-13T18:50:46.747039+0000","last_peered":"2024-09-13T18:50:46.747039+0000","last_clean":"2024-09-13T18:50:46.747039+0000","last_became_active":"2024-09-13T18:45:21.662210+0000","last_became_peered":"2024-09-13T18:45:21.662210+0000","last_unstale":"2024-09-13T18:50:46.747039+0000","last_undegraded":"2024-09-13T18:50:46.747039+0000","last_fullsized":"2024-09-13T18:50:46.747039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:46.747013+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:46.747013+0000","last_clean_scrub_stamp":"2024-09-13T18:50:46.747013+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:01.227032+0000","scrub_duration":0.0037197200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:46.630291+0000","last_change":"2024-09-13T18:45:26.053575+0000","last_active":"2024-09-13T18:49:46.630291+0000","last_peered":"2024-09-13T18:49:46.630291+0000","last_clean":"2024-09-13T18:49:46.630291+0000","last_became_active":"2024-09-13T18:45:26.053195+0000","last_became_peered":"2024-09-13T18:45:26.053195+0000","last_unstale":"2024-09-13T18:49:46.630291+0000","last_undegraded":"2024-09-13T18:49:46.630291+0000","last_fullsized":"2024-09-13T18:49:46.630291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'7","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.723175+0000","last_change":"2024-09-13T18:45:22.031817+0000","last_active":"2024-09-13T18:50:38.723175+0000","last_peered":"2024-09-13T18:50:38.723175+0000","last_clean":"2024-09-13T18:50:38.723175+0000","last_became_active":"2024-09-13T18:45:22.031312+0000","last_became_peered":"2024-09-13T18:45:22.031312+0000","last_unstale":"2024-09-13T18:50:38.723175+0000","last_undegraded":"2024-09-13T18:50:38.723175+0000","last_fullsized":"2024-09-13T18:50:38.723175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:45.608053+0000","last_change":"2024-09-13T18:50:45.608171+0000","last_active":"2024-09-13T18:50:45.608053+0000","last_peered":"2024-09-13T18:50:45.608053+0000","last_clean":"2024-09-13T18:50:45.608053+0000","last_became_active":"2024-09-13T18:45:21.654844+0000","last_became_peered":"2024-09-13T18:45:21.654844+0000","last_unstale":"2024-09-13T18:50:45.608053+0000","last_undegraded":"2024-09-13T18:50:45.608053+0000","last_fullsized":"2024-09-13T18:50:45.608053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2024-09-13T18:50:45.608031+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2024-09-13T18:50:45.608031+0000","last_clean_scrub_stamp":"2024-09-13T18:50:45.608031+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:30.420618+0000","scrub_duration":0.0035795750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:16.632167+0000","last_change":"2024-09-13T18:45:26.056440+0000","last_active":"2024-09-13T18:50:16.632167+0000","last_peered":"2024-09-13T18:50:16.632167+0000","last_clean":"2024-09-13T18:50:16.632167+0000","last_became_active":"2024-09-13T18:45:26.055955+0000","last_became_peered":"2024-09-13T18:45:26.055955+0000","last_unstale":"2024-09-13T18:50:16.632167+0000","last_undegraded":"2024-09-13T18:50:16.632167+0000","last_fullsized":"2024-09-13T18:50:16.632167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'9","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.715574+0000","last_change":"2024-09-13T18:45:22.027821+0000","last_active":"2024-09-13T18:50:38.715574+0000","last_peered":"2024-09-13T18:50:38.715574+0000","last_clean":"2024-09-13T18:50:38.715574+0000","last_became_active":"2024-09-13T18:45:22.027172+0000","last_became_peered":"2024-09-13T18:45:22.027172+0000","last_unstale":"2024-09-13T18:50:38.715574+0000","last_undegraded":"2024-09-13T18:50:38.715574+0000","last_fullsized":"2024-09-13T18:50:38.715574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.190482+0000","last_change":"2024-09-13T18:50:49.190582+0000","last_active":"2024-09-13T18:50:49.190482+0000","last_peered":"2024-09-13T18:50:49.190482+0000","last_clean":"2024-09-13T18:50:49.190482+0000","last_became_active":"2024-09-13T18:45:21.663746+0000","last_became_peered":"2024-09-13T18:45:21.663746+0000","last_unstale":"2024-09-13T18:50:49.190482+0000","last_undegraded":"2024-09-13T18:50:49.190482+0000","last_fullsized":"2024-09-13T18:50:49.190482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:49.190457+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:49.190457+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.190457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:34.003043+0000","scrub_duration":0.0013612330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:16.632923+0000","last_change":"2024-09-13T18:45:26.253221+0000","last_active":"2024-09-13T18:50:16.632923+0000","last_peered":"2024-09-13T18:50:16.632923+0000","last_clean":"2024-09-13T18:50:16.632923+0000","last_became_active":"2024-09-13T18:45:26.252841+0000","last_became_peered":"2024-09-13T18:45:26.252841+0000","last_unstale":"2024-09-13T18:50:16.632923+0000","last_undegraded":"2024-09-13T18:50:16.632923+0000","last_fullsized":"2024-09-13T18:50:16.632923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'20","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.723798+0000","last_change":"2024-09-13T18:45:22.033554+0000","last_active":"2024-09-13T18:50:38.723798+0000","last_peered":"2024-09-13T18:50:38.723798+0000","last_clean":"2024-09-13T18:50:38.723798+0000","last_became_active":"2024-09-13T18:45:22.032862+0000","last_became_peered":"2024-09-13T18:45:22.032862+0000","last_unstale":"2024-09-13T18:50:38.723798+0000","last_undegraded":"2024-09-13T18:50:38.723798+0000","last_fullsized":"2024-09-13T18:50:38.723798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'8","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:01.632876+0000","last_change":"2024-09-13T18:45:21.668025+0000","last_active":"2024-09-13T18:50:01.632876+0000","last_peered":"2024-09-13T18:50:01.632876+0000","last_clean":"2024-09-13T18:50:01.632876+0000","last_became_active":"2024-09-13T18:45:21.667457+0000","last_became_peered":"2024-09-13T18:45:21.667457+0000","last_unstale":"2024-09-13T18:50:01.632876+0000","last_undegraded":"2024-09-13T18:50:01.632876+0000","last_fullsized":"2024-09-13T18:50:01.632876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:20.635139+0000","last_clean_scrub_stamp":"2024-09-13T18:45:20.635139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.631647+0000","last_change":"2024-09-13T18:45:26.250464+0000","last_active":"2024-09-13T18:50:06.631647+0000","last_peered":"2024-09-13T18:50:06.631647+0000","last_clean":"2024-09-13T18:50:06.631647+0000","last_became_active":"2024-09-13T18:45:26.250041+0000","last_became_peered":"2024-09-13T18:45:26.250041+0000","last_unstale":"2024-09-13T18:50:06.631647+0000","last_undegraded":"2024-09-13T18:50:06.631647+0000","last_fullsized":"2024-09-13T18:50:06.631647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:54.569727+0000","last_change":"2024-09-13T18:50:54.569854+0000","last_active":"2024-09-13T18:50:54.569727+0000","last_peered":"2024-09-13T18:50:54.569727+0000","last_clean":"2024-09-13T18:50:54.569727+0000","last_became_active":"2024-09-13T18:45:22.023882+0000","last_became_peered":"2024-09-13T18:45:22.023882+0000","last_unstale":"2024-09-13T18:50:54.569727+0000","last_undegraded":"2024-09-13T18:50:54.569727+0000","last_fullsized":"2024-09-13T18:50:54.569727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:54.569702+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:54.569702+0000","last_clean_scrub_stamp":"2024-09-13T18:50:54.569702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:45.447629+0000","scrub_duration":0.0017254239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.525039+0000","last_change":"2024-09-13T18:50:47.525152+0000","last_active":"2024-09-13T18:50:47.525039+0000","last_peered":"2024-09-13T18:50:47.525039+0000","last_clean":"2024-09-13T18:50:47.525039+0000","last_became_active":"2024-09-13T18:45:21.662980+0000","last_became_peered":"2024-09-13T18:45:21.662980+0000","last_unstale":"2024-09-13T18:50:47.525039+0000","last_undegraded":"2024-09-13T18:50:47.525039+0000","last_fullsized":"2024-09-13T18:50:47.525039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:47.525016+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:47.525016+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.525016+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:46.204054+0000","scrub_duration":0.0038760959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:16.634733+0000","last_change":"2024-09-13T18:45:26.253184+0000","last_active":"2024-09-13T18:50:16.634733+0000","last_peered":"2024-09-13T18:50:16.634733+0000","last_clean":"2024-09-13T18:50:16.634733+0000","last_became_active":"2024-09-13T18:45:26.252786+0000","last_became_peered":"2024-09-13T18:45:26.252786+0000","last_unstale":"2024-09-13T18:50:16.634733+0000","last_undegraded":"2024-09-13T18:50:16.634733+0000","last_fullsized":"2024-09-13T18:50:16.634733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.716515+0000","last_change":"2024-09-13T18:45:22.035052+0000","last_active":"2024-09-13T18:50:38.716515+0000","last_peered":"2024-09-13T18:50:38.716515+0000","last_clean":"2024-09-13T18:50:38.716515+0000","last_became_active":"2024-09-13T18:45:22.034765+0000","last_became_peered":"2024-09-13T18:45:22.034765+0000","last_unstale":"2024-09-13T18:50:38.716515+0000","last_undegraded":"2024-09-13T18:50:38.716515+0000","last_fullsized":"2024-09-13T18:50:38.716515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'104","reported_seq":135,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.203053+0000","last_change":"2024-09-13T18:50:47.203181+0000","last_active":"2024-09-13T18:50:47.203053+0000","last_peered":"2024-09-13T18:50:47.203053+0000","last_clean":"2024-09-13T18:50:47.203053+0000","last_became_active":"2024-09-13T18:45:21.667587+0000","last_became_peered":"2024-09-13T18:45:21.667587+0000","last_unstale":"2024-09-13T18:50:47.203053+0000","last_undegraded":"2024-09-13T18:50:47.203053+0000","last_fullsized":"2024-09-13T18:50:47.203053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'104","last_scrub_stamp":"2024-09-13T18:50:47.203030+0000","last_deep_scrub":"26'104","last_deep_scrub_stamp":"2024-09-13T18:50:47.203030+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.203030+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:42.560439+0000","scrub_duration":0.020188185000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":942437,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.636379+0000","last_change":"2024-09-13T18:45:26.052997+0000","last_active":"2024-09-13T18:50:06.636379+0000","last_peered":"2024-09-13T18:50:06.636379+0000","last_clean":"2024-09-13T18:50:06.636379+0000","last_became_active":"2024-09-13T18:45:26.052614+0000","last_became_peered":"2024-09-13T18:45:26.052614+0000","last_unstale":"2024-09-13T18:50:06.636379+0000","last_undegraded":"2024-09-13T18:50:06.636379+0000","last_fullsized":"2024-09-13T18:50:06.636379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'12","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:55.746737+0000","last_change":"2024-09-13T18:50:55.746842+0000","last_active":"2024-09-13T18:50:55.746737+0000","last_peered":"2024-09-13T18:50:55.746737+0000","last_clean":"2024-09-13T18:50:55.746737+0000","last_became_active":"2024-09-13T18:45:22.020461+0000","last_became_peered":"2024-09-13T18:45:22.020461+0000","last_unstale":"2024-09-13T18:50:55.746737+0000","last_undegraded":"2024-09-13T18:50:55.746737+0000","last_fullsized":"2024-09-13T18:50:55.746737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-09-13T18:50:55.746712+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-09-13T18:50:55.746712+0000","last_clean_scrub_stamp":"2024-09-13T18:50:55.746712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:46.624639+0000","scrub_duration":0.001397379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'30","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:59.319018+0000","last_change":"2024-09-13T18:50:59.319133+0000","last_active":"2024-09-13T18:50:59.319018+0000","last_peered":"2024-09-13T18:50:59.319018+0000","last_clean":"2024-09-13T18:50:59.319018+0000","last_became_active":"2024-09-13T18:45:21.663941+0000","last_became_peered":"2024-09-13T18:45:21.663941+0000","last_unstale":"2024-09-13T18:50:59.319018+0000","last_undegraded":"2024-09-13T18:50:59.319018+0000","last_fullsized":"2024-09-13T18:50:59.319018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'30","last_scrub_stamp":"2024-09-13T18:50:59.318992+0000","last_deep_scrub":"26'30","last_deep_scrub_stamp":"2024-09-13T18:50:59.318992+0000","last_clean_scrub_stamp":"2024-09-13T18:50:59.318992+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:23.332800+0000","scrub_duration":0.0038590220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.632927+0000","last_change":"2024-09-13T18:45:26.051227+0000","last_active":"2024-09-13T18:50:06.632927+0000","last_peered":"2024-09-13T18:50:06.632927+0000","last_clean":"2024-09-13T18:50:06.632927+0000","last_became_active":"2024-09-13T18:45:26.050757+0000","last_became_peered":"2024-09-13T18:45:26.050757+0000","last_unstale":"2024-09-13T18:50:06.632927+0000","last_undegraded":"2024-09-13T18:50:06.632927+0000","last_fullsized":"2024-09-13T18:50:06.632927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:57.568366+0000","last_change":"2024-09-13T18:50:57.568488+0000","last_active":"2024-09-13T18:50:57.568366+0000","last_peered":"2024-09-13T18:50:57.568366+0000","last_clean":"2024-09-13T18:50:57.568366+0000","last_became_active":"2024-09-13T18:45:22.024972+0000","last_became_peered":"2024-09-13T18:45:22.024972+0000","last_unstale":"2024-09-13T18:50:57.568366+0000","last_undegraded":"2024-09-13T18:50:57.568366+0000","last_fullsized":"2024-09-13T18:50:57.568366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:50:57.568343+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:50:57.568343+0000","last_clean_scrub_stamp":"2024-09-13T18:50:57.568343+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:11.127567+0000","scrub_duration":0.0016603970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'7","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:57.516274+0000","last_change":"2024-09-13T18:50:57.516394+0000","last_active":"2024-09-13T18:50:57.516274+0000","last_peered":"2024-09-13T18:50:57.516274+0000","last_clean":"2024-09-13T18:50:57.516274+0000","last_became_active":"2024-09-13T18:45:21.666516+0000","last_became_peered":"2024-09-13T18:45:21.666516+0000","last_unstale":"2024-09-13T18:50:57.516274+0000","last_undegraded":"2024-09-13T18:50:57.516274+0000","last_fullsized":"2024-09-13T18:50:57.516274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:57.516252+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:57.516252+0000","last_clean_scrub_stamp":"2024-09-13T18:50:57.516252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:48.394179+0000","scrub_duration":0.001474358,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.631530+0000","last_change":"2024-09-13T18:45:26.057746+0000","last_active":"2024-09-13T18:50:06.631530+0000","last_peered":"2024-09-13T18:50:06.631530+0000","last_clean":"2024-09-13T18:50:06.631530+0000","last_became_active":"2024-09-13T18:45:26.057285+0000","last_became_peered":"2024-09-13T18:45:26.057285+0000","last_unstale":"2024-09-13T18:50:06.631530+0000","last_undegraded":"2024-09-13T18:50:06.631530+0000","last_fullsized":"2024-09-13T18:50:06.631530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:50.580387+0000","last_change":"2024-09-13T18:50:50.580490+0000","last_active":"2024-09-13T18:50:50.580387+0000","last_peered":"2024-09-13T18:50:50.580387+0000","last_clean":"2024-09-13T18:50:50.580387+0000","last_became_active":"2024-09-13T18:45:22.031341+0000","last_became_peered":"2024-09-13T18:45:22.031341+0000","last_unstale":"2024-09-13T18:50:50.580387+0000","last_undegraded":"2024-09-13T18:50:50.580387+0000","last_fullsized":"2024-09-13T18:50:50.580387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:50.580363+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:50.580363+0000","last_clean_scrub_stamp":"2024-09-13T18:50:50.580363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:36.406449+0000","scrub_duration":0.0013669019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:52.209692+0000","last_change":"2024-09-13T18:50:52.209792+0000","last_active":"2024-09-13T18:50:52.209692+0000","last_peered":"2024-09-13T18:50:52.209692+0000","last_clean":"2024-09-13T18:50:52.209692+0000","last_became_active":"2024-09-13T18:45:21.664401+0000","last_became_peered":"2024-09-13T18:45:21.664401+0000","last_unstale":"2024-09-13T18:50:52.209692+0000","last_undegraded":"2024-09-13T18:50:52.209692+0000","last_fullsized":"2024-09-13T18:50:52.209692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:52.209668+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:52.209668+0000","last_clean_scrub_stamp":"2024-09-13T18:50:52.209668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:51.968472+0000","scrub_duration":0.001304253,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.631569+0000","last_change":"2024-09-13T18:45:26.254041+0000","last_active":"2024-09-13T18:50:06.631569+0000","last_peered":"2024-09-13T18:50:06.631569+0000","last_clean":"2024-09-13T18:50:06.631569+0000","last_became_active":"2024-09-13T18:45:26.253579+0000","last_became_peered":"2024-09-13T18:45:26.253579+0000","last_unstale":"2024-09-13T18:50:06.631569+0000","last_undegraded":"2024-09-13T18:50:06.631569+0000","last_fullsized":"2024-09-13T18:50:06.631569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:26.626734+0000","last_change":"2024-09-13T18:45:26.253962+0000","last_active":"2024-09-13T18:49:26.626734+0000","last_peered":"2024-09-13T18:49:26.626734+0000","last_clean":"2024-09-13T18:49:26.626734+0000","last_became_active":"2024-09-13T18:45:26.252979+0000","last_became_peered":"2024-09-13T18:45:26.252979+0000","last_unstale":"2024-09-13T18:49:26.626734+0000","last_undegraded":"2024-09-13T18:49:26.626734+0000","last_fullsized":"2024-09-13T18:49:26.626734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'11","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:44.232716+0000","last_change":"2024-09-13T18:50:44.232835+0000","last_active":"2024-09-13T18:50:44.232716+0000","last_peered":"2024-09-13T18:50:44.232716+0000","last_clean":"2024-09-13T18:50:44.232716+0000","last_became_active":"2024-09-13T18:45:22.030453+0000","last_became_peered":"2024-09-13T18:45:22.030453+0000","last_unstale":"2024-09-13T18:50:44.232716+0000","last_undegraded":"2024-09-13T18:50:44.232716+0000","last_fullsized":"2024-09-13T18:50:44.232716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:50:44.232671+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:50:44.232671+0000","last_clean_scrub_stamp":"2024-09-13T18:50:44.232671+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:43.991475+0000","scrub_duration":0.0014480770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:00.539547+0000","last_change":"2024-09-13T18:51:00.539669+0000","last_active":"2024-09-13T18:51:00.539547+0000","last_peered":"2024-09-13T18:51:00.539547+0000","last_clean":"2024-09-13T18:51:00.539547+0000","last_became_active":"2024-09-13T18:45:21.664571+0000","last_became_peered":"2024-09-13T18:45:21.664571+0000","last_unstale":"2024-09-13T18:51:00.539547+0000","last_undegraded":"2024-09-13T18:51:00.539547+0000","last_fullsized":"2024-09-13T18:51:00.539547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:00.539521+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:00.539521+0000","last_clean_scrub_stamp":"2024-09-13T18:51:00.539521+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:14.098745+0000","scrub_duration":0.001600532,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:36.629766+0000","last_change":"2024-09-13T18:45:26.054920+0000","last_active":"2024-09-13T18:49:36.629766+0000","last_peered":"2024-09-13T18:49:36.629766+0000","last_clean":"2024-09-13T18:49:36.629766+0000","last_became_active":"2024-09-13T18:45:26.054510+0000","last_became_peered":"2024-09-13T18:45:26.054510+0000","last_unstale":"2024-09-13T18:49:36.629766+0000","last_undegraded":"2024-09-13T18:49:36.629766+0000","last_fullsized":"2024-09-13T18:49:36.629766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:46.866498+0000","last_change":"2024-09-13T18:50:46.866594+0000","last_active":"2024-09-13T18:50:46.866498+0000","last_peered":"2024-09-13T18:50:46.866498+0000","last_clean":"2024-09-13T18:50:46.866498+0000","last_became_active":"2024-09-13T18:45:22.028062+0000","last_became_peered":"2024-09-13T18:45:22.028062+0000","last_unstale":"2024-09-13T18:50:46.866498+0000","last_undegraded":"2024-09-13T18:50:46.866498+0000","last_fullsized":"2024-09-13T18:50:46.866498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:46.866474+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:46.866474+0000","last_clean_scrub_stamp":"2024-09-13T18:50:46.866474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:08.205344+0000","scrub_duration":0.0015895569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:52.891038+0000","last_change":"2024-09-13T18:50:52.891140+0000","last_active":"2024-09-13T18:50:52.891038+0000","last_peered":"2024-09-13T18:50:52.891038+0000","last_clean":"2024-09-13T18:50:52.891038+0000","last_became_active":"2024-09-13T18:45:21.672470+0000","last_became_peered":"2024-09-13T18:45:21.672470+0000","last_unstale":"2024-09-13T18:50:52.891038+0000","last_undegraded":"2024-09-13T18:50:52.891038+0000","last_fullsized":"2024-09-13T18:50:52.891038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:50:52.891015+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:50:52.891015+0000","last_clean_scrub_stamp":"2024-09-13T18:50:52.891015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:43.768942+0000","scrub_duration":0.001947734,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.207387+0000","last_change":"2024-09-13T18:50:51.207489+0000","last_active":"2024-09-13T18:50:51.207387+0000","last_peered":"2024-09-13T18:50:51.207387+0000","last_clean":"2024-09-13T18:50:51.207387+0000","last_became_active":"2024-09-13T18:45:21.659912+0000","last_became_peered":"2024-09-13T18:45:21.659912+0000","last_unstale":"2024-09-13T18:50:51.207387+0000","last_undegraded":"2024-09-13T18:50:51.207387+0000","last_fullsized":"2024-09-13T18:50:51.207387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:51.207360+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:51.207360+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.207360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:13.344926+0000","scrub_duration":0.0013910459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'7","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720951+0000","last_change":"2024-09-13T18:45:22.024571+0000","last_active":"2024-09-13T18:50:38.720951+0000","last_peered":"2024-09-13T18:50:38.720951+0000","last_clean":"2024-09-13T18:50:38.720951+0000","last_became_active":"2024-09-13T18:45:22.024305+0000","last_became_peered":"2024-09-13T18:45:22.024305+0000","last_unstale":"2024-09-13T18:50:38.720951+0000","last_undegraded":"2024-09-13T18:50:38.720951+0000","last_fullsized":"2024-09-13T18:50:38.720951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.634442+0000","last_change":"2024-09-13T18:50:53.634577+0000","last_active":"2024-09-13T18:50:53.634442+0000","last_peered":"2024-09-13T18:50:53.634442+0000","last_clean":"2024-09-13T18:50:53.634442+0000","last_became_active":"2024-09-13T18:45:26.055794+0000","last_became_peered":"2024-09-13T18:45:26.055794+0000","last_unstale":"2024-09-13T18:50:53.634442+0000","last_undegraded":"2024-09-13T18:50:53.634442+0000","last_fullsized":"2024-09-13T18:50:53.634442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:53.634420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:53.634420+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.634420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:29.073415+0000","scrub_duration":0.0018457149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:00.849167+0000","last_change":"2024-09-13T18:51:00.849278+0000","last_active":"2024-09-13T18:51:00.849167+0000","last_peered":"2024-09-13T18:51:00.849167+0000","last_clean":"2024-09-13T18:51:00.849167+0000","last_became_active":"2024-09-13T18:45:21.670083+0000","last_became_peered":"2024-09-13T18:45:21.670083+0000","last_unstale":"2024-09-13T18:51:00.849167+0000","last_undegraded":"2024-09-13T18:51:00.849167+0000","last_fullsized":"2024-09-13T18:51:00.849167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:51:00.849140+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:51:00.849140+0000","last_clean_scrub_stamp":"2024-09-13T18:51:00.849140+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:09.479543+0000","scrub_duration":0.0018400650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.752295+0000","last_change":"2024-09-13T18:50:53.752405+0000","last_active":"2024-09-13T18:50:53.752295+0000","last_peered":"2024-09-13T18:50:53.752295+0000","last_clean":"2024-09-13T18:50:53.752295+0000","last_became_active":"2024-09-13T18:45:22.021496+0000","last_became_peered":"2024-09-13T18:45:22.021496+0000","last_unstale":"2024-09-13T18:50:53.752295+0000","last_undegraded":"2024-09-13T18:50:53.752295+0000","last_fullsized":"2024-09-13T18:50:53.752295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:53.752270+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:53.752270+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.752270+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:49.621131+0000","scrub_duration":0.0017525349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:26.634136+0000","last_change":"2024-09-13T18:45:26.050478+0000","last_active":"2024-09-13T18:50:26.634136+0000","last_peered":"2024-09-13T18:50:26.634136+0000","last_clean":"2024-09-13T18:50:26.634136+0000","last_became_active":"2024-09-13T18:45:26.050095+0000","last_became_peered":"2024-09-13T18:45:26.050095+0000","last_unstale":"2024-09-13T18:50:26.634136+0000","last_undegraded":"2024-09-13T18:50:26.634136+0000","last_fullsized":"2024-09-13T18:50:26.634136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'8","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.715712+0000","last_change":"2024-09-13T18:45:22.028025+0000","last_active":"2024-09-13T18:50:38.715712+0000","last_peered":"2024-09-13T18:50:38.715712+0000","last_clean":"2024-09-13T18:50:38.715712+0000","last_became_active":"2024-09-13T18:45:22.027528+0000","last_became_peered":"2024-09-13T18:45:22.027528+0000","last_unstale":"2024-09-13T18:50:38.715712+0000","last_undegraded":"2024-09-13T18:50:38.715712+0000","last_fullsized":"2024-09-13T18:50:38.715712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'8","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.607793+0000","last_change":"2024-09-13T18:50:48.607907+0000","last_active":"2024-09-13T18:50:48.607793+0000","last_peered":"2024-09-13T18:50:48.607793+0000","last_clean":"2024-09-13T18:50:48.607793+0000","last_became_active":"2024-09-13T18:45:22.024369+0000","last_became_peered":"2024-09-13T18:45:22.024369+0000","last_unstale":"2024-09-13T18:50:48.607793+0000","last_undegraded":"2024-09-13T18:50:48.607793+0000","last_fullsized":"2024-09-13T18:50:48.607793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:50:48.607766+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:50:48.607766+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.607766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:48.366570+0000","scrub_duration":0.0018146099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'6","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720435+0000","last_change":"2024-09-13T18:45:22.035861+0000","last_active":"2024-09-13T18:50:38.720435+0000","last_peered":"2024-09-13T18:50:38.720435+0000","last_clean":"2024-09-13T18:50:38.720435+0000","last_became_active":"2024-09-13T18:45:22.034318+0000","last_became_peered":"2024-09-13T18:45:22.034318+0000","last_unstale":"2024-09-13T18:50:38.720435+0000","last_undegraded":"2024-09-13T18:50:38.720435+0000","last_fullsized":"2024-09-13T18:50:38.720435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:44.490559+0000","last_change":"2024-09-13T18:50:44.490637+0000","last_active":"2024-09-13T18:50:44.490559+0000","last_peered":"2024-09-13T18:50:44.490559+0000","last_clean":"2024-09-13T18:50:44.490559+0000","last_became_active":"2024-09-13T18:45:22.032851+0000","last_became_peered":"2024-09-13T18:45:22.032851+0000","last_unstale":"2024-09-13T18:50:44.490559+0000","last_undegraded":"2024-09-13T18:50:44.490559+0000","last_fullsized":"2024-09-13T18:50:44.490559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:44.490540+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:44.490540+0000","last_clean_scrub_stamp":"2024-09-13T18:50:44.490540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:19.929534+0000","scrub_duration":0.0012625819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.703471+0000","last_change":"2024-09-13T18:45:22.033500+0000","last_active":"2024-09-13T18:50:38.703471+0000","last_peered":"2024-09-13T18:50:38.703471+0000","last_clean":"2024-09-13T18:50:38.703471+0000","last_became_active":"2024-09-13T18:45:22.033156+0000","last_became_peered":"2024-09-13T18:45:22.033156+0000","last_unstale":"2024-09-13T18:50:38.703471+0000","last_undegraded":"2024-09-13T18:50:38.703471+0000","last_fullsized":"2024-09-13T18:50:38.703471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'6","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.711698+0000","last_change":"2024-09-13T18:45:22.029906+0000","last_active":"2024-09-13T18:50:38.711698+0000","last_peered":"2024-09-13T18:50:38.711698+0000","last_clean":"2024-09-13T18:50:38.711698+0000","last_became_active":"2024-09-13T18:45:22.029654+0000","last_became_peered":"2024-09-13T18:45:22.029654+0000","last_unstale":"2024-09-13T18:50:38.711698+0000","last_undegraded":"2024-09-13T18:50:38.711698+0000","last_fullsized":"2024-09-13T18:50:38.711698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'13","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.289706+0000","last_change":"2024-09-13T18:51:01.289810+0000","last_active":"2024-09-13T18:51:01.289706+0000","last_peered":"2024-09-13T18:51:01.289706+0000","last_clean":"2024-09-13T18:51:01.289706+0000","last_became_active":"2024-09-13T18:45:22.028031+0000","last_became_peered":"2024-09-13T18:45:22.028031+0000","last_unstale":"2024-09-13T18:51:01.289706+0000","last_undegraded":"2024-09-13T18:51:01.289706+0000","last_fullsized":"2024-09-13T18:51:01.289706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-09-13T18:51:01.289682+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-09-13T18:51:01.289682+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.289682+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:15.769701+0000","scrub_duration":0.0012523860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'7","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.706782+0000","last_change":"2024-09-13T18:45:22.032816+0000","last_active":"2024-09-13T18:50:38.706782+0000","last_peered":"2024-09-13T18:50:38.706782+0000","last_clean":"2024-09-13T18:50:38.706782+0000","last_became_active":"2024-09-13T18:45:22.032561+0000","last_became_peered":"2024-09-13T18:45:22.032561+0000","last_unstale":"2024-09-13T18:50:38.706782+0000","last_undegraded":"2024-09-13T18:50:38.706782+0000","last_fullsized":"2024-09-13T18:50:38.706782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'9","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.718556+0000","last_change":"2024-09-13T18:45:22.036615+0000","last_active":"2024-09-13T18:50:38.718556+0000","last_peered":"2024-09-13T18:50:38.718556+0000","last_clean":"2024-09-13T18:50:38.718556+0000","last_became_active":"2024-09-13T18:45:22.036380+0000","last_became_peered":"2024-09-13T18:45:22.036380+0000","last_unstale":"2024-09-13T18:50:38.718556+0000","last_undegraded":"2024-09-13T18:50:38.718556+0000","last_fullsized":"2024-09-13T18:50:38.718556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:43.876477+0000","last_change":"2024-09-13T18:50:43.876558+0000","last_active":"2024-09-13T18:50:43.876477+0000","last_peered":"2024-09-13T18:50:43.876477+0000","last_clean":"2024-09-13T18:50:43.876477+0000","last_became_active":"2024-09-13T18:45:22.034646+0000","last_became_peered":"2024-09-13T18:45:22.034646+0000","last_unstale":"2024-09-13T18:50:43.876477+0000","last_undegraded":"2024-09-13T18:50:43.876477+0000","last_fullsized":"2024-09-13T18:50:43.876477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:50:43.876456+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:50:43.876456+0000","last_clean_scrub_stamp":"2024-09-13T18:50:43.876456+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.356475+0000","scrub_duration":0.0016307299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'13","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.716811+0000","last_change":"2024-09-13T18:45:22.029195+0000","last_active":"2024-09-13T18:50:38.716811+0000","last_peered":"2024-09-13T18:50:38.716811+0000","last_clean":"2024-09-13T18:50:38.716811+0000","last_became_active":"2024-09-13T18:45:22.028430+0000","last_became_peered":"2024-09-13T18:45:22.028430+0000","last_unstale":"2024-09-13T18:50:38.716811+0000","last_undegraded":"2024-09-13T18:50:38.716811+0000","last_fullsized":"2024-09-13T18:50:38.716811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'11","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.715718+0000","last_change":"2024-09-13T18:45:22.019974+0000","last_active":"2024-09-13T18:50:38.715718+0000","last_peered":"2024-09-13T18:50:38.715718+0000","last_clean":"2024-09-13T18:50:38.715718+0000","last_became_active":"2024-09-13T18:45:22.019733+0000","last_became_peered":"2024-09-13T18:45:22.019733+0000","last_unstale":"2024-09-13T18:50:38.715718+0000","last_undegraded":"2024-09-13T18:50:38.715718+0000","last_fullsized":"2024-09-13T18:50:38.715718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'8","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.717984+0000","last_change":"2024-09-13T18:45:22.016110+0000","last_active":"2024-09-13T18:50:38.717984+0000","last_peered":"2024-09-13T18:50:38.717984+0000","last_clean":"2024-09-13T18:50:38.717984+0000","last_became_active":"2024-09-13T18:45:22.015868+0000","last_became_peered":"2024-09-13T18:45:22.015868+0000","last_unstale":"2024-09-13T18:50:38.717984+0000","last_undegraded":"2024-09-13T18:50:38.717984+0000","last_fullsized":"2024-09-13T18:50:38.717984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:46.911973+0000","last_change":"2024-09-13T18:50:46.912064+0000","last_active":"2024-09-13T18:50:46.911973+0000","last_peered":"2024-09-13T18:50:46.911973+0000","last_clean":"2024-09-13T18:50:46.911973+0000","last_became_active":"2024-09-13T18:45:22.034019+0000","last_became_peered":"2024-09-13T18:45:22.034019+0000","last_unstale":"2024-09-13T18:50:46.911973+0000","last_undegraded":"2024-09-13T18:50:46.911973+0000","last_fullsized":"2024-09-13T18:50:46.911973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:46.911953+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:46.911953+0000","last_clean_scrub_stamp":"2024-09-13T18:50:46.911953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:36.922217+0000","scrub_duration":0.0017146489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'12","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.657819+0000","last_change":"2024-09-13T18:50:49.657990+0000","last_active":"2024-09-13T18:50:49.657819+0000","last_peered":"2024-09-13T18:50:49.657819+0000","last_clean":"2024-09-13T18:50:49.657819+0000","last_became_active":"2024-09-13T18:45:22.020415+0000","last_became_peered":"2024-09-13T18:45:22.020415+0000","last_unstale":"2024-09-13T18:50:49.657819+0000","last_undegraded":"2024-09-13T18:50:49.657819+0000","last_fullsized":"2024-09-13T18:50:49.657819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-09-13T18:50:49.657795+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-09-13T18:50:49.657795+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.657795+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:11.513081+0000","scrub_duration":0.0020089489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'6","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.706902+0000","last_change":"2024-09-13T18:45:22.035941+0000","last_active":"2024-09-13T18:50:38.706902+0000","last_peered":"2024-09-13T18:50:38.706902+0000","last_clean":"2024-09-13T18:50:38.706902+0000","last_became_active":"2024-09-13T18:45:22.035491+0000","last_became_peered":"2024-09-13T18:45:22.035491+0000","last_unstale":"2024-09-13T18:50:38.706902+0000","last_undegraded":"2024-09-13T18:50:38.706902+0000","last_fullsized":"2024-09-13T18:50:38.706902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'11","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:57.604594+0000","last_change":"2024-09-13T18:50:57.604705+0000","last_active":"2024-09-13T18:50:57.604594+0000","last_peered":"2024-09-13T18:50:57.604594+0000","last_clean":"2024-09-13T18:50:57.604594+0000","last_became_active":"2024-09-13T18:46:11.146859+0000","last_became_peered":"2024-09-13T18:46:11.146859+0000","last_unstale":"2024-09-13T18:50:57.604594+0000","last_undegraded":"2024-09-13T18:50:57.604594+0000","last_fullsized":"2024-09-13T18:50:57.604594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:50:57.604573+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:50:57.604573+0000","last_clean_scrub_stamp":"2024-09-13T18:50:57.604573+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:18.943443+0000","scrub_duration":0.001354744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"26'6","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.707380+0000","last_change":"2024-09-13T18:45:22.021298+0000","last_active":"2024-09-13T18:50:38.707380+0000","last_peered":"2024-09-13T18:50:38.707380+0000","last_clean":"2024-09-13T18:50:38.707380+0000","last_became_active":"2024-09-13T18:45:22.021042+0000","last_became_peered":"2024-09-13T18:45:22.021042+0000","last_unstale":"2024-09-13T18:50:38.707380+0000","last_undegraded":"2024-09-13T18:50:38.707380+0000","last_fullsized":"2024-09-13T18:50:38.707380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.715318+0000","last_change":"2024-09-13T18:45:22.021628+0000","last_active":"2024-09-13T18:50:38.715318+0000","last_peered":"2024-09-13T18:50:38.715318+0000","last_clean":"2024-09-13T18:50:38.715318+0000","last_became_active":"2024-09-13T18:45:22.021366+0000","last_became_peered":"2024-09-13T18:45:22.021366+0000","last_unstale":"2024-09-13T18:50:38.715318+0000","last_undegraded":"2024-09-13T18:50:38.715318+0000","last_fullsized":"2024-09-13T18:50:38.715318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'10","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:50.854309+0000","last_change":"2024-09-13T18:50:50.854426+0000","last_active":"2024-09-13T18:50:50.854309+0000","last_peered":"2024-09-13T18:50:50.854309+0000","last_clean":"2024-09-13T18:50:50.854309+0000","last_became_active":"2024-09-13T18:45:22.028594+0000","last_became_peered":"2024-09-13T18:45:22.028594+0000","last_unstale":"2024-09-13T18:50:50.854309+0000","last_undegraded":"2024-09-13T18:50:50.854309+0000","last_fullsized":"2024-09-13T18:50:50.854309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-09-13T18:50:50.854284+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-09-13T18:50:50.854284+0000","last_clean_scrub_stamp":"2024-09-13T18:50:50.854284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:46.723145+0000","scrub_duration":0.0018955790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:58.758344+0000","last_change":"2024-09-13T18:50:58.758450+0000","last_active":"2024-09-13T18:50:58.758344+0000","last_peered":"2024-09-13T18:50:58.758344+0000","last_clean":"2024-09-13T18:50:58.758344+0000","last_became_active":"2024-09-13T18:45:22.016731+0000","last_became_peered":"2024-09-13T18:45:22.016731+0000","last_unstale":"2024-09-13T18:50:58.758344+0000","last_undegraded":"2024-09-13T18:50:58.758344+0000","last_fullsized":"2024-09-13T18:50:58.758344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:58.758323+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:58.758323+0000","last_clean_scrub_stamp":"2024-09-13T18:50:58.758323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:12.317546+0000","scrub_duration":0.0014195729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'6","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.714990+0000","last_change":"2024-09-13T18:45:22.028649+0000","last_active":"2024-09-13T18:50:38.714990+0000","last_peered":"2024-09-13T18:50:38.714990+0000","last_clean":"2024-09-13T18:50:38.714990+0000","last_became_active":"2024-09-13T18:45:22.027899+0000","last_became_peered":"2024-09-13T18:45:22.027899+0000","last_unstale":"2024-09-13T18:50:38.714990+0000","last_undegraded":"2024-09-13T18:50:38.714990+0000","last_fullsized":"2024-09-13T18:50:38.714990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'16","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.714412+0000","last_change":"2024-09-13T18:45:22.024291+0000","last_active":"2024-09-13T18:50:38.714412+0000","last_peered":"2024-09-13T18:50:38.714412+0000","last_clean":"2024-09-13T18:50:38.714412+0000","last_became_active":"2024-09-13T18:45:22.024014+0000","last_became_peered":"2024-09-13T18:45:22.024014+0000","last_unstale":"2024-09-13T18:50:38.714412+0000","last_undegraded":"2024-09-13T18:50:38.714412+0000","last_fullsized":"2024-09-13T18:50:38.714412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'9","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.719401+0000","last_change":"2024-09-13T18:45:22.036551+0000","last_active":"2024-09-13T18:50:38.719401+0000","last_peered":"2024-09-13T18:50:38.719401+0000","last_clean":"2024-09-13T18:50:38.719401+0000","last_became_active":"2024-09-13T18:45:22.036269+0000","last_became_peered":"2024-09-13T18:45:22.036269+0000","last_unstale":"2024-09-13T18:50:38.719401+0000","last_undegraded":"2024-09-13T18:50:38.719401+0000","last_fullsized":"2024-09-13T18:50:38.719401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.719595+0000","last_change":"2024-09-13T18:45:22.032392+0000","last_active":"2024-09-13T18:50:38.719595+0000","last_peered":"2024-09-13T18:50:38.719595+0000","last_clean":"2024-09-13T18:50:38.719595+0000","last_became_active":"2024-09-13T18:45:22.027605+0000","last_became_peered":"2024-09-13T18:45:22.027605+0000","last_unstale":"2024-09-13T18:50:38.719595+0000","last_undegraded":"2024-09-13T18:50:38.719595+0000","last_fullsized":"2024-09-13T18:50:38.719595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.713788+0000","last_change":"2024-09-13T18:45:22.029307+0000","last_active":"2024-09-13T18:50:38.713788+0000","last_peered":"2024-09-13T18:50:38.713788+0000","last_clean":"2024-09-13T18:50:38.713788+0000","last_became_active":"2024-09-13T18:45:22.029018+0000","last_became_peered":"2024-09-13T18:45:22.029018+0000","last_unstale":"2024-09-13T18:50:38.713788+0000","last_undegraded":"2024-09-13T18:50:38.713788+0000","last_fullsized":"2024-09-13T18:50:38.713788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.714656+0000","last_change":"2024-09-13T18:45:22.029061+0000","last_active":"2024-09-13T18:50:38.714656+0000","last_peered":"2024-09-13T18:50:38.714656+0000","last_clean":"2024-09-13T18:50:38.714656+0000","last_became_active":"2024-09-13T18:45:22.028758+0000","last_became_peered":"2024-09-13T18:45:22.028758+0000","last_unstale":"2024-09-13T18:50:38.714656+0000","last_undegraded":"2024-09-13T18:50:38.714656+0000","last_fullsized":"2024-09-13T18:50:38.714656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.720434+0000","last_change":"2024-09-13T18:45:22.029690+0000","last_active":"2024-09-13T18:50:38.720434+0000","last_peered":"2024-09-13T18:50:38.720434+0000","last_clean":"2024-09-13T18:50:38.720434+0000","last_became_active":"2024-09-13T18:45:22.029403+0000","last_became_peered":"2024-09-13T18:45:22.029403+0000","last_unstale":"2024-09-13T18:50:38.720434+0000","last_undegraded":"2024-09-13T18:50:38.720434+0000","last_fullsized":"2024-09-13T18:50:38.720434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'6","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.718363+0000","last_change":"2024-09-13T18:45:22.038483+0000","last_active":"2024-09-13T18:50:38.718363+0000","last_peered":"2024-09-13T18:50:38.718363+0000","last_clean":"2024-09-13T18:50:38.718363+0000","last_became_active":"2024-09-13T18:45:22.036877+0000","last_became_peered":"2024-09-13T18:45:22.036877+0000","last_unstale":"2024-09-13T18:50:38.718363+0000","last_undegraded":"2024-09-13T18:50:38.718363+0000","last_fullsized":"2024-09-13T18:50:38.718363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.715229+0000","last_change":"2024-09-13T18:45:22.022846+0000","last_active":"2024-09-13T18:50:38.715229+0000","last_peered":"2024-09-13T18:50:38.715229+0000","last_clean":"2024-09-13T18:50:38.715229+0000","last_became_active":"2024-09-13T18:45:22.022618+0000","last_became_peered":"2024-09-13T18:45:22.022618+0000","last_unstale":"2024-09-13T18:50:38.715229+0000","last_undegraded":"2024-09-13T18:50:38.715229+0000","last_fullsized":"2024-09-13T18:50:38.715229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.714306+0000","last_change":"2024-09-13T18:45:22.028545+0000","last_active":"2024-09-13T18:50:38.714306+0000","last_peered":"2024-09-13T18:50:38.714306+0000","last_clean":"2024-09-13T18:50:38.714306+0000","last_became_active":"2024-09-13T18:45:22.028291+0000","last_became_peered":"2024-09-13T18:45:22.028291+0000","last_unstale":"2024-09-13T18:50:38.714306+0000","last_undegraded":"2024-09-13T18:50:38.714306+0000","last_fullsized":"2024-09-13T18:50:38.714306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'10","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.717579+0000","last_change":"2024-09-13T18:45:22.034460+0000","last_active":"2024-09-13T18:50:38.717579+0000","last_peered":"2024-09-13T18:50:38.717579+0000","last_clean":"2024-09-13T18:50:38.717579+0000","last_became_active":"2024-09-13T18:45:22.033974+0000","last_became_peered":"2024-09-13T18:45:22.033974+0000","last_unstale":"2024-09-13T18:50:38.717579+0000","last_undegraded":"2024-09-13T18:50:38.717579+0000","last_fullsized":"2024-09-13T18:50:38.717579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":954260,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":272,"num_write_kb":1081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":1908520,"data_compressed":245052,"data_compressed_allocated":294912,"data_compressed_original":1441792,"omap_allocated":0,"internal_metadata":0},"log_size":353,"ondisk_log_size":353,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":704313,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.42399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.754},"last":0.499},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.46999999999999997},"min":{"1min":0.36199999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.65400000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49099999999999999,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70799999999999996,"5min":0.749,"15min":0.749},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.432,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67300000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66200000000000003,"5min":0.755,"15min":0.755},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.48099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56200000000000006}]},{"osd":4,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.47099999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47299999999999998,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60399999999999998,"5min":0.748,"15min":0.748},"last":0.439}]},{"osd":5,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.52100000000000002},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.54300000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73099999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.57199999999999995},"min":{"1min":0.41199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.52900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":655360,"data_stored":1055800,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.67600000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.61799999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.746,"15min":0.746},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67700000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70699999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.496}]},{"osd":4,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47299999999999998},"min":{"1min":0.33100000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63600000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.42799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.441},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.41399999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.40000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":113453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.32600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.626,"5min":0.87,"15min":0.87},"last":0.41099999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78700000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67600000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.433}]},{"osd":2,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54000000000000004,"15min":0.56299999999999994},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.55200000000000005},"min":{"1min":0.36899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.503}]},{"osd":3,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76100000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.33000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33800000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59999999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.307}]},{"osd":6,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71999999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.40200000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.33700000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68600000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.39900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.38600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":113489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.377,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.67400000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.499,"15min":0.499},"min":{"1min":0.35099999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.60999999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.255,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66500000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.56200000000000006},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.435,"5min":0.25,"15min":0.25},"max":{"1min":0.747,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.41199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.40400000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59099999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47599999999999998,"15min":0.497},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.442}]},{"osd":6,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72299999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.497},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":1.075,"15min":1.075},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":667648,"data_stored":1066825,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.63600000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.375,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.498,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.40600000000000003},"min":{"1min":0.251,"5min":0.223,"15min":0.223},"max":{"1min":0.753,"5min":1.121,"15min":1.121},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67200000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.432}]},{"osd":2,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.46800000000000003},"min":{"1min":0.314,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45700000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61299999999999999,"15min":0.58999999999999997},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59699999999999998,"15min":0.623},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.624}]},{"osd":6,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81000000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73199999999999998,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63,"15min":0.67300000000000004},"min":{"1min":0.41899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.63700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":290816,"data_stored":124388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.35899999999999999},"min":{"1min":0.20899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70899999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.495}]},{"osd":1,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40600000000000003,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54300000000000004,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.441,"5min":0.432,"15min":0.41199999999999998},"min":{"1min":0.27400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40400000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.437},"min":{"1min":0.33000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.438},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70499999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77100000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.627},"min":{"1min":0.46500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76700000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.82099999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.45600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.995,"15min":0.995},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.79500000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63400000000000001,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83699999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.45100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83299999999999996,"5min":0.874,"15min":0.874},"last":0.82499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":113523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.23599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.56200000000000006,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36399999999999999,"15min":0.34799999999999998},"min":{"1min":0.23499999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.22500000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.52900000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.435,"15min":0.42299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.57499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.38800000000000001},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38900000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.74299999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79700000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.47799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72499999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74199999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.625}]},{"osd":6,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.432},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77000000000000002,"5min":0.872,"15min":0.872},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80200000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":356352,"data_stored":704369,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39900000000000002,"15min":0.42299999999999999},"min":{"1min":0.23300000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.629,"5min":1.496,"15min":1.496},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.40300000000000002},"min":{"1min":0.252,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56699999999999995,"5min":1.024,"15min":1.024},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.26900000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.76300000000000001,"5min":1.518,"15min":1.518},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.29399999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83699999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.30599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":1.294,"15min":1.294},"last":0.38},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.64800000000000002},"min":{"1min":0.439,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91500000000000004,"5min":1.198,"15min":1.198},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73899999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.50600000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.69399999999999995},"min":{"1min":0.42499999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61699999999999999,"15min":0.64800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96899999999999997,"5min":1.143,"15min":1.143},"last":0.42699999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60799999999999998,"15min":0.65100000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.72699999999999998,"5min":1.391,"15min":1.391},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66100000000000003,"15min":0.72899999999999998},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84999999999999998,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.496}]},{"osd":7,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67900000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63,"15min":0.68000000000000005},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.82099999999999995,"5min":1.363,"15min":1.363},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":11025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":953462,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":942437,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:51:05.566 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.566 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.566 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.566 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.566 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.567 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.567 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.567 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.567 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.567 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.567 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.567 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.568 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.568 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.568 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.568 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.568 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.568 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.568 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.568 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.569 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.569 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.569 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.569 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.569 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.569 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.569 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.569 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.570 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.570 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.570 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.570 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.570 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.570 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.570 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.570 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.570 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-13T18:45:20.635139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.571 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.571 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.571 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.571 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.571 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.571 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.571 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.571 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.572 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.572 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.572 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.572 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.572 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.572 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.572 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.573 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.573 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.573 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.573 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.573 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.573 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.573 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.573 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.574 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.574 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.574 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.574 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.574 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.574 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.574 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.574 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.574 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.574 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.575 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:05.575 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:51:08.051 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:51:08.054 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:51:25.576 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:51:25.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.689+0000 7f513f87d640 1 Processor -- start 2024-09-13T18:51:25.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.689+0000 7f513f87d640 1 -- start start 2024-09-13T18:51:25.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.690+0000 7f513f87d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f51380aed30 0x7f5138143b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.690+0000 7f513f87d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5138144070 0x7f51381546c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.690+0000 7f513f87d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51380b0470 con 0x7f51380b0090 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.690+0000 7f513f87d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5138144500 con 0x7f51380aed30 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.690+0000 7f513f87d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51380b1340 con 0x7f5138144070 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.690+0000 7f513de1a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5138144070 0x7f51381546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.690+0000 7f513ce18640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f51380aed30 0x7f5138143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.690+0000 7f513de1a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5138144070 0x7f51381546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.29:56060/0 (socket says 172.21.15.29:56060) 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.690+0000 7f513d619640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f51380b0090 0x7f513814a590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.29:56648/0 (socket says 172.21.15.29:56648) 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.691+0000 7f513de1a640 1 -- 172.21.15.29:0/1231806989 learned_addr learned my addr 172.21.15.29:0/1231806989 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.691+0000 7f513ce18640 1 -- 172.21.15.29:0/1231806989 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5138144070 msgr2=0x7f51381546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.691+0000 7f513ce18640 1 --2- 172.21.15.29:0/1231806989 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5138144070 0x7f51381546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.691+0000 7f513ce18640 1 -- 172.21.15.29:0/1231806989 >> v1:172.21.15.96:6789/0 conn(0x7f51380b0090 legacy=0x7f513814a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.691+0000 7f513ce18640 1 -- 172.21.15.29:0/1231806989 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380af4c0 con 0x7f51380aed30 2024-09-13T18:51:25.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.691+0000 7f512ffff640 1 -- 172.21.15.29:0/1231806989 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307675349 0 0) 0x7f51380b0470 con 0x7f51380b0090 2024-09-13T18:51:25.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.691+0000 7f513de1a640 1 --2- 172.21.15.29:0/1231806989 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5138144070 0x7f51381546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:25.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.692+0000 7f513ce18640 1 --2- 172.21.15.29:0/1231806989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380aed30 0x7f5138143b30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f51280097a0 tx=0x7f512802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3114c45a507bc74e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:25.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.692+0000 7f512ffff640 1 -- 172.21.15.29:0/1231806989 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512802ae50 con 0x7f51380aed30 2024-09-13T18:51:25.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.692+0000 7f512ffff640 1 -- 172.21.15.29:0/1231806989 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5128032440 con 0x7f51380aed30 2024-09-13T18:51:25.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.692+0000 7f512ffff640 1 -- 172.21.15.29:0/1231806989 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51280327d0 con 0x7f51380aed30 2024-09-13T18:51:25.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.692+0000 7f513f87d640 1 -- 172.21.15.29:0/1231806989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380aed30 msgr2=0x7f5138143b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:25.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.692+0000 7f513f87d640 1 --2- 172.21.15.29:0/1231806989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380aed30 0x7f5138143b30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f51280097a0 tx=0x7f512802a100 comp rx=0 tx=0).stop 2024-09-13T18:51:25.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.692+0000 7f513f87d640 1 -- 172.21.15.29:0/1231806989 shutdown_connections 2024-09-13T18:51:25.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.692+0000 7f513f87d640 1 --2- 172.21.15.29:0/1231806989 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5138144070 0x7f51381546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:25.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.692+0000 7f513f87d640 1 --2- 172.21.15.29:0/1231806989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51380aed30 0x7f5138143b30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:25.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.692+0000 7f513f87d640 1 -- 172.21.15.29:0/1231806989 >> 172.21.15.29:0/1231806989 conn(0x7f513806a890 msgr2=0x7f51380b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:25.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.693+0000 7f513f87d640 1 -- 172.21.15.29:0/1231806989 shutdown_connections 2024-09-13T18:51:25.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.693+0000 7f513f87d640 1 -- 172.21.15.29:0/1231806989 wait complete. 2024-09-13T18:51:25.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.694+0000 7f513f87d640 1 Processor -- start 2024-09-13T18:51:25.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.694+0000 7f513f87d640 1 -- start start 2024-09-13T18:51:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.694+0000 7f513f87d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51380aed30 0x7f513806f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.694+0000 7f513f87d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51380b0090 0x7f513806e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.694+0000 7f513f87d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5138144070 0x7f51381df9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.694+0000 7f513f87d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5138070fa0 con 0x7f51380aed30 2024-09-13T18:51:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.694+0000 7f513f87d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513806fc90 con 0x7f5138144070 2024-09-13T18:51:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.694+0000 7f513f87d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5138071210 con 0x7f51380b0090 2024-09-13T18:51:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.694+0000 7f513d619640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51380aed30 0x7f513806f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.694+0000 7f513d619640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51380aed30 0x7f513806f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56548/0 (socket says 172.21.15.29:56548) 2024-09-13T18:51:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.694+0000 7f513d619640 1 -- 172.21.15.29:0/3159719221 learned_addr learned my addr 172.21.15.29:0/3159719221 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:51:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f513ce18640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51380b0090 0x7f513806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f513de1a640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5138144070 0x7f51381df9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f513d619640 1 -- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51380b0090 msgr2=0x7f513806e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f513d619640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51380b0090 0x7f513806e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f513d619640 1 -- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5138144070 msgr2=0x7f51381df9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f513d619640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5138144070 0x7f51381df9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f513d619640 1 -- 172.21.15.29:0/3159719221 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5130009b30 con 0x7f51380aed30 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f513ce18640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51380b0090 0x7f513806e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f513de1a640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5138144070 0x7f51381df9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f513d619640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51380aed30 0x7f513806f5b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f513400c4d0 tx=0x7f513400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f512dffb640 1 -- 172.21.15.29:0/3159719221 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51340074e0 con 0x7f51380aed30 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f512dffb640 1 -- 172.21.15.29:0/3159719221 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5134007660 con 0x7f51380aed30 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f513f87d640 1 -- 172.21.15.29:0/3159719221 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5128009400 con 0x7f51380aed30 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.695+0000 7f512dffb640 1 -- 172.21.15.29:0/3159719221 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134004a20 con 0x7f51380aed30 2024-09-13T18:51:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.696+0000 7f513f87d640 1 -- 172.21.15.29:0/3159719221 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51381df560 con 0x7f51380aed30 2024-09-13T18:51:25.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.697+0000 7f513f87d640 1 -- 172.21.15.29:0/3159719221 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5138070170 con 0x7f51380aed30 2024-09-13T18:51:25.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.697+0000 7f512dffb640 1 -- 172.21.15.29:0/3159719221 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5134004b80 con 0x7f51380aed30 2024-09-13T18:51:25.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.697+0000 7f512dffb640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f511c06ac30 0x7f511c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:25.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.697+0000 7f512dffb640 1 -- 172.21.15.29:0/3159719221 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5134088aa0 con 0x7f51380aed30 2024-09-13T18:51:25.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.698+0000 7f513ce18640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f511c06ac30 0x7f511c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:25.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.698+0000 7f513ce18640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f511c06ac30 0x7f511c06d0f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5128034000 tx=0x7f512802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:25.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.702+0000 7f512dffb640 1 -- 172.21.15.29:0/3159719221 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5138070170 con 0x7f51380aed30 2024-09-13T18:51:25.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.872+0000 7f513f87d640 1 -- 172.21.15.29:0/3159719221 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51380b3050 con 0x7f511c06ac30 2024-09-13T18:51:25.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.882+0000 7f512dffb640 1 -- 172.21.15.29:0/3159719221 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370830 (secure 0 0 0) 0x7f51380b3050 con 0x7f511c06ac30 2024-09-13T18:51:25.889 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:51:25.891 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-13T18:51:25.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.885+0000 7f513f87d640 1 -- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f511c06ac30 msgr2=0x7f511c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:25.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.885+0000 7f513f87d640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f511c06ac30 0x7f511c06d0f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5128034000 tx=0x7f512802e000 comp rx=0 tx=0).stop 2024-09-13T18:51:25.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.885+0000 7f513f87d640 1 -- 172.21.15.29:0/3159719221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51380aed30 msgr2=0x7f513806f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:25.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.885+0000 7f513f87d640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51380aed30 0x7f513806f5b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f513400c4d0 tx=0x7f513400c990 comp rx=0 tx=0).stop 2024-09-13T18:51:25.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.885+0000 7f513f87d640 1 -- 172.21.15.29:0/3159719221 shutdown_connections 2024-09-13T18:51:25.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.885+0000 7f513f87d640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f511c06ac30 0x7f511c06d0f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:25.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.885+0000 7f513f87d640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5138144070 0x7f51381df9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:25.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.885+0000 7f513f87d640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51380b0090 0x7f513806e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:25.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.885+0000 7f513f87d640 1 --2- 172.21.15.29:0/3159719221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51380aed30 0x7f513806f5b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:25.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.885+0000 7f513f87d640 1 -- 172.21.15.29:0/3159719221 >> 172.21.15.29:0/3159719221 conn(0x7f513806a890 msgr2=0x7f51380b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:25.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.885+0000 7f513f87d640 1 -- 172.21.15.29:0/3159719221 shutdown_connections 2024-09-13T18:51:25.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:25.885+0000 7f513f87d640 1 -- 172.21.15.29:0/3159719221 wait complete. 2024-09-13T18:51:25.899 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-13T18:51:25.683122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1544628,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":156,"num_read_kb":140,"num_write":437,"num_write_kb":3501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":981,"ondisk_log_size":981,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235616,"kb_used_data":3104,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739104,"statfs":{"total":773094113280,"available":772852842496,"internally_reserved":0,"allocated":3178496,"data_stored":3996160,"data_compressed":310028,"data_compressed_allocated":385024,"data_compressed_original":2588672,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003245"},"pg_stats":[{"pgid":"2.1f","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.536651+0000","last_change":"2024-09-13T18:50:48.536748+0000","last_active":"2024-09-13T18:50:48.536651+0000","last_peered":"2024-09-13T18:50:48.536651+0000","last_clean":"2024-09-13T18:50:48.536651+0000","last_became_active":"2024-09-13T18:45:21.667985+0000","last_became_peered":"2024-09-13T18:45:21.667985+0000","last_unstale":"2024-09-13T18:50:48.536651+0000","last_undegraded":"2024-09-13T18:50:48.536651+0000","last_fullsized":"2024-09-13T18:50:48.536651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:48.536623+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:48.536623+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.536623+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:34.362710+0000","scrub_duration":0.0039049509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'7","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.710579+0000","last_change":"2024-09-13T18:45:22.034389+0000","last_active":"2024-09-13T18:50:38.710579+0000","last_peered":"2024-09-13T18:50:38.710579+0000","last_clean":"2024-09-13T18:50:38.710579+0000","last_became_active":"2024-09-13T18:45:22.034125+0000","last_became_peered":"2024-09-13T18:45:22.034125+0000","last_unstale":"2024-09-13T18:50:38.710579+0000","last_undegraded":"2024-09-13T18:50:38.710579+0000","last_fullsized":"2024-09-13T18:50:38.710579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:16.632775+0000","last_change":"2024-09-13T18:45:26.253118+0000","last_active":"2024-09-13T18:50:16.632775+0000","last_peered":"2024-09-13T18:50:16.632775+0000","last_clean":"2024-09-13T18:50:16.632775+0000","last_became_active":"2024-09-13T18:45:26.252747+0000","last_became_peered":"2024-09-13T18:45:26.252747+0000","last_unstale":"2024-09-13T18:50:16.632775+0000","last_undegraded":"2024-09-13T18:50:16.632775+0000","last_fullsized":"2024-09-13T18:50:16.632775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:55.823028+0000","last_change":"2024-09-13T18:50:55.823028+0000","last_active":"2024-09-13T18:50:55.823028+0000","last_peered":"2024-09-13T18:50:55.823028+0000","last_clean":"2024-09-13T18:50:55.823028+0000","last_became_active":"2024-09-13T18:45:21.666398+0000","last_became_peered":"2024-09-13T18:45:21.666398+0000","last_unstale":"2024-09-13T18:50:55.823028+0000","last_undegraded":"2024-09-13T18:50:55.823028+0000","last_fullsized":"2024-09-13T18:50:55.823028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:55.822888+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:55.822888+0000","last_clean_scrub_stamp":"2024-09-13T18:50:55.822888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:09.382112+0000","scrub_duration":0.001447315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'8","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:03.501369+0000","last_change":"2024-09-13T18:51:03.501489+0000","last_active":"2024-09-13T18:51:03.501369+0000","last_peered":"2024-09-13T18:51:03.501369+0000","last_clean":"2024-09-13T18:51:03.501369+0000","last_became_active":"2024-09-13T18:45:22.024424+0000","last_became_peered":"2024-09-13T18:45:22.024424+0000","last_unstale":"2024-09-13T18:51:03.501369+0000","last_undegraded":"2024-09-13T18:51:03.501369+0000","last_fullsized":"2024-09-13T18:51:03.501369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:03.501346+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:03.501346+0000","last_clean_scrub_stamp":"2024-09-13T18:51:03.501346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:30.116732+0000","scrub_duration":0.001917361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:04.839924+0000","last_change":"2024-09-13T18:51:04.840041+0000","last_active":"2024-09-13T18:51:04.839924+0000","last_peered":"2024-09-13T18:51:04.839924+0000","last_clean":"2024-09-13T18:51:04.839924+0000","last_became_active":"2024-09-13T18:45:26.049414+0000","last_became_peered":"2024-09-13T18:45:26.049414+0000","last_unstale":"2024-09-13T18:51:04.839924+0000","last_undegraded":"2024-09-13T18:51:04.839924+0000","last_fullsized":"2024-09-13T18:51:04.839924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:04.839896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:04.839896+0000","last_clean_scrub_stamp":"2024-09-13T18:51:04.839896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:31.455281+0000","scrub_duration":0.0018258759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:00.920349+0000","last_change":"2024-09-13T18:51:00.920443+0000","last_active":"2024-09-13T18:51:00.920349+0000","last_peered":"2024-09-13T18:51:00.920349+0000","last_clean":"2024-09-13T18:51:00.920349+0000","last_became_active":"2024-09-13T18:45:21.667602+0000","last_became_peered":"2024-09-13T18:45:21.667602+0000","last_unstale":"2024-09-13T18:51:00.920349+0000","last_undegraded":"2024-09-13T18:51:00.920349+0000","last_fullsized":"2024-09-13T18:51:00.920349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:00.920324+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:00.920324+0000","last_clean_scrub_stamp":"2024-09-13T18:51:00.920324+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:59.320550+0000","scrub_duration":0.0027812430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'8","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.721087+0000","last_change":"2024-09-13T18:45:22.036952+0000","last_active":"2024-09-13T18:50:38.721087+0000","last_peered":"2024-09-13T18:50:38.721087+0000","last_clean":"2024-09-13T18:50:38.721087+0000","last_became_active":"2024-09-13T18:45:22.035790+0000","last_became_peered":"2024-09-13T18:45:22.035790+0000","last_unstale":"2024-09-13T18:50:38.721087+0000","last_undegraded":"2024-09-13T18:50:38.721087+0000","last_fullsized":"2024-09-13T18:50:38.721087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:26.635645+0000","last_change":"2024-09-13T18:45:26.052333+0000","last_active":"2024-09-13T18:50:26.635645+0000","last_peered":"2024-09-13T18:50:26.635645+0000","last_clean":"2024-09-13T18:50:26.635645+0000","last_became_active":"2024-09-13T18:45:26.051873+0000","last_became_peered":"2024-09-13T18:45:26.051873+0000","last_unstale":"2024-09-13T18:50:26.635645+0000","last_undegraded":"2024-09-13T18:50:26.635645+0000","last_fullsized":"2024-09-13T18:50:26.635645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.931169+0000","last_change":"2024-09-13T18:50:51.931266+0000","last_active":"2024-09-13T18:50:51.931169+0000","last_peered":"2024-09-13T18:50:51.931169+0000","last_clean":"2024-09-13T18:50:51.931169+0000","last_became_active":"2024-09-13T18:45:21.669622+0000","last_became_peered":"2024-09-13T18:45:21.669622+0000","last_unstale":"2024-09-13T18:50:51.931169+0000","last_undegraded":"2024-09-13T18:50:51.931169+0000","last_fullsized":"2024-09-13T18:50:51.931169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:51.931146+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:51.931146+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.931146+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:13.786431+0000","scrub_duration":0.0028583060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'14","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:13.440684+0000","last_change":"2024-09-13T18:51:13.440828+0000","last_active":"2024-09-13T18:51:13.440684+0000","last_peered":"2024-09-13T18:51:13.440684+0000","last_clean":"2024-09-13T18:51:13.440684+0000","last_became_active":"2024-09-13T18:45:22.034431+0000","last_became_peered":"2024-09-13T18:45:22.034431+0000","last_unstale":"2024-09-13T18:51:13.440684+0000","last_undegraded":"2024-09-13T18:51:13.440684+0000","last_fullsized":"2024-09-13T18:51:13.440684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-09-13T18:51:13.440661+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-09-13T18:51:13.440661+0000","last_clean_scrub_stamp":"2024-09-13T18:51:13.440661+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:58.336878+0000","scrub_duration":0.001315384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:12.893027+0000","last_change":"2024-09-13T18:51:12.893188+0000","last_active":"2024-09-13T18:51:12.893027+0000","last_peered":"2024-09-13T18:51:12.893027+0000","last_clean":"2024-09-13T18:51:12.893027+0000","last_became_active":"2024-09-13T18:45:26.052441+0000","last_became_peered":"2024-09-13T18:45:26.052441+0000","last_unstale":"2024-09-13T18:51:12.893027+0000","last_undegraded":"2024-09-13T18:51:12.893027+0000","last_fullsized":"2024-09-13T18:51:12.893027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:12.893003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:12.893003+0000","last_clean_scrub_stamp":"2024-09-13T18:51:12.893003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:15.183557+0000","scrub_duration":0.0022650729999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.253089+0000","last_change":"2024-09-13T18:50:53.253185+0000","last_active":"2024-09-13T18:50:53.253089+0000","last_peered":"2024-09-13T18:50:53.253089+0000","last_clean":"2024-09-13T18:50:53.253089+0000","last_became_active":"2024-09-13T18:45:22.015758+0000","last_became_peered":"2024-09-13T18:45:22.015758+0000","last_unstale":"2024-09-13T18:50:53.253089+0000","last_undegraded":"2024-09-13T18:50:53.253089+0000","last_fullsized":"2024-09-13T18:50:53.253089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:53.253065+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:53.253065+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.253065+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:15.108350+0000","scrub_duration":0.001311446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:58.974434+0000","last_change":"2024-09-13T18:50:58.974551+0000","last_active":"2024-09-13T18:50:58.974434+0000","last_peered":"2024-09-13T18:50:58.974434+0000","last_clean":"2024-09-13T18:50:58.974434+0000","last_became_active":"2024-09-13T18:45:21.672388+0000","last_became_peered":"2024-09-13T18:45:21.672388+0000","last_unstale":"2024-09-13T18:50:58.974434+0000","last_undegraded":"2024-09-13T18:50:58.974434+0000","last_fullsized":"2024-09-13T18:50:58.974434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:50:58.974396+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:50:58.974396+0000","last_clean_scrub_stamp":"2024-09-13T18:50:58.974396+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:13.454414+0000","scrub_duration":0.0026098369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:56.631766+0000","last_change":"2024-09-13T18:46:11.150163+0000","last_active":"2024-09-13T18:49:56.631766+0000","last_peered":"2024-09-13T18:49:56.631766+0000","last_clean":"2024-09-13T18:49:56.631766+0000","last_became_active":"2024-09-13T18:46:11.149623+0000","last_became_peered":"2024-09-13T18:46:11.149623+0000","last_unstale":"2024-09-13T18:49:56.631766+0000","last_undegraded":"2024-09-13T18:49:56.631766+0000","last_fullsized":"2024-09-13T18:49:56.631766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'9","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.714924+0000","last_change":"2024-09-13T18:45:22.028858+0000","last_active":"2024-09-13T18:50:38.714924+0000","last_peered":"2024-09-13T18:50:38.714924+0000","last_clean":"2024-09-13T18:50:38.714924+0000","last_became_active":"2024-09-13T18:45:22.028336+0000","last_became_peered":"2024-09-13T18:45:22.028336+0000","last_unstale":"2024-09-13T18:50:38.714924+0000","last_undegraded":"2024-09-13T18:50:38.714924+0000","last_fullsized":"2024-09-13T18:50:38.714924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.227304+0000","last_change":"2024-09-13T18:50:51.227414+0000","last_active":"2024-09-13T18:50:51.227304+0000","last_peered":"2024-09-13T18:50:51.227304+0000","last_clean":"2024-09-13T18:50:51.227304+0000","last_became_active":"2024-09-13T18:45:21.667625+0000","last_became_peered":"2024-09-13T18:45:21.667625+0000","last_unstale":"2024-09-13T18:50:51.227304+0000","last_undegraded":"2024-09-13T18:50:51.227304+0000","last_fullsized":"2024-09-13T18:50:51.227304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:51.227280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:51.227280+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.227280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:05.707299+0000","scrub_duration":0.001427123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:56.631721+0000","last_change":"2024-09-13T18:45:26.050576+0000","last_active":"2024-09-13T18:49:56.631721+0000","last_peered":"2024-09-13T18:49:56.631721+0000","last_clean":"2024-09-13T18:49:56.631721+0000","last_became_active":"2024-09-13T18:45:26.049129+0000","last_became_peered":"2024-09-13T18:45:26.049129+0000","last_unstale":"2024-09-13T18:49:56.631721+0000","last_undegraded":"2024-09-13T18:49:56.631721+0000","last_fullsized":"2024-09-13T18:49:56.631721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:54.649259+0000","last_change":"2024-09-13T18:50:54.649378+0000","last_active":"2024-09-13T18:50:54.649259+0000","last_peered":"2024-09-13T18:50:54.649259+0000","last_clean":"2024-09-13T18:50:54.649259+0000","last_became_active":"2024-09-13T18:46:11.149036+0000","last_became_peered":"2024-09-13T18:46:11.149036+0000","last_unstale":"2024-09-13T18:50:54.649259+0000","last_undegraded":"2024-09-13T18:50:54.649259+0000","last_fullsized":"2024-09-13T18:50:54.649259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:54.649236+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:54.649236+0000","last_clean_scrub_stamp":"2024-09-13T18:50:54.649236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:09.129255+0000","scrub_duration":0.001480161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:45.276110+0000","last_change":"2024-09-13T18:50:45.276213+0000","last_active":"2024-09-13T18:50:45.276110+0000","last_peered":"2024-09-13T18:50:45.276110+0000","last_clean":"2024-09-13T18:50:45.276110+0000","last_became_active":"2024-09-13T18:45:21.668242+0000","last_became_peered":"2024-09-13T18:45:21.668242+0000","last_unstale":"2024-09-13T18:50:45.276110+0000","last_undegraded":"2024-09-13T18:50:45.276110+0000","last_fullsized":"2024-09-13T18:50:45.276110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:45.276090+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:45.276090+0000","last_clean_scrub_stamp":"2024-09-13T18:50:45.276090+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:32.233036+0000","scrub_duration":0.001724461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:56.635478+0000","last_change":"2024-09-13T18:45:26.255263+0000","last_active":"2024-09-13T18:49:56.635478+0000","last_peered":"2024-09-13T18:49:56.635478+0000","last_clean":"2024-09-13T18:49:56.635478+0000","last_became_active":"2024-09-13T18:45:26.254886+0000","last_became_peered":"2024-09-13T18:45:26.254886+0000","last_unstale":"2024-09-13T18:49:56.635478+0000","last_undegraded":"2024-09-13T18:49:56.635478+0000","last_fullsized":"2024-09-13T18:49:56.635478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.741575+0000","last_change":"2024-09-13T18:50:48.741674+0000","last_active":"2024-09-13T18:50:48.741575+0000","last_peered":"2024-09-13T18:50:48.741575+0000","last_clean":"2024-09-13T18:50:48.741575+0000","last_became_active":"2024-09-13T18:45:22.027835+0000","last_became_peered":"2024-09-13T18:45:22.027835+0000","last_unstale":"2024-09-13T18:50:48.741575+0000","last_undegraded":"2024-09-13T18:50:48.741575+0000","last_fullsized":"2024-09-13T18:50:48.741575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:48.741554+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:48.741554+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.741554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:34.567640+0000","scrub_duration":0.0017755049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.907598+0000","last_change":"2024-09-13T18:51:01.907727+0000","last_active":"2024-09-13T18:51:01.907598+0000","last_peered":"2024-09-13T18:51:01.907598+0000","last_clean":"2024-09-13T18:51:01.907598+0000","last_became_active":"2024-09-13T18:45:21.668765+0000","last_became_peered":"2024-09-13T18:45:21.668765+0000","last_unstale":"2024-09-13T18:51:01.907598+0000","last_undegraded":"2024-09-13T18:51:01.907598+0000","last_fullsized":"2024-09-13T18:51:01.907598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:51:01.907558+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:51:01.907558+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.907558+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:56.338211+0000","scrub_duration":0.0021193679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:03.860763+0000","last_change":"2024-09-13T18:51:03.860929+0000","last_active":"2024-09-13T18:51:03.860763+0000","last_peered":"2024-09-13T18:51:03.860763+0000","last_clean":"2024-09-13T18:51:03.860763+0000","last_became_active":"2024-09-13T18:45:26.049408+0000","last_became_peered":"2024-09-13T18:45:26.049408+0000","last_unstale":"2024-09-13T18:51:03.860763+0000","last_undegraded":"2024-09-13T18:51:03.860763+0000","last_fullsized":"2024-09-13T18:51:03.860763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:03.860740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:03.860740+0000","last_clean_scrub_stamp":"2024-09-13T18:51:03.860740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:12.491143+0000","scrub_duration":0.0020454399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:52.560168+0000","last_change":"2024-09-13T18:50:52.560268+0000","last_active":"2024-09-13T18:50:52.560168+0000","last_peered":"2024-09-13T18:50:52.560168+0000","last_clean":"2024-09-13T18:50:52.560168+0000","last_became_active":"2024-09-13T18:45:22.021976+0000","last_became_peered":"2024-09-13T18:45:22.021976+0000","last_unstale":"2024-09-13T18:50:52.560168+0000","last_undegraded":"2024-09-13T18:50:52.560168+0000","last_fullsized":"2024-09-13T18:50:52.560168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:52.560142+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:52.560142+0000","last_clean_scrub_stamp":"2024-09-13T18:50:52.560142+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:48.429003+0000","scrub_duration":0.0016215960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.229700+0000","last_change":"2024-09-13T18:50:48.229823+0000","last_active":"2024-09-13T18:50:48.229700+0000","last_peered":"2024-09-13T18:50:48.229700+0000","last_clean":"2024-09-13T18:50:48.229700+0000","last_became_active":"2024-09-13T18:45:21.667680+0000","last_became_peered":"2024-09-13T18:45:21.667680+0000","last_unstale":"2024-09-13T18:50:48.229700+0000","last_undegraded":"2024-09-13T18:50:48.229700+0000","last_fullsized":"2024-09-13T18:50:48.229700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:48.229676+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:48.229676+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.229676+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:38.239939+0000","scrub_duration":0.0024150930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:15.833886+0000","last_change":"2024-09-13T18:51:15.834041+0000","last_active":"2024-09-13T18:51:15.833886+0000","last_peered":"2024-09-13T18:51:15.833886+0000","last_clean":"2024-09-13T18:51:15.833886+0000","last_became_active":"2024-09-13T18:45:26.254662+0000","last_became_peered":"2024-09-13T18:45:26.254662+0000","last_unstale":"2024-09-13T18:51:15.833886+0000","last_undegraded":"2024-09-13T18:51:15.833886+0000","last_fullsized":"2024-09-13T18:51:15.833886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:15.833861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:15.833861+0000","last_clean_scrub_stamp":"2024-09-13T18:51:15.833861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:39.007889+0000","scrub_duration":0.0017530099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.804602+0000","last_change":"2024-09-13T18:51:01.804727+0000","last_active":"2024-09-13T18:51:01.804602+0000","last_peered":"2024-09-13T18:51:01.804602+0000","last_clean":"2024-09-13T18:51:01.804602+0000","last_became_active":"2024-09-13T18:45:22.026419+0000","last_became_peered":"2024-09-13T18:45:22.026419+0000","last_unstale":"2024-09-13T18:51:01.804602+0000","last_undegraded":"2024-09-13T18:51:01.804602+0000","last_fullsized":"2024-09-13T18:51:01.804602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:01.804577+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:01.804577+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.804577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:28.419963+0000","scrub_duration":0.001887402,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'37","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:54.195045+0000","last_change":"2024-09-13T18:50:54.195184+0000","last_active":"2024-09-13T18:50:54.195045+0000","last_peered":"2024-09-13T18:50:54.195045+0000","last_clean":"2024-09-13T18:50:54.195045+0000","last_became_active":"2024-09-13T18:45:21.664066+0000","last_became_peered":"2024-09-13T18:45:21.664066+0000","last_unstale":"2024-09-13T18:50:54.195045+0000","last_undegraded":"2024-09-13T18:50:54.195045+0000","last_fullsized":"2024-09-13T18:50:54.195045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'37","last_scrub_stamp":"2024-09-13T18:50:54.195018+0000","last_deep_scrub":"26'37","last_deep_scrub_stamp":"2024-09-13T18:50:54.195018+0000","last_clean_scrub_stamp":"2024-09-13T18:50:54.195018+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:48.625670+0000","scrub_duration":0.0018610250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:26.627621+0000","last_change":"2024-09-13T18:45:26.253888+0000","last_active":"2024-09-13T18:49:26.627621+0000","last_peered":"2024-09-13T18:49:26.627621+0000","last_clean":"2024-09-13T18:49:26.627621+0000","last_became_active":"2024-09-13T18:45:26.253488+0000","last_became_peered":"2024-09-13T18:45:26.253488+0000","last_unstale":"2024-09-13T18:49:26.627621+0000","last_undegraded":"2024-09-13T18:49:26.627621+0000","last_fullsized":"2024-09-13T18:49:26.627621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'11","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:07.332343+0000","last_change":"2024-09-13T18:51:07.332449+0000","last_active":"2024-09-13T18:51:07.332343+0000","last_peered":"2024-09-13T18:51:07.332343+0000","last_clean":"2024-09-13T18:51:07.332343+0000","last_became_active":"2024-09-13T18:45:22.022628+0000","last_became_peered":"2024-09-13T18:45:22.022628+0000","last_unstale":"2024-09-13T18:51:07.332343+0000","last_undegraded":"2024-09-13T18:51:07.332343+0000","last_fullsized":"2024-09-13T18:51:07.332343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:51:07.332316+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:51:07.332316+0000","last_clean_scrub_stamp":"2024-09-13T18:51:07.332316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:15.962718+0000","scrub_duration":0.0015008759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:50.944196+0000","last_change":"2024-09-13T18:50:50.944283+0000","last_active":"2024-09-13T18:50:50.944196+0000","last_peered":"2024-09-13T18:50:50.944196+0000","last_clean":"2024-09-13T18:50:50.944196+0000","last_became_active":"2024-09-13T18:45:21.668645+0000","last_became_peered":"2024-09-13T18:45:21.668645+0000","last_unstale":"2024-09-13T18:50:50.944196+0000","last_undegraded":"2024-09-13T18:50:50.944196+0000","last_fullsized":"2024-09-13T18:50:50.944196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:50.944170+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:50.944170+0000","last_clean_scrub_stamp":"2024-09-13T18:50:50.944170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:50.702974+0000","scrub_duration":0.0019259710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:36.627757+0000","last_change":"2024-09-13T18:46:11.658745+0000","last_active":"2024-09-13T18:49:36.627757+0000","last_peered":"2024-09-13T18:49:36.627757+0000","last_clean":"2024-09-13T18:49:36.627757+0000","last_became_active":"2024-09-13T18:46:11.658190+0000","last_became_peered":"2024-09-13T18:46:11.658190+0000","last_unstale":"2024-09-13T18:49:36.627757+0000","last_undegraded":"2024-09-13T18:49:36.627757+0000","last_fullsized":"2024-09-13T18:49:36.627757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:56.652546+0000","last_change":"2024-09-13T18:50:56.652677+0000","last_active":"2024-09-13T18:50:56.652546+0000","last_peered":"2024-09-13T18:50:56.652546+0000","last_clean":"2024-09-13T18:50:56.652546+0000","last_became_active":"2024-09-13T18:46:11.145524+0000","last_became_peered":"2024-09-13T18:46:11.145524+0000","last_unstale":"2024-09-13T18:50:56.652546+0000","last_undegraded":"2024-09-13T18:50:56.652546+0000","last_fullsized":"2024-09-13T18:50:56.652546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:56.652521+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:56.652521+0000","last_clean_scrub_stamp":"2024-09-13T18:50:56.652521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:42.478607+0000","scrub_duration":0.0014878630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:58.294050+0000","last_change":"2024-09-13T18:50:58.294183+0000","last_active":"2024-09-13T18:50:58.294050+0000","last_peered":"2024-09-13T18:50:58.294050+0000","last_clean":"2024-09-13T18:50:58.294050+0000","last_became_active":"2024-09-13T18:45:21.660577+0000","last_became_peered":"2024-09-13T18:45:21.660577+0000","last_unstale":"2024-09-13T18:50:58.294050+0000","last_undegraded":"2024-09-13T18:50:58.294050+0000","last_fullsized":"2024-09-13T18:50:58.294050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:58.294026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:58.294026+0000","last_clean_scrub_stamp":"2024-09-13T18:50:58.294026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:54.162887+0000","scrub_duration":0.001538322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:36.633399+0000","last_change":"2024-09-13T18:45:26.056021+0000","last_active":"2024-09-13T18:49:36.633399+0000","last_peered":"2024-09-13T18:49:36.633399+0000","last_clean":"2024-09-13T18:49:36.633399+0000","last_became_active":"2024-09-13T18:45:26.053877+0000","last_became_peered":"2024-09-13T18:45:26.053877+0000","last_unstale":"2024-09-13T18:49:36.633399+0000","last_undegraded":"2024-09-13T18:49:36.633399+0000","last_fullsized":"2024-09-13T18:49:36.633399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.737249+0000","last_change":"2024-09-13T18:50:49.737342+0000","last_active":"2024-09-13T18:50:49.737249+0000","last_peered":"2024-09-13T18:50:49.737249+0000","last_clean":"2024-09-13T18:50:49.737249+0000","last_became_active":"2024-09-13T18:45:22.028714+0000","last_became_peered":"2024-09-13T18:45:22.028714+0000","last_unstale":"2024-09-13T18:50:49.737249+0000","last_undegraded":"2024-09-13T18:50:49.737249+0000","last_fullsized":"2024-09-13T18:50:49.737249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:49.737225+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:49.737225+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.737225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:11.076096+0000","scrub_duration":0.0019902909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.619923+0000","last_change":"2024-09-13T18:50:51.620039+0000","last_active":"2024-09-13T18:50:51.619923+0000","last_peered":"2024-09-13T18:50:51.619923+0000","last_clean":"2024-09-13T18:50:51.619923+0000","last_became_active":"2024-09-13T18:45:21.667320+0000","last_became_peered":"2024-09-13T18:45:21.667320+0000","last_unstale":"2024-09-13T18:50:51.619923+0000","last_undegraded":"2024-09-13T18:50:51.619923+0000","last_fullsized":"2024-09-13T18:50:51.619923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:51.619900+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:51.619900+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.619900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:12.958770+0000","scrub_duration":0.0015549559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:35.174779+0000","last_change":"2024-09-13T18:46:11.148369+0000","last_active":"2024-09-13T18:50:35.174779+0000","last_peered":"2024-09-13T18:50:35.174779+0000","last_clean":"2024-09-13T18:50:35.174779+0000","last_became_active":"2024-09-13T18:46:11.147801+0000","last_became_peered":"2024-09-13T18:46:11.147801+0000","last_unstale":"2024-09-13T18:50:35.174779+0000","last_undegraded":"2024-09-13T18:50:35.174779+0000","last_fullsized":"2024-09-13T18:50:35.174779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.265246+0000","last_change":"2024-09-13T18:51:01.265385+0000","last_active":"2024-09-13T18:51:01.265246+0000","last_peered":"2024-09-13T18:51:01.265246+0000","last_clean":"2024-09-13T18:51:01.265246+0000","last_became_active":"2024-09-13T18:45:22.023357+0000","last_became_peered":"2024-09-13T18:45:22.023357+0000","last_unstale":"2024-09-13T18:51:01.265246+0000","last_undegraded":"2024-09-13T18:51:01.265246+0000","last_fullsized":"2024-09-13T18:51:01.265246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:01.265221+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:01.265221+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.265221+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:14.824444+0000","scrub_duration":0.0015610520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'46","reported_seq":116,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.566915+0000","last_change":"2024-09-13T18:50:47.567062+0000","last_active":"2024-09-13T18:50:47.566915+0000","last_peered":"2024-09-13T18:50:47.566915+0000","last_clean":"2024-09-13T18:50:47.566915+0000","last_became_active":"2024-09-13T18:45:21.667768+0000","last_became_peered":"2024-09-13T18:45:21.667768+0000","last_unstale":"2024-09-13T18:50:47.566915+0000","last_undegraded":"2024-09-13T18:50:47.566915+0000","last_fullsized":"2024-09-13T18:50:47.566915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'46","last_scrub_stamp":"2024-09-13T18:50:47.566865+0000","last_deep_scrub":"26'46","last_deep_scrub_stamp":"2024-09-13T18:50:47.566865+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.566865+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:09.704431+0000","scrub_duration":0.0017576639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":40,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:46.634682+0000","last_change":"2024-09-13T18:45:26.057274+0000","last_active":"2024-09-13T18:49:46.634682+0000","last_peered":"2024-09-13T18:49:46.634682+0000","last_clean":"2024-09-13T18:49:46.634682+0000","last_became_active":"2024-09-13T18:45:26.056850+0000","last_became_peered":"2024-09-13T18:45:26.056850+0000","last_unstale":"2024-09-13T18:49:46.634682+0000","last_undegraded":"2024-09-13T18:49:46.634682+0000","last_fullsized":"2024-09-13T18:49:46.634682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.560269+0000","last_change":"2024-09-13T18:50:49.560377+0000","last_active":"2024-09-13T18:50:49.560269+0000","last_peered":"2024-09-13T18:50:49.560269+0000","last_clean":"2024-09-13T18:50:49.560269+0000","last_became_active":"2024-09-13T18:45:22.020317+0000","last_became_peered":"2024-09-13T18:45:22.020317+0000","last_unstale":"2024-09-13T18:50:49.560269+0000","last_undegraded":"2024-09-13T18:50:49.560269+0000","last_fullsized":"2024-09-13T18:50:49.560269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:49.560243+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:49.560243+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.560243+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:10.899114+0000","scrub_duration":0.001921554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.990780+0000","last_change":"2024-09-13T18:50:49.990780+0000","last_active":"2024-09-13T18:50:49.990780+0000","last_peered":"2024-09-13T18:50:49.990780+0000","last_clean":"2024-09-13T18:50:49.990780+0000","last_became_active":"2024-09-13T18:45:21.667483+0000","last_became_peered":"2024-09-13T18:45:21.667483+0000","last_unstale":"2024-09-13T18:50:49.990780+0000","last_undegraded":"2024-09-13T18:50:49.990780+0000","last_fullsized":"2024-09-13T18:50:49.990780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:49.990664+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:49.990664+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.990664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:12.128230+0000","scrub_duration":0.002034138,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:46.629130+0000","last_change":"2024-09-13T18:45:26.254703+0000","last_active":"2024-09-13T18:49:46.629130+0000","last_peered":"2024-09-13T18:49:46.629130+0000","last_clean":"2024-09-13T18:49:46.629130+0000","last_became_active":"2024-09-13T18:45:26.253533+0000","last_became_peered":"2024-09-13T18:45:26.253533+0000","last_unstale":"2024-09-13T18:49:46.629130+0000","last_undegraded":"2024-09-13T18:49:46.629130+0000","last_fullsized":"2024-09-13T18:49:46.629130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'8","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:45.898750+0000","last_change":"2024-09-13T18:50:45.898842+0000","last_active":"2024-09-13T18:50:45.898750+0000","last_peered":"2024-09-13T18:50:45.898750+0000","last_clean":"2024-09-13T18:50:45.898750+0000","last_became_active":"2024-09-13T18:45:22.032109+0000","last_became_peered":"2024-09-13T18:45:22.032109+0000","last_unstale":"2024-09-13T18:50:45.898750+0000","last_undegraded":"2024-09-13T18:50:45.898750+0000","last_fullsized":"2024-09-13T18:50:45.898750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:50:45.898727+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:50:45.898727+0000","last_clean_scrub_stamp":"2024-09-13T18:50:45.898727+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:31.724813+0000","scrub_duration":0.002426119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:55.584004+0000","last_change":"2024-09-13T18:50:55.584126+0000","last_active":"2024-09-13T18:50:55.584004+0000","last_peered":"2024-09-13T18:50:55.584004+0000","last_clean":"2024-09-13T18:50:55.584004+0000","last_became_active":"2024-09-13T18:45:21.662344+0000","last_became_peered":"2024-09-13T18:45:21.662344+0000","last_unstale":"2024-09-13T18:50:55.584004+0000","last_undegraded":"2024-09-13T18:50:55.584004+0000","last_fullsized":"2024-09-13T18:50:55.584004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:55.583980+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:55.583980+0000","last_clean_scrub_stamp":"2024-09-13T18:50:55.583980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.452841+0000","scrub_duration":0.0022605720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":185,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.963592+0000","last_change":"2024-09-13T18:50:47.963592+0000","last_active":"2024-09-13T18:50:47.963592+0000","last_peered":"2024-09-13T18:50:47.963592+0000","last_clean":"2024-09-13T18:50:47.963592+0000","last_became_active":"2024-09-13T18:45:19.777172+0000","last_became_peered":"2024-09-13T18:45:19.777172+0000","last_unstale":"2024-09-13T18:50:47.963592+0000","last_undegraded":"2024-09-13T18:50:47.963592+0000","last_fullsized":"2024-09-13T18:50:47.963592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-09-13T18:50:47.963462+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-09-13T18:50:47.963462+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.963462+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:32.776049+0000","scrub_duration":0.0045475369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:19.229160+0000","last_change":"2024-09-13T18:51:19.229290+0000","last_active":"2024-09-13T18:51:19.229160+0000","last_peered":"2024-09-13T18:51:19.229160+0000","last_clean":"2024-09-13T18:51:19.229160+0000","last_became_active":"2024-09-13T18:45:26.252890+0000","last_became_peered":"2024-09-13T18:45:26.252890+0000","last_unstale":"2024-09-13T18:51:19.229160+0000","last_undegraded":"2024-09-13T18:51:19.229160+0000","last_fullsized":"2024-09-13T18:51:19.229160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:19.229136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:19.229136+0000","last_clean_scrub_stamp":"2024-09-13T18:51:19.229136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:45.844522+0000","scrub_duration":0.0018592859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:08.902874+0000","last_change":"2024-09-13T18:51:08.902981+0000","last_active":"2024-09-13T18:51:08.902874+0000","last_peered":"2024-09-13T18:51:08.902874+0000","last_clean":"2024-09-13T18:51:08.902874+0000","last_became_active":"2024-09-13T18:45:22.036153+0000","last_became_peered":"2024-09-13T18:45:22.036153+0000","last_unstale":"2024-09-13T18:51:08.902874+0000","last_undegraded":"2024-09-13T18:51:08.902874+0000","last_fullsized":"2024-09-13T18:51:08.902874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:08.902849+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:08.902849+0000","last_clean_scrub_stamp":"2024-09-13T18:51:08.902849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:22.462073+0000","scrub_duration":0.001591044,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:43.612187+0000","last_change":"2024-09-13T18:50:43.612278+0000","last_active":"2024-09-13T18:50:43.612187+0000","last_peered":"2024-09-13T18:50:43.612187+0000","last_clean":"2024-09-13T18:50:43.612187+0000","last_became_active":"2024-09-13T18:45:21.665582+0000","last_became_peered":"2024-09-13T18:45:21.665582+0000","last_unstale":"2024-09-13T18:50:43.612187+0000","last_undegraded":"2024-09-13T18:50:43.612187+0000","last_fullsized":"2024-09-13T18:50:43.612187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:43.612164+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:43.612164+0000","last_clean_scrub_stamp":"2024-09-13T18:50:43.612164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:38.969573+0000","scrub_duration":0.0020111640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:46.630845+0000","last_change":"2024-09-13T18:45:26.250391+0000","last_active":"2024-09-13T18:49:46.630845+0000","last_peered":"2024-09-13T18:49:46.630845+0000","last_clean":"2024-09-13T18:49:46.630845+0000","last_became_active":"2024-09-13T18:45:26.249986+0000","last_became_peered":"2024-09-13T18:45:26.249986+0000","last_unstale":"2024-09-13T18:49:46.630845+0000","last_undegraded":"2024-09-13T18:49:46.630845+0000","last_fullsized":"2024-09-13T18:49:46.630845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.591676+0000","last_change":"2024-09-13T18:50:48.591788+0000","last_active":"2024-09-13T18:50:48.591676+0000","last_peered":"2024-09-13T18:50:48.591676+0000","last_clean":"2024-09-13T18:50:48.591676+0000","last_became_active":"2024-09-13T18:45:22.036523+0000","last_became_peered":"2024-09-13T18:45:22.036523+0000","last_unstale":"2024-09-13T18:50:48.591676+0000","last_undegraded":"2024-09-13T18:50:48.591676+0000","last_fullsized":"2024-09-13T18:50:48.591676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:48.591652+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:48.591652+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.591652+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:03.071671+0000","scrub_duration":0.001672523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.185355+0000","last_change":"2024-09-13T18:50:53.185451+0000","last_active":"2024-09-13T18:50:53.185355+0000","last_peered":"2024-09-13T18:50:53.185355+0000","last_clean":"2024-09-13T18:50:53.185355+0000","last_became_active":"2024-09-13T18:45:21.662405+0000","last_became_peered":"2024-09-13T18:45:21.662405+0000","last_unstale":"2024-09-13T18:50:53.185355+0000","last_undegraded":"2024-09-13T18:50:53.185355+0000","last_fullsized":"2024-09-13T18:50:53.185355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:53.185332+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:53.185332+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.185332+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:51.585557+0000","scrub_duration":0.0032345479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:56.630103+0000","last_change":"2024-09-13T18:45:26.055309+0000","last_active":"2024-09-13T18:49:56.630103+0000","last_peered":"2024-09-13T18:49:56.630103+0000","last_clean":"2024-09-13T18:49:56.630103+0000","last_became_active":"2024-09-13T18:45:26.054449+0000","last_became_peered":"2024-09-13T18:45:26.054449+0000","last_unstale":"2024-09-13T18:49:56.630103+0000","last_undegraded":"2024-09-13T18:49:56.630103+0000","last_fullsized":"2024-09-13T18:49:56.630103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'9","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:41.640193+0000","last_change":"2024-09-13T18:46:11.150958+0000","last_active":"2024-09-13T18:50:41.640193+0000","last_peered":"2024-09-13T18:50:41.640193+0000","last_clean":"2024-09-13T18:50:41.640193+0000","last_became_active":"2024-09-13T18:46:11.150605+0000","last_became_peered":"2024-09-13T18:46:11.150605+0000","last_unstale":"2024-09-13T18:50:41.640193+0000","last_undegraded":"2024-09-13T18:50:41.640193+0000","last_fullsized":"2024-09-13T18:50:41.640193+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:44.581874+0000","last_change":"2024-09-13T18:50:44.581951+0000","last_active":"2024-09-13T18:50:44.581874+0000","last_peered":"2024-09-13T18:50:44.581874+0000","last_clean":"2024-09-13T18:50:44.581874+0000","last_became_active":"2024-09-13T18:45:21.667340+0000","last_became_peered":"2024-09-13T18:45:21.667340+0000","last_unstale":"2024-09-13T18:50:44.581874+0000","last_undegraded":"2024-09-13T18:50:44.581874+0000","last_fullsized":"2024-09-13T18:50:44.581874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:44.581853+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:44.581853+0000","last_clean_scrub_stamp":"2024-09-13T18:50:44.581853+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:34.592117+0000","scrub_duration":0.002403325,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:46.630965+0000","last_change":"2024-09-13T18:45:26.250450+0000","last_active":"2024-09-13T18:49:46.630965+0000","last_peered":"2024-09-13T18:49:46.630965+0000","last_clean":"2024-09-13T18:49:46.630965+0000","last_became_active":"2024-09-13T18:45:26.250020+0000","last_became_peered":"2024-09-13T18:45:26.250020+0000","last_unstale":"2024-09-13T18:49:46.630965+0000","last_undegraded":"2024-09-13T18:49:46.630965+0000","last_fullsized":"2024-09-13T18:49:46.630965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:06.933020+0000","last_change":"2024-09-13T18:51:06.933112+0000","last_active":"2024-09-13T18:51:06.933020+0000","last_peered":"2024-09-13T18:51:06.933020+0000","last_clean":"2024-09-13T18:51:06.933020+0000","last_became_active":"2024-09-13T18:45:22.030275+0000","last_became_peered":"2024-09-13T18:45:22.030275+0000","last_unstale":"2024-09-13T18:51:06.933020+0000","last_undegraded":"2024-09-13T18:51:06.933020+0000","last_fullsized":"2024-09-13T18:51:06.933020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:06.932993+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:06.932993+0000","last_clean_scrub_stamp":"2024-09-13T18:51:06.932993+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:30.946801+0000","scrub_duration":0.001459723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:46.747039+0000","last_change":"2024-09-13T18:50:46.747141+0000","last_active":"2024-09-13T18:50:46.747039+0000","last_peered":"2024-09-13T18:50:46.747039+0000","last_clean":"2024-09-13T18:50:46.747039+0000","last_became_active":"2024-09-13T18:45:21.662210+0000","last_became_peered":"2024-09-13T18:45:21.662210+0000","last_unstale":"2024-09-13T18:50:46.747039+0000","last_undegraded":"2024-09-13T18:50:46.747039+0000","last_fullsized":"2024-09-13T18:50:46.747039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:46.747013+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:46.747013+0000","last_clean_scrub_stamp":"2024-09-13T18:50:46.747013+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:01.227032+0000","scrub_duration":0.0037197200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:46.630291+0000","last_change":"2024-09-13T18:45:26.053575+0000","last_active":"2024-09-13T18:49:46.630291+0000","last_peered":"2024-09-13T18:49:46.630291+0000","last_clean":"2024-09-13T18:49:46.630291+0000","last_became_active":"2024-09-13T18:45:26.053195+0000","last_became_peered":"2024-09-13T18:45:26.053195+0000","last_unstale":"2024-09-13T18:49:46.630291+0000","last_undegraded":"2024-09-13T18:49:46.630291+0000","last_fullsized":"2024-09-13T18:49:46.630291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:14.842758+0000","last_change":"2024-09-13T18:51:14.842898+0000","last_active":"2024-09-13T18:51:14.842758+0000","last_peered":"2024-09-13T18:51:14.842758+0000","last_clean":"2024-09-13T18:51:14.842758+0000","last_became_active":"2024-09-13T18:45:22.031312+0000","last_became_peered":"2024-09-13T18:45:22.031312+0000","last_unstale":"2024-09-13T18:51:14.842758+0000","last_undegraded":"2024-09-13T18:51:14.842758+0000","last_fullsized":"2024-09-13T18:51:14.842758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:14.842734+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:14.842734+0000","last_clean_scrub_stamp":"2024-09-13T18:51:14.842734+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:23.473137+0000","scrub_duration":0.0016508709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:45.608053+0000","last_change":"2024-09-13T18:50:45.608171+0000","last_active":"2024-09-13T18:50:45.608053+0000","last_peered":"2024-09-13T18:50:45.608053+0000","last_clean":"2024-09-13T18:50:45.608053+0000","last_became_active":"2024-09-13T18:45:21.654844+0000","last_became_peered":"2024-09-13T18:45:21.654844+0000","last_unstale":"2024-09-13T18:50:45.608053+0000","last_undegraded":"2024-09-13T18:50:45.608053+0000","last_fullsized":"2024-09-13T18:50:45.608053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2024-09-13T18:50:45.608031+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2024-09-13T18:50:45.608031+0000","last_clean_scrub_stamp":"2024-09-13T18:50:45.608031+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:30.420618+0000","scrub_duration":0.0035795750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:16.632167+0000","last_change":"2024-09-13T18:45:26.056440+0000","last_active":"2024-09-13T18:50:16.632167+0000","last_peered":"2024-09-13T18:50:16.632167+0000","last_clean":"2024-09-13T18:50:16.632167+0000","last_became_active":"2024-09-13T18:45:26.055955+0000","last_became_peered":"2024-09-13T18:45:26.055955+0000","last_unstale":"2024-09-13T18:50:16.632167+0000","last_undegraded":"2024-09-13T18:50:16.632167+0000","last_fullsized":"2024-09-13T18:50:16.632167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:03.236973+0000","last_change":"2024-09-13T18:51:03.237150+0000","last_active":"2024-09-13T18:51:03.236973+0000","last_peered":"2024-09-13T18:51:03.236973+0000","last_clean":"2024-09-13T18:51:03.236973+0000","last_became_active":"2024-09-13T18:45:22.027172+0000","last_became_peered":"2024-09-13T18:45:22.027172+0000","last_unstale":"2024-09-13T18:51:03.236973+0000","last_undegraded":"2024-09-13T18:51:03.236973+0000","last_fullsized":"2024-09-13T18:51:03.236973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:51:03.236933+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:51:03.236933+0000","last_clean_scrub_stamp":"2024-09-13T18:51:03.236933+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:49.063019+0000","scrub_duration":0.0022569790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.190482+0000","last_change":"2024-09-13T18:50:49.190582+0000","last_active":"2024-09-13T18:50:49.190482+0000","last_peered":"2024-09-13T18:50:49.190482+0000","last_clean":"2024-09-13T18:50:49.190482+0000","last_became_active":"2024-09-13T18:45:21.663746+0000","last_became_peered":"2024-09-13T18:45:21.663746+0000","last_unstale":"2024-09-13T18:50:49.190482+0000","last_undegraded":"2024-09-13T18:50:49.190482+0000","last_fullsized":"2024-09-13T18:50:49.190482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:49.190457+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:49.190457+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.190457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:34.003043+0000","scrub_duration":0.0013612330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:16.632923+0000","last_change":"2024-09-13T18:45:26.253221+0000","last_active":"2024-09-13T18:50:16.632923+0000","last_peered":"2024-09-13T18:50:16.632923+0000","last_clean":"2024-09-13T18:50:16.632923+0000","last_became_active":"2024-09-13T18:45:26.252841+0000","last_became_peered":"2024-09-13T18:45:26.252841+0000","last_unstale":"2024-09-13T18:50:16.632923+0000","last_undegraded":"2024-09-13T18:50:16.632923+0000","last_fullsized":"2024-09-13T18:50:16.632923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'20","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:05.973224+0000","last_change":"2024-09-13T18:51:05.973322+0000","last_active":"2024-09-13T18:51:05.973224+0000","last_peered":"2024-09-13T18:51:05.973224+0000","last_clean":"2024-09-13T18:51:05.973224+0000","last_became_active":"2024-09-13T18:45:22.032862+0000","last_became_peered":"2024-09-13T18:45:22.032862+0000","last_unstale":"2024-09-13T18:51:05.973224+0000","last_undegraded":"2024-09-13T18:51:05.973224+0000","last_fullsized":"2024-09-13T18:51:05.973224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-09-13T18:51:05.973201+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-09-13T18:51:05.973201+0000","last_clean_scrub_stamp":"2024-09-13T18:51:05.973201+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:01.842061+0000","scrub_duration":0.001409771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:05.497671+0000","last_change":"2024-09-13T18:51:05.497769+0000","last_active":"2024-09-13T18:51:05.497671+0000","last_peered":"2024-09-13T18:51:05.497671+0000","last_clean":"2024-09-13T18:51:05.497671+0000","last_became_active":"2024-09-13T18:45:21.667457+0000","last_became_peered":"2024-09-13T18:45:21.667457+0000","last_unstale":"2024-09-13T18:51:05.497671+0000","last_undegraded":"2024-09-13T18:51:05.497671+0000","last_fullsized":"2024-09-13T18:51:05.497671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:05.497646+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:05.497646+0000","last_clean_scrub_stamp":"2024-09-13T18:51:05.497646+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:14.128049+0000","scrub_duration":0.001432996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.631647+0000","last_change":"2024-09-13T18:45:26.250464+0000","last_active":"2024-09-13T18:50:06.631647+0000","last_peered":"2024-09-13T18:50:06.631647+0000","last_clean":"2024-09-13T18:50:06.631647+0000","last_became_active":"2024-09-13T18:45:26.250041+0000","last_became_peered":"2024-09-13T18:45:26.250041+0000","last_unstale":"2024-09-13T18:50:06.631647+0000","last_undegraded":"2024-09-13T18:50:06.631647+0000","last_fullsized":"2024-09-13T18:50:06.631647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:54.569727+0000","last_change":"2024-09-13T18:50:54.569854+0000","last_active":"2024-09-13T18:50:54.569727+0000","last_peered":"2024-09-13T18:50:54.569727+0000","last_clean":"2024-09-13T18:50:54.569727+0000","last_became_active":"2024-09-13T18:45:22.023882+0000","last_became_peered":"2024-09-13T18:45:22.023882+0000","last_unstale":"2024-09-13T18:50:54.569727+0000","last_undegraded":"2024-09-13T18:50:54.569727+0000","last_fullsized":"2024-09-13T18:50:54.569727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:54.569702+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:54.569702+0000","last_clean_scrub_stamp":"2024-09-13T18:50:54.569702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:45.447629+0000","scrub_duration":0.0017254239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.525039+0000","last_change":"2024-09-13T18:50:47.525152+0000","last_active":"2024-09-13T18:50:47.525039+0000","last_peered":"2024-09-13T18:50:47.525039+0000","last_clean":"2024-09-13T18:50:47.525039+0000","last_became_active":"2024-09-13T18:45:21.662980+0000","last_became_peered":"2024-09-13T18:45:21.662980+0000","last_unstale":"2024-09-13T18:50:47.525039+0000","last_undegraded":"2024-09-13T18:50:47.525039+0000","last_fullsized":"2024-09-13T18:50:47.525039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:47.525016+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:47.525016+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.525016+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:46.204054+0000","scrub_duration":0.0038760959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:16.634733+0000","last_change":"2024-09-13T18:45:26.253184+0000","last_active":"2024-09-13T18:50:16.634733+0000","last_peered":"2024-09-13T18:50:16.634733+0000","last_clean":"2024-09-13T18:50:16.634733+0000","last_became_active":"2024-09-13T18:45:26.252786+0000","last_became_peered":"2024-09-13T18:45:26.252786+0000","last_unstale":"2024-09-13T18:50:16.634733+0000","last_undegraded":"2024-09-13T18:50:16.634733+0000","last_fullsized":"2024-09-13T18:50:16.634733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.716515+0000","last_change":"2024-09-13T18:45:22.035052+0000","last_active":"2024-09-13T18:50:38.716515+0000","last_peered":"2024-09-13T18:50:38.716515+0000","last_clean":"2024-09-13T18:50:38.716515+0000","last_became_active":"2024-09-13T18:45:22.034765+0000","last_became_peered":"2024-09-13T18:45:22.034765+0000","last_unstale":"2024-09-13T18:50:38.716515+0000","last_undegraded":"2024-09-13T18:50:38.716515+0000","last_fullsized":"2024-09-13T18:50:38.716515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'104","reported_seq":135,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.203053+0000","last_change":"2024-09-13T18:50:47.203181+0000","last_active":"2024-09-13T18:50:47.203053+0000","last_peered":"2024-09-13T18:50:47.203053+0000","last_clean":"2024-09-13T18:50:47.203053+0000","last_became_active":"2024-09-13T18:45:21.667587+0000","last_became_peered":"2024-09-13T18:45:21.667587+0000","last_unstale":"2024-09-13T18:50:47.203053+0000","last_undegraded":"2024-09-13T18:50:47.203053+0000","last_fullsized":"2024-09-13T18:50:47.203053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'104","last_scrub_stamp":"2024-09-13T18:50:47.203030+0000","last_deep_scrub":"26'104","last_deep_scrub_stamp":"2024-09-13T18:50:47.203030+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.203030+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:42.560439+0000","scrub_duration":0.020188185000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":942437,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.636379+0000","last_change":"2024-09-13T18:45:26.052997+0000","last_active":"2024-09-13T18:50:06.636379+0000","last_peered":"2024-09-13T18:50:06.636379+0000","last_clean":"2024-09-13T18:50:06.636379+0000","last_became_active":"2024-09-13T18:45:26.052614+0000","last_became_peered":"2024-09-13T18:45:26.052614+0000","last_unstale":"2024-09-13T18:50:06.636379+0000","last_undegraded":"2024-09-13T18:50:06.636379+0000","last_fullsized":"2024-09-13T18:50:06.636379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'12","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:55.746737+0000","last_change":"2024-09-13T18:50:55.746842+0000","last_active":"2024-09-13T18:50:55.746737+0000","last_peered":"2024-09-13T18:50:55.746737+0000","last_clean":"2024-09-13T18:50:55.746737+0000","last_became_active":"2024-09-13T18:45:22.020461+0000","last_became_peered":"2024-09-13T18:45:22.020461+0000","last_unstale":"2024-09-13T18:50:55.746737+0000","last_undegraded":"2024-09-13T18:50:55.746737+0000","last_fullsized":"2024-09-13T18:50:55.746737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-09-13T18:50:55.746712+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-09-13T18:50:55.746712+0000","last_clean_scrub_stamp":"2024-09-13T18:50:55.746712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:46.624639+0000","scrub_duration":0.001397379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'30","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:59.319018+0000","last_change":"2024-09-13T18:50:59.319133+0000","last_active":"2024-09-13T18:50:59.319018+0000","last_peered":"2024-09-13T18:50:59.319018+0000","last_clean":"2024-09-13T18:50:59.319018+0000","last_became_active":"2024-09-13T18:45:21.663941+0000","last_became_peered":"2024-09-13T18:45:21.663941+0000","last_unstale":"2024-09-13T18:50:59.319018+0000","last_undegraded":"2024-09-13T18:50:59.319018+0000","last_fullsized":"2024-09-13T18:50:59.319018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'30","last_scrub_stamp":"2024-09-13T18:50:59.318992+0000","last_deep_scrub":"26'30","last_deep_scrub_stamp":"2024-09-13T18:50:59.318992+0000","last_clean_scrub_stamp":"2024-09-13T18:50:59.318992+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:23.332800+0000","scrub_duration":0.0038590220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.632927+0000","last_change":"2024-09-13T18:45:26.051227+0000","last_active":"2024-09-13T18:50:06.632927+0000","last_peered":"2024-09-13T18:50:06.632927+0000","last_clean":"2024-09-13T18:50:06.632927+0000","last_became_active":"2024-09-13T18:45:26.050757+0000","last_became_peered":"2024-09-13T18:45:26.050757+0000","last_unstale":"2024-09-13T18:50:06.632927+0000","last_undegraded":"2024-09-13T18:50:06.632927+0000","last_fullsized":"2024-09-13T18:50:06.632927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:57.568366+0000","last_change":"2024-09-13T18:50:57.568488+0000","last_active":"2024-09-13T18:50:57.568366+0000","last_peered":"2024-09-13T18:50:57.568366+0000","last_clean":"2024-09-13T18:50:57.568366+0000","last_became_active":"2024-09-13T18:45:22.024972+0000","last_became_peered":"2024-09-13T18:45:22.024972+0000","last_unstale":"2024-09-13T18:50:57.568366+0000","last_undegraded":"2024-09-13T18:50:57.568366+0000","last_fullsized":"2024-09-13T18:50:57.568366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:50:57.568343+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:50:57.568343+0000","last_clean_scrub_stamp":"2024-09-13T18:50:57.568343+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:11.127567+0000","scrub_duration":0.0016603970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'7","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:57.516274+0000","last_change":"2024-09-13T18:50:57.516394+0000","last_active":"2024-09-13T18:50:57.516274+0000","last_peered":"2024-09-13T18:50:57.516274+0000","last_clean":"2024-09-13T18:50:57.516274+0000","last_became_active":"2024-09-13T18:45:21.666516+0000","last_became_peered":"2024-09-13T18:45:21.666516+0000","last_unstale":"2024-09-13T18:50:57.516274+0000","last_undegraded":"2024-09-13T18:50:57.516274+0000","last_fullsized":"2024-09-13T18:50:57.516274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:57.516252+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:57.516252+0000","last_clean_scrub_stamp":"2024-09-13T18:50:57.516252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:48.394179+0000","scrub_duration":0.001474358,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.631530+0000","last_change":"2024-09-13T18:45:26.057746+0000","last_active":"2024-09-13T18:50:06.631530+0000","last_peered":"2024-09-13T18:50:06.631530+0000","last_clean":"2024-09-13T18:50:06.631530+0000","last_became_active":"2024-09-13T18:45:26.057285+0000","last_became_peered":"2024-09-13T18:45:26.057285+0000","last_unstale":"2024-09-13T18:50:06.631530+0000","last_undegraded":"2024-09-13T18:50:06.631530+0000","last_fullsized":"2024-09-13T18:50:06.631530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:50.580387+0000","last_change":"2024-09-13T18:50:50.580490+0000","last_active":"2024-09-13T18:50:50.580387+0000","last_peered":"2024-09-13T18:50:50.580387+0000","last_clean":"2024-09-13T18:50:50.580387+0000","last_became_active":"2024-09-13T18:45:22.031341+0000","last_became_peered":"2024-09-13T18:45:22.031341+0000","last_unstale":"2024-09-13T18:50:50.580387+0000","last_undegraded":"2024-09-13T18:50:50.580387+0000","last_fullsized":"2024-09-13T18:50:50.580387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:50.580363+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:50.580363+0000","last_clean_scrub_stamp":"2024-09-13T18:50:50.580363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:36.406449+0000","scrub_duration":0.0013669019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:52.209692+0000","last_change":"2024-09-13T18:50:52.209792+0000","last_active":"2024-09-13T18:50:52.209692+0000","last_peered":"2024-09-13T18:50:52.209692+0000","last_clean":"2024-09-13T18:50:52.209692+0000","last_became_active":"2024-09-13T18:45:21.664401+0000","last_became_peered":"2024-09-13T18:45:21.664401+0000","last_unstale":"2024-09-13T18:50:52.209692+0000","last_undegraded":"2024-09-13T18:50:52.209692+0000","last_fullsized":"2024-09-13T18:50:52.209692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:52.209668+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:52.209668+0000","last_clean_scrub_stamp":"2024-09-13T18:50:52.209668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:51.968472+0000","scrub_duration":0.001304253,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.631569+0000","last_change":"2024-09-13T18:45:26.254041+0000","last_active":"2024-09-13T18:50:06.631569+0000","last_peered":"2024-09-13T18:50:06.631569+0000","last_clean":"2024-09-13T18:50:06.631569+0000","last_became_active":"2024-09-13T18:45:26.253579+0000","last_became_peered":"2024-09-13T18:45:26.253579+0000","last_unstale":"2024-09-13T18:50:06.631569+0000","last_undegraded":"2024-09-13T18:50:06.631569+0000","last_fullsized":"2024-09-13T18:50:06.631569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:49:26.626734+0000","last_change":"2024-09-13T18:45:26.253962+0000","last_active":"2024-09-13T18:49:26.626734+0000","last_peered":"2024-09-13T18:49:26.626734+0000","last_clean":"2024-09-13T18:49:26.626734+0000","last_became_active":"2024-09-13T18:45:26.252979+0000","last_became_peered":"2024-09-13T18:45:26.252979+0000","last_unstale":"2024-09-13T18:49:26.626734+0000","last_undegraded":"2024-09-13T18:49:26.626734+0000","last_fullsized":"2024-09-13T18:49:26.626734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'11","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:44.232716+0000","last_change":"2024-09-13T18:50:44.232835+0000","last_active":"2024-09-13T18:50:44.232716+0000","last_peered":"2024-09-13T18:50:44.232716+0000","last_clean":"2024-09-13T18:50:44.232716+0000","last_became_active":"2024-09-13T18:45:22.030453+0000","last_became_peered":"2024-09-13T18:45:22.030453+0000","last_unstale":"2024-09-13T18:50:44.232716+0000","last_undegraded":"2024-09-13T18:50:44.232716+0000","last_fullsized":"2024-09-13T18:50:44.232716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:50:44.232671+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:50:44.232671+0000","last_clean_scrub_stamp":"2024-09-13T18:50:44.232671+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:43.991475+0000","scrub_duration":0.0014480770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:00.539547+0000","last_change":"2024-09-13T18:51:00.539669+0000","last_active":"2024-09-13T18:51:00.539547+0000","last_peered":"2024-09-13T18:51:00.539547+0000","last_clean":"2024-09-13T18:51:00.539547+0000","last_became_active":"2024-09-13T18:45:21.664571+0000","last_became_peered":"2024-09-13T18:45:21.664571+0000","last_unstale":"2024-09-13T18:51:00.539547+0000","last_undegraded":"2024-09-13T18:51:00.539547+0000","last_fullsized":"2024-09-13T18:51:00.539547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:00.539521+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:00.539521+0000","last_clean_scrub_stamp":"2024-09-13T18:51:00.539521+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:14.098745+0000","scrub_duration":0.001600532,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:18.256460+0000","last_change":"2024-09-13T18:51:18.256601+0000","last_active":"2024-09-13T18:51:18.256460+0000","last_peered":"2024-09-13T18:51:18.256460+0000","last_clean":"2024-09-13T18:51:18.256460+0000","last_became_active":"2024-09-13T18:45:26.054510+0000","last_became_peered":"2024-09-13T18:45:26.054510+0000","last_unstale":"2024-09-13T18:51:18.256460+0000","last_undegraded":"2024-09-13T18:51:18.256460+0000","last_fullsized":"2024-09-13T18:51:18.256460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:18.256436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:18.256436+0000","last_clean_scrub_stamp":"2024-09-13T18:51:18.256436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:26.886838+0000","scrub_duration":0.0019428430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:46.866498+0000","last_change":"2024-09-13T18:50:46.866594+0000","last_active":"2024-09-13T18:50:46.866498+0000","last_peered":"2024-09-13T18:50:46.866498+0000","last_clean":"2024-09-13T18:50:46.866498+0000","last_became_active":"2024-09-13T18:45:22.028062+0000","last_became_peered":"2024-09-13T18:45:22.028062+0000","last_unstale":"2024-09-13T18:50:46.866498+0000","last_undegraded":"2024-09-13T18:50:46.866498+0000","last_fullsized":"2024-09-13T18:50:46.866498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:46.866474+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:46.866474+0000","last_clean_scrub_stamp":"2024-09-13T18:50:46.866474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:08.205344+0000","scrub_duration":0.0015895569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:52.891038+0000","last_change":"2024-09-13T18:50:52.891140+0000","last_active":"2024-09-13T18:50:52.891038+0000","last_peered":"2024-09-13T18:50:52.891038+0000","last_clean":"2024-09-13T18:50:52.891038+0000","last_became_active":"2024-09-13T18:45:21.672470+0000","last_became_peered":"2024-09-13T18:45:21.672470+0000","last_unstale":"2024-09-13T18:50:52.891038+0000","last_undegraded":"2024-09-13T18:50:52.891038+0000","last_fullsized":"2024-09-13T18:50:52.891038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:50:52.891015+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:50:52.891015+0000","last_clean_scrub_stamp":"2024-09-13T18:50:52.891015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:43.768942+0000","scrub_duration":0.001947734,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.207387+0000","last_change":"2024-09-13T18:50:51.207489+0000","last_active":"2024-09-13T18:50:51.207387+0000","last_peered":"2024-09-13T18:50:51.207387+0000","last_clean":"2024-09-13T18:50:51.207387+0000","last_became_active":"2024-09-13T18:45:21.659912+0000","last_became_peered":"2024-09-13T18:45:21.659912+0000","last_unstale":"2024-09-13T18:50:51.207387+0000","last_undegraded":"2024-09-13T18:50:51.207387+0000","last_fullsized":"2024-09-13T18:50:51.207387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:51.207360+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:51.207360+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.207360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:13.344926+0000","scrub_duration":0.0013910459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:02.505731+0000","last_change":"2024-09-13T18:51:02.505849+0000","last_active":"2024-09-13T18:51:02.505731+0000","last_peered":"2024-09-13T18:51:02.505731+0000","last_clean":"2024-09-13T18:51:02.505731+0000","last_became_active":"2024-09-13T18:45:22.024305+0000","last_became_peered":"2024-09-13T18:45:22.024305+0000","last_unstale":"2024-09-13T18:51:02.505731+0000","last_undegraded":"2024-09-13T18:51:02.505731+0000","last_fullsized":"2024-09-13T18:51:02.505731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:02.505710+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:02.505710+0000","last_clean_scrub_stamp":"2024-09-13T18:51:02.505710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:11.136113+0000","scrub_duration":0.0020117059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.634442+0000","last_change":"2024-09-13T18:50:53.634577+0000","last_active":"2024-09-13T18:50:53.634442+0000","last_peered":"2024-09-13T18:50:53.634442+0000","last_clean":"2024-09-13T18:50:53.634442+0000","last_became_active":"2024-09-13T18:45:26.055794+0000","last_became_peered":"2024-09-13T18:45:26.055794+0000","last_unstale":"2024-09-13T18:50:53.634442+0000","last_undegraded":"2024-09-13T18:50:53.634442+0000","last_fullsized":"2024-09-13T18:50:53.634442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:53.634420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:53.634420+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.634420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:29.073415+0000","scrub_duration":0.0018457149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:00.849167+0000","last_change":"2024-09-13T18:51:00.849278+0000","last_active":"2024-09-13T18:51:00.849167+0000","last_peered":"2024-09-13T18:51:00.849167+0000","last_clean":"2024-09-13T18:51:00.849167+0000","last_became_active":"2024-09-13T18:45:21.670083+0000","last_became_peered":"2024-09-13T18:45:21.670083+0000","last_unstale":"2024-09-13T18:51:00.849167+0000","last_undegraded":"2024-09-13T18:51:00.849167+0000","last_fullsized":"2024-09-13T18:51:00.849167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:51:00.849140+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:51:00.849140+0000","last_clean_scrub_stamp":"2024-09-13T18:51:00.849140+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:09.479543+0000","scrub_duration":0.0018400650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.752295+0000","last_change":"2024-09-13T18:50:53.752405+0000","last_active":"2024-09-13T18:50:53.752295+0000","last_peered":"2024-09-13T18:50:53.752295+0000","last_clean":"2024-09-13T18:50:53.752295+0000","last_became_active":"2024-09-13T18:45:22.021496+0000","last_became_peered":"2024-09-13T18:45:22.021496+0000","last_unstale":"2024-09-13T18:50:53.752295+0000","last_undegraded":"2024-09-13T18:50:53.752295+0000","last_fullsized":"2024-09-13T18:50:53.752295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:53.752270+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:53.752270+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.752270+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:49.621131+0000","scrub_duration":0.0017525349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:26.634136+0000","last_change":"2024-09-13T18:45:26.050478+0000","last_active":"2024-09-13T18:50:26.634136+0000","last_peered":"2024-09-13T18:50:26.634136+0000","last_clean":"2024-09-13T18:50:26.634136+0000","last_became_active":"2024-09-13T18:45:26.050095+0000","last_became_peered":"2024-09-13T18:45:26.050095+0000","last_unstale":"2024-09-13T18:50:26.634136+0000","last_undegraded":"2024-09-13T18:50:26.634136+0000","last_fullsized":"2024-09-13T18:50:26.634136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:13.281044+0000","last_change":"2024-09-13T18:51:13.281140+0000","last_active":"2024-09-13T18:51:13.281044+0000","last_peered":"2024-09-13T18:51:13.281044+0000","last_clean":"2024-09-13T18:51:13.281044+0000","last_became_active":"2024-09-13T18:45:22.027528+0000","last_became_peered":"2024-09-13T18:45:22.027528+0000","last_unstale":"2024-09-13T18:51:13.281044+0000","last_undegraded":"2024-09-13T18:51:13.281044+0000","last_fullsized":"2024-09-13T18:51:13.281044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:13.281016+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:13.281016+0000","last_clean_scrub_stamp":"2024-09-13T18:51:13.281016+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:26.840240+0000","scrub_duration":0.001715488,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'8","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.607793+0000","last_change":"2024-09-13T18:50:48.607907+0000","last_active":"2024-09-13T18:50:48.607793+0000","last_peered":"2024-09-13T18:50:48.607793+0000","last_clean":"2024-09-13T18:50:48.607793+0000","last_became_active":"2024-09-13T18:45:22.024369+0000","last_became_peered":"2024-09-13T18:45:22.024369+0000","last_unstale":"2024-09-13T18:50:48.607793+0000","last_undegraded":"2024-09-13T18:50:48.607793+0000","last_fullsized":"2024-09-13T18:50:48.607793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:50:48.607766+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:50:48.607766+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.607766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:48.366570+0000","scrub_duration":0.0018146099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:16.527190+0000","last_change":"2024-09-13T18:51:16.527317+0000","last_active":"2024-09-13T18:51:16.527190+0000","last_peered":"2024-09-13T18:51:16.527190+0000","last_clean":"2024-09-13T18:51:16.527190+0000","last_became_active":"2024-09-13T18:45:22.034318+0000","last_became_peered":"2024-09-13T18:45:22.034318+0000","last_unstale":"2024-09-13T18:51:16.527190+0000","last_undegraded":"2024-09-13T18:51:16.527190+0000","last_fullsized":"2024-09-13T18:51:16.527190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:16.527167+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:16.527167+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.527167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:39.701195+0000","scrub_duration":0.001722756,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:44.490559+0000","last_change":"2024-09-13T18:50:44.490637+0000","last_active":"2024-09-13T18:50:44.490559+0000","last_peered":"2024-09-13T18:50:44.490559+0000","last_clean":"2024-09-13T18:50:44.490559+0000","last_became_active":"2024-09-13T18:45:22.032851+0000","last_became_peered":"2024-09-13T18:45:22.032851+0000","last_unstale":"2024-09-13T18:50:44.490559+0000","last_undegraded":"2024-09-13T18:50:44.490559+0000","last_fullsized":"2024-09-13T18:50:44.490559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:44.490540+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:44.490540+0000","last_clean_scrub_stamp":"2024-09-13T18:50:44.490540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:19.929534+0000","scrub_duration":0.0012625819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:13.781325+0000","last_change":"2024-09-13T18:51:13.781438+0000","last_active":"2024-09-13T18:51:13.781325+0000","last_peered":"2024-09-13T18:51:13.781325+0000","last_clean":"2024-09-13T18:51:13.781325+0000","last_became_active":"2024-09-13T18:45:22.033156+0000","last_became_peered":"2024-09-13T18:45:22.033156+0000","last_unstale":"2024-09-13T18:51:13.781325+0000","last_undegraded":"2024-09-13T18:51:13.781325+0000","last_fullsized":"2024-09-13T18:51:13.781325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:13.781297+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:13.781297+0000","last_clean_scrub_stamp":"2024-09-13T18:51:13.781297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:36.955325+0000","scrub_duration":0.001953104,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:08.342365+0000","last_change":"2024-09-13T18:51:08.342520+0000","last_active":"2024-09-13T18:51:08.342365+0000","last_peered":"2024-09-13T18:51:08.342365+0000","last_clean":"2024-09-13T18:51:08.342365+0000","last_became_active":"2024-09-13T18:45:22.029654+0000","last_became_peered":"2024-09-13T18:45:22.029654+0000","last_unstale":"2024-09-13T18:51:08.342365+0000","last_undegraded":"2024-09-13T18:51:08.342365+0000","last_fullsized":"2024-09-13T18:51:08.342365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:08.342338+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:08.342338+0000","last_clean_scrub_stamp":"2024-09-13T18:51:08.342338+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:26.590827+0000","scrub_duration":0.0017863480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'13","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.289706+0000","last_change":"2024-09-13T18:51:01.289810+0000","last_active":"2024-09-13T18:51:01.289706+0000","last_peered":"2024-09-13T18:51:01.289706+0000","last_clean":"2024-09-13T18:51:01.289706+0000","last_became_active":"2024-09-13T18:45:22.028031+0000","last_became_peered":"2024-09-13T18:45:22.028031+0000","last_unstale":"2024-09-13T18:51:01.289706+0000","last_undegraded":"2024-09-13T18:51:01.289706+0000","last_fullsized":"2024-09-13T18:51:01.289706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-09-13T18:51:01.289682+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-09-13T18:51:01.289682+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.289682+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:15.769701+0000","scrub_duration":0.0012523860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:10.763853+0000","last_change":"2024-09-13T18:51:10.763987+0000","last_active":"2024-09-13T18:51:10.763853+0000","last_peered":"2024-09-13T18:51:10.763853+0000","last_clean":"2024-09-13T18:51:10.763853+0000","last_became_active":"2024-09-13T18:45:22.032561+0000","last_became_peered":"2024-09-13T18:45:22.032561+0000","last_unstale":"2024-09-13T18:51:10.763853+0000","last_undegraded":"2024-09-13T18:51:10.763853+0000","last_fullsized":"2024-09-13T18:51:10.763853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:10.763829+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:10.763829+0000","last_clean_scrub_stamp":"2024-09-13T18:51:10.763829+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:55.660046+0000","scrub_duration":0.0021163110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:06.469308+0000","last_change":"2024-09-13T18:51:06.469397+0000","last_active":"2024-09-13T18:51:06.469308+0000","last_peered":"2024-09-13T18:51:06.469308+0000","last_clean":"2024-09-13T18:51:06.469308+0000","last_became_active":"2024-09-13T18:45:22.036380+0000","last_became_peered":"2024-09-13T18:45:22.036380+0000","last_unstale":"2024-09-13T18:51:06.469308+0000","last_undegraded":"2024-09-13T18:51:06.469308+0000","last_fullsized":"2024-09-13T18:51:06.469308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:51:06.469283+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:51:06.469283+0000","last_clean_scrub_stamp":"2024-09-13T18:51:06.469283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:33.084669+0000","scrub_duration":0.0018037019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:43.876477+0000","last_change":"2024-09-13T18:50:43.876558+0000","last_active":"2024-09-13T18:50:43.876477+0000","last_peered":"2024-09-13T18:50:43.876477+0000","last_clean":"2024-09-13T18:50:43.876477+0000","last_became_active":"2024-09-13T18:45:22.034646+0000","last_became_peered":"2024-09-13T18:45:22.034646+0000","last_unstale":"2024-09-13T18:50:43.876477+0000","last_undegraded":"2024-09-13T18:50:43.876477+0000","last_fullsized":"2024-09-13T18:50:43.876477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:50:43.876456+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:50:43.876456+0000","last_clean_scrub_stamp":"2024-09-13T18:50:43.876456+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.356475+0000","scrub_duration":0.0016307299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'13","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.716811+0000","last_change":"2024-09-13T18:45:22.029195+0000","last_active":"2024-09-13T18:50:38.716811+0000","last_peered":"2024-09-13T18:50:38.716811+0000","last_clean":"2024-09-13T18:50:38.716811+0000","last_became_active":"2024-09-13T18:45:22.028430+0000","last_became_peered":"2024-09-13T18:45:22.028430+0000","last_unstale":"2024-09-13T18:50:38.716811+0000","last_undegraded":"2024-09-13T18:50:38.716811+0000","last_fullsized":"2024-09-13T18:50:38.716811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'11","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:09.582511+0000","last_change":"2024-09-13T18:51:09.582639+0000","last_active":"2024-09-13T18:51:09.582511+0000","last_peered":"2024-09-13T18:51:09.582511+0000","last_clean":"2024-09-13T18:51:09.582511+0000","last_became_active":"2024-09-13T18:45:22.019733+0000","last_became_peered":"2024-09-13T18:45:22.019733+0000","last_unstale":"2024-09-13T18:51:09.582511+0000","last_undegraded":"2024-09-13T18:51:09.582511+0000","last_fullsized":"2024-09-13T18:51:09.582511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:51:09.582487+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:51:09.582487+0000","last_clean_scrub_stamp":"2024-09-13T18:51:09.582487+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:47.859252+0000","scrub_duration":0.0019273700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:08.225956+0000","last_change":"2024-09-13T18:51:08.226058+0000","last_active":"2024-09-13T18:51:08.225956+0000","last_peered":"2024-09-13T18:51:08.225956+0000","last_clean":"2024-09-13T18:51:08.225956+0000","last_became_active":"2024-09-13T18:45:22.015868+0000","last_became_peered":"2024-09-13T18:45:22.015868+0000","last_unstale":"2024-09-13T18:51:08.225956+0000","last_undegraded":"2024-09-13T18:51:08.225956+0000","last_fullsized":"2024-09-13T18:51:08.225956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:08.225930+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:08.225930+0000","last_clean_scrub_stamp":"2024-09-13T18:51:08.225930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:04.094791+0000","scrub_duration":0.0015192599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:46.911973+0000","last_change":"2024-09-13T18:50:46.912064+0000","last_active":"2024-09-13T18:50:46.911973+0000","last_peered":"2024-09-13T18:50:46.911973+0000","last_clean":"2024-09-13T18:50:46.911973+0000","last_became_active":"2024-09-13T18:45:22.034019+0000","last_became_peered":"2024-09-13T18:45:22.034019+0000","last_unstale":"2024-09-13T18:50:46.911973+0000","last_undegraded":"2024-09-13T18:50:46.911973+0000","last_fullsized":"2024-09-13T18:50:46.911973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:46.911953+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:46.911953+0000","last_clean_scrub_stamp":"2024-09-13T18:50:46.911953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:36.922217+0000","scrub_duration":0.0017146489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'12","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.657819+0000","last_change":"2024-09-13T18:50:49.657990+0000","last_active":"2024-09-13T18:50:49.657819+0000","last_peered":"2024-09-13T18:50:49.657819+0000","last_clean":"2024-09-13T18:50:49.657819+0000","last_became_active":"2024-09-13T18:45:22.020415+0000","last_became_peered":"2024-09-13T18:45:22.020415+0000","last_unstale":"2024-09-13T18:50:49.657819+0000","last_undegraded":"2024-09-13T18:50:49.657819+0000","last_fullsized":"2024-09-13T18:50:49.657819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-09-13T18:50:49.657795+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-09-13T18:50:49.657795+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.657795+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:11.513081+0000","scrub_duration":0.0020089489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:12.465521+0000","last_change":"2024-09-13T18:51:12.465623+0000","last_active":"2024-09-13T18:51:12.465521+0000","last_peered":"2024-09-13T18:51:12.465521+0000","last_clean":"2024-09-13T18:51:12.465521+0000","last_became_active":"2024-09-13T18:45:22.035491+0000","last_became_peered":"2024-09-13T18:45:22.035491+0000","last_unstale":"2024-09-13T18:51:12.465521+0000","last_undegraded":"2024-09-13T18:51:12.465521+0000","last_fullsized":"2024-09-13T18:51:12.465521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:12.465495+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:12.465495+0000","last_clean_scrub_stamp":"2024-09-13T18:51:12.465495+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:50.742260+0000","scrub_duration":0.0014084880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'11","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:57.604594+0000","last_change":"2024-09-13T18:50:57.604705+0000","last_active":"2024-09-13T18:50:57.604594+0000","last_peered":"2024-09-13T18:50:57.604594+0000","last_clean":"2024-09-13T18:50:57.604594+0000","last_became_active":"2024-09-13T18:46:11.146859+0000","last_became_peered":"2024-09-13T18:46:11.146859+0000","last_unstale":"2024-09-13T18:50:57.604594+0000","last_undegraded":"2024-09-13T18:50:57.604594+0000","last_fullsized":"2024-09-13T18:50:57.604594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:50:57.604573+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:50:57.604573+0000","last_clean_scrub_stamp":"2024-09-13T18:50:57.604573+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:18.943443+0000","scrub_duration":0.001354744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.403472+0000","last_change":"2024-09-13T18:51:17.403572+0000","last_active":"2024-09-13T18:51:17.403472+0000","last_peered":"2024-09-13T18:51:17.403472+0000","last_clean":"2024-09-13T18:51:17.403472+0000","last_became_active":"2024-09-13T18:45:22.021042+0000","last_became_peered":"2024-09-13T18:45:22.021042+0000","last_unstale":"2024-09-13T18:51:17.403472+0000","last_undegraded":"2024-09-13T18:51:17.403472+0000","last_fullsized":"2024-09-13T18:51:17.403472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:17.403444+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:17.403444+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.403444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:19.693997+0000","scrub_duration":0.0017615700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:10.562357+0000","last_change":"2024-09-13T18:51:10.562498+0000","last_active":"2024-09-13T18:51:10.562357+0000","last_peered":"2024-09-13T18:51:10.562357+0000","last_clean":"2024-09-13T18:51:10.562357+0000","last_became_active":"2024-09-13T18:45:22.021366+0000","last_became_peered":"2024-09-13T18:45:22.021366+0000","last_unstale":"2024-09-13T18:51:10.562357+0000","last_undegraded":"2024-09-13T18:51:10.562357+0000","last_fullsized":"2024-09-13T18:51:10.562357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:10.562334+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:10.562334+0000","last_clean_scrub_stamp":"2024-09-13T18:51:10.562334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:55.458551+0000","scrub_duration":0.001601419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'10","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:50.854309+0000","last_change":"2024-09-13T18:50:50.854426+0000","last_active":"2024-09-13T18:50:50.854309+0000","last_peered":"2024-09-13T18:50:50.854309+0000","last_clean":"2024-09-13T18:50:50.854309+0000","last_became_active":"2024-09-13T18:45:22.028594+0000","last_became_peered":"2024-09-13T18:45:22.028594+0000","last_unstale":"2024-09-13T18:50:50.854309+0000","last_undegraded":"2024-09-13T18:50:50.854309+0000","last_fullsized":"2024-09-13T18:50:50.854309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-09-13T18:50:50.854284+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-09-13T18:50:50.854284+0000","last_clean_scrub_stamp":"2024-09-13T18:50:50.854284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:46.723145+0000","scrub_duration":0.0018955790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:58.758344+0000","last_change":"2024-09-13T18:50:58.758450+0000","last_active":"2024-09-13T18:50:58.758344+0000","last_peered":"2024-09-13T18:50:58.758344+0000","last_clean":"2024-09-13T18:50:58.758344+0000","last_became_active":"2024-09-13T18:45:22.016731+0000","last_became_peered":"2024-09-13T18:45:22.016731+0000","last_unstale":"2024-09-13T18:50:58.758344+0000","last_undegraded":"2024-09-13T18:50:58.758344+0000","last_fullsized":"2024-09-13T18:50:58.758344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:58.758323+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:58.758323+0000","last_clean_scrub_stamp":"2024-09-13T18:50:58.758323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:12.317546+0000","scrub_duration":0.0014195729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:04.219420+0000","last_change":"2024-09-13T18:51:04.219534+0000","last_active":"2024-09-13T18:51:04.219420+0000","last_peered":"2024-09-13T18:51:04.219420+0000","last_clean":"2024-09-13T18:51:04.219420+0000","last_became_active":"2024-09-13T18:45:22.027899+0000","last_became_peered":"2024-09-13T18:45:22.027899+0000","last_unstale":"2024-09-13T18:51:04.219420+0000","last_undegraded":"2024-09-13T18:51:04.219420+0000","last_fullsized":"2024-09-13T18:51:04.219420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:04.219395+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:04.219395+0000","last_clean_scrub_stamp":"2024-09-13T18:51:04.219395+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:25.558266+0000","scrub_duration":0.0013989510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:10.239934+0000","last_change":"2024-09-13T18:51:10.240028+0000","last_active":"2024-09-13T18:51:10.239934+0000","last_peered":"2024-09-13T18:51:10.239934+0000","last_clean":"2024-09-13T18:51:10.239934+0000","last_became_active":"2024-09-13T18:45:22.024014+0000","last_became_peered":"2024-09-13T18:45:22.024014+0000","last_unstale":"2024-09-13T18:51:10.239934+0000","last_undegraded":"2024-09-13T18:51:10.239934+0000","last_fullsized":"2024-09-13T18:51:10.239934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2024-09-13T18:51:10.239911+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2024-09-13T18:51:10.239911+0000","last_clean_scrub_stamp":"2024-09-13T18:51:10.239911+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.117838+0000","scrub_duration":0.0014525180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'9","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.719401+0000","last_change":"2024-09-13T18:45:22.036551+0000","last_active":"2024-09-13T18:50:38.719401+0000","last_peered":"2024-09-13T18:50:38.719401+0000","last_clean":"2024-09-13T18:50:38.719401+0000","last_became_active":"2024-09-13T18:45:22.036269+0000","last_became_peered":"2024-09-13T18:45:22.036269+0000","last_unstale":"2024-09-13T18:50:38.719401+0000","last_undegraded":"2024-09-13T18:50:38.719401+0000","last_fullsized":"2024-09-13T18:50:38.719401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.719595+0000","last_change":"2024-09-13T18:45:22.032392+0000","last_active":"2024-09-13T18:50:38.719595+0000","last_peered":"2024-09-13T18:50:38.719595+0000","last_clean":"2024-09-13T18:50:38.719595+0000","last_became_active":"2024-09-13T18:45:22.027605+0000","last_became_peered":"2024-09-13T18:45:22.027605+0000","last_unstale":"2024-09-13T18:50:38.719595+0000","last_undegraded":"2024-09-13T18:50:38.719595+0000","last_fullsized":"2024-09-13T18:50:38.719595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.713788+0000","last_change":"2024-09-13T18:45:22.029307+0000","last_active":"2024-09-13T18:50:38.713788+0000","last_peered":"2024-09-13T18:50:38.713788+0000","last_clean":"2024-09-13T18:50:38.713788+0000","last_became_active":"2024-09-13T18:45:22.029018+0000","last_became_peered":"2024-09-13T18:45:22.029018+0000","last_unstale":"2024-09-13T18:50:38.713788+0000","last_undegraded":"2024-09-13T18:50:38.713788+0000","last_fullsized":"2024-09-13T18:50:38.713788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.714656+0000","last_change":"2024-09-13T18:45:22.029061+0000","last_active":"2024-09-13T18:50:38.714656+0000","last_peered":"2024-09-13T18:50:38.714656+0000","last_clean":"2024-09-13T18:50:38.714656+0000","last_became_active":"2024-09-13T18:45:22.028758+0000","last_became_peered":"2024-09-13T18:45:22.028758+0000","last_unstale":"2024-09-13T18:50:38.714656+0000","last_undegraded":"2024-09-13T18:50:38.714656+0000","last_fullsized":"2024-09-13T18:50:38.714656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:15.836886+0000","last_change":"2024-09-13T18:51:15.837024+0000","last_active":"2024-09-13T18:51:15.836886+0000","last_peered":"2024-09-13T18:51:15.836886+0000","last_clean":"2024-09-13T18:51:15.836886+0000","last_became_active":"2024-09-13T18:45:22.029403+0000","last_became_peered":"2024-09-13T18:45:22.029403+0000","last_unstale":"2024-09-13T18:51:15.836886+0000","last_undegraded":"2024-09-13T18:51:15.836886+0000","last_fullsized":"2024-09-13T18:51:15.836886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:15.836847+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:15.836847+0000","last_clean_scrub_stamp":"2024-09-13T18:51:15.836847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:34.085336+0000","scrub_duration":0.0017205300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'6","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.718363+0000","last_change":"2024-09-13T18:45:22.038483+0000","last_active":"2024-09-13T18:50:38.718363+0000","last_peered":"2024-09-13T18:50:38.718363+0000","last_clean":"2024-09-13T18:50:38.718363+0000","last_became_active":"2024-09-13T18:45:22.036877+0000","last_became_peered":"2024-09-13T18:45:22.036877+0000","last_unstale":"2024-09-13T18:50:38.718363+0000","last_undegraded":"2024-09-13T18:50:38.718363+0000","last_fullsized":"2024-09-13T18:50:38.718363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'8","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:13.580946+0000","last_change":"2024-09-13T18:51:13.581085+0000","last_active":"2024-09-13T18:51:13.580946+0000","last_peered":"2024-09-13T18:51:13.580946+0000","last_clean":"2024-09-13T18:51:13.580946+0000","last_became_active":"2024-09-13T18:45:22.022618+0000","last_became_peered":"2024-09-13T18:45:22.022618+0000","last_unstale":"2024-09-13T18:51:13.580946+0000","last_undegraded":"2024-09-13T18:51:13.580946+0000","last_fullsized":"2024-09-13T18:51:13.580946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:13.580921+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:13.580921+0000","last_clean_scrub_stamp":"2024-09-13T18:51:13.580921+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:36.754949+0000","scrub_duration":0.001570622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.714306+0000","last_change":"2024-09-13T18:45:22.028545+0000","last_active":"2024-09-13T18:50:38.714306+0000","last_peered":"2024-09-13T18:50:38.714306+0000","last_clean":"2024-09-13T18:50:38.714306+0000","last_became_active":"2024-09-13T18:45:22.028291+0000","last_became_peered":"2024-09-13T18:45:22.028291+0000","last_unstale":"2024-09-13T18:50:38.714306+0000","last_undegraded":"2024-09-13T18:50:38.714306+0000","last_fullsized":"2024-09-13T18:50:38.714306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'10","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:38.717579+0000","last_change":"2024-09-13T18:45:22.034460+0000","last_active":"2024-09-13T18:50:38.717579+0000","last_peered":"2024-09-13T18:50:38.717579+0000","last_clean":"2024-09-13T18:50:38.717579+0000","last_became_active":"2024-09-13T18:45:22.033974+0000","last_became_peered":"2024-09-13T18:45:22.033974+0000","last_unstale":"2024-09-13T18:50:38.717579+0000","last_undegraded":"2024-09-13T18:50:38.717579+0000","last_fullsized":"2024-09-13T18:50:38.717579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:21.639437+0000","last_clean_scrub_stamp":"2024-09-13T18:45:21.639437+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":954260,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":272,"num_write_kb":1081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":1908520,"data_compressed":245052,"data_compressed_allocated":294912,"data_compressed_original":1441792,"omap_allocated":0,"internal_metadata":0},"log_size":353,"ondisk_log_size":353,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":704313,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.42399999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.754},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.46999999999999997},"min":{"1min":0.36199999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.65400000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.68200000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49099999999999999,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70799999999999996,"5min":0.749,"15min":0.749},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.432,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67300000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66200000000000003,"5min":0.755,"15min":0.755},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.48099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.66800000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.47099999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47299999999999998,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60399999999999998,"5min":0.748,"15min":0.748},"last":0.5}]},{"osd":5,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.52100000000000002},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.54300000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73099999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.45800000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.57199999999999995},"min":{"1min":0.41199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.435}]}]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":655360,"data_stored":1055800,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.67600000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.746,"15min":0.746},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67700000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.61099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70699999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42299999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47299999999999998},"min":{"1min":0.33100000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63600000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.42799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.379},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.47299999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.41399999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.40000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.495}]}]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":113453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.32600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.626,"5min":0.87,"15min":0.87},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78700000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67600000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54000000000000004,"15min":0.56299999999999994},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.55200000000000005},"min":{"1min":0.36899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76100000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.33000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.33800000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59999999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.434},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40100000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71999999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.40200000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68600000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.39900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":113489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.377,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.67400000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.499,"15min":0.499},"min":{"1min":0.35099999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.503}]},{"osd":1,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.255,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66500000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.56200000000000006},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.435,"5min":0.25,"15min":0.25},"max":{"1min":0.747,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.41199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.40400000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59099999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47599999999999998,"15min":0.497},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.36099999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72299999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.433},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":1.075,"15min":1.075},"last":0.45300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":667648,"data_stored":1066825,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.63600000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.375,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.498,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.40600000000000003},"min":{"1min":0.251,"5min":0.223,"15min":0.223},"max":{"1min":0.753,"5min":1.121,"15min":1.121},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67200000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.373}]},{"osd":2,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.46800000000000003},"min":{"1min":0.314,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61299999999999999,"15min":0.58999999999999997},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.505},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59699999999999998,"15min":0.623},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81000000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.624},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:50:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73199999999999998,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63,"15min":0.67300000000000004},"min":{"1min":0.41899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.58199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":290816,"data_stored":124388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.35899999999999999},"min":{"1min":0.20899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70899999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40600000000000003,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54300000000000004,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.432,"15min":0.41199999999999998},"min":{"1min":0.27400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.376}]},{"osd":3,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.437},"min":{"1min":0.33000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.438},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70499999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.44500000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77100000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.505},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.627},"min":{"1min":0.46500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76700000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.82099999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.626}]},{"osd":6,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.45600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.995,"15min":0.995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:50:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63400000000000001,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83699999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.45100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83299999999999996,"5min":0.874,"15min":0.874},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":113523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.23599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.56200000000000006,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.371},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36399999999999999,"15min":0.34799999999999998},"min":{"1min":0.23499999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.22500000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.315},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.52900000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.435,"15min":0.42299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.57499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.38800000000000001},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.434}]},{"osd":4,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.74299999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79700000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72499999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74199999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77000000000000002,"5min":0.872,"15min":0.872},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:50:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80200000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.68999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":356352,"data_stored":704369,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39900000000000002,"15min":0.42299999999999999},"min":{"1min":0.23300000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.629,"5min":1.496,"15min":1.496},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.40300000000000002},"min":{"1min":0.252,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56699999999999995,"5min":1.024,"15min":1.024},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.26900000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.76300000000000001,"5min":1.518,"15min":1.518},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.29399999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.83699999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.28599999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.249,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":1.294,"15min":1.294},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.438}]},{"osd":4,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.64800000000000002},"min":{"1min":0.439,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91500000000000004,"5min":1.198,"15min":1.198},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73899999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.69399999999999995},"min":{"1min":0.42499999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61699999999999999,"15min":0.64800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96899999999999997,"5min":1.143,"15min":1.143},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60799999999999998,"15min":0.65100000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.72699999999999998,"5min":1.391,"15min":1.391},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66100000000000003,"15min":0.72899999999999998},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84999999999999998,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:50:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67900000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.623},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63,"15min":0.68000000000000005},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.82099999999999995,"5min":1.363,"15min":1.363},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":11025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":953462,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":942437,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:51:25.990 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.990 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.990 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.990 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.990 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.990 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.990 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.991 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.991 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.991 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.991 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.991 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.991 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.991 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.992 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.992 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.992 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.992 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.992 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.992 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.992 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.993 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.993 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.993 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.993 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.993 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.993 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.993 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.993 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.994 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.994 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.994 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.994 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.994 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.994 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.995 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.995 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.995 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T18:45:21.639437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:25.995 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:51:38.171 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:51:38.175 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:51:45.995 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:51:46.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.110+0000 7f5a66241640 1 Processor -- start 2024-09-13T18:51:46.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.110+0000 7f5a66241640 1 -- start start 2024-09-13T18:51:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a66241640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5a600712c0 0x7f5a6013d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a66241640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a60071900 0x7f5a6013da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a66241640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6006eab0 con 0x7f5a600b0cd0 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a66241640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6006f3c0 con 0x7f5a60071900 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a66241640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6013df70 con 0x7f5a600712c0 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a5ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a60071900 0x7f5a6013da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a5ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a60071900 0x7f5a6013da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47566/0 (socket says 172.21.15.29:47566) 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a5ffff640 1 -- 172.21.15.29:0/1896021817 learned_addr learned my addr 172.21.15.29:0/1896021817 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a5effd640 1 --2- 172.21.15.29:0/1896021817 >> v2:172.21.15.96:3300/0 conn(0x7f5a600712c0 0x7f5a6013d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a5ffff640 1 -- 172.21.15.29:0/1896021817 >> v2:172.21.15.96:3300/0 conn(0x7f5a600712c0 msgr2=0x7f5a6013d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a5ffff640 1 --2- 172.21.15.29:0/1896021817 >> v2:172.21.15.96:3300/0 conn(0x7f5a600712c0 0x7f5a6013d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a5ffff640 1 -- 172.21.15.29:0/1896021817 >> v1:172.21.15.96:6789/0 conn(0x7f5a600b0cd0 legacy=0x7f5a60070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.111+0000 7f5a5ffff640 1 -- 172.21.15.29:0/1896021817 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a600b10b0 con 0x7f5a60071900 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.112+0000 7f5a5ffff640 1 --2- 172.21.15.29:0/1896021817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a60071900 0x7f5a6013da30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5a600ae720 tx=0x7f5a5802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6f98063d0fc2d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.112+0000 7f5a5e7fc640 1 -- 172.21.15.29:0/1896021817 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58031600 con 0x7f5a60071900 2024-09-13T18:51:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.112+0000 7f5a5e7fc640 1 -- 172.21.15.29:0/1896021817 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5802d050 con 0x7f5a60071900 2024-09-13T18:51:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.112+0000 7f5a5e7fc640 1 -- 172.21.15.29:0/1896021817 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58031980 con 0x7f5a60071900 2024-09-13T18:51:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.113+0000 7f5a66241640 1 -- 172.21.15.29:0/1896021817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a60071900 msgr2=0x7f5a6013da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.113+0000 7f5a66241640 1 --2- 172.21.15.29:0/1896021817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a60071900 0x7f5a6013da30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5a600ae720 tx=0x7f5a5802a6a0 comp rx=0 tx=0).stop 2024-09-13T18:51:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.113+0000 7f5a66241640 1 -- 172.21.15.29:0/1896021817 shutdown_connections 2024-09-13T18:51:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.113+0000 7f5a66241640 1 --2- 172.21.15.29:0/1896021817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a60071900 0x7f5a6013da30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.113+0000 7f5a66241640 1 --2- 172.21.15.29:0/1896021817 >> v2:172.21.15.96:3300/0 conn(0x7f5a600712c0 0x7f5a6013d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.113+0000 7f5a66241640 1 -- 172.21.15.29:0/1896021817 >> 172.21.15.29:0/1896021817 conn(0x7f5a6006a890 msgr2=0x7f5a600b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.113+0000 7f5a66241640 1 -- 172.21.15.29:0/1896021817 shutdown_connections 2024-09-13T18:51:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.113+0000 7f5a66241640 1 -- 172.21.15.29:0/1896021817 wait complete. 2024-09-13T18:51:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.114+0000 7f5a66241640 1 Processor -- start 2024-09-13T18:51:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.114+0000 7f5a66241640 1 -- start start 2024-09-13T18:51:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a66241640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a600712c0 0x7f5a600abb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a66241640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a60071900 0x7f5a600a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a66241640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a600b0cd0 0x7f5a600a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a66241640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6013c190 con 0x7f5a60071900 2024-09-13T18:51:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a66241640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600a85a0 con 0x7f5a600b0cd0 2024-09-13T18:51:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a66241640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600ad4e0 con 0x7f5a600712c0 2024-09-13T18:51:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a5effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a60071900 0x7f5a600a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a5effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a60071900 0x7f5a600a8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47568/0 (socket says 172.21.15.29:47568) 2024-09-13T18:51:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a5effd640 1 -- 172.21.15.29:0/1264905444 learned_addr learned my addr 172.21.15.29:0/1264905444 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:51:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a5ffff640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a600b0cd0 0x7f5a600a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a5f7fe640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a600712c0 0x7f5a600abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a5effd640 1 -- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a600712c0 msgr2=0x7f5a600abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a5effd640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a600712c0 0x7f5a600abb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a5effd640 1 -- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a600b0cd0 msgr2=0x7f5a600a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a5effd640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a600b0cd0 0x7f5a600a8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a5effd640 1 -- 172.21.15.29:0/1264905444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a58009b30 con 0x7f5a60071900 2024-09-13T18:51:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.115+0000 7f5a5effd640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a60071900 0x7f5a600a8a80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400d800 tx=0x7f5a5400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.116+0000 7f5a47fff640 1 -- 172.21.15.29:0/1264905444 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5400b6c0 con 0x7f5a60071900 2024-09-13T18:51:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.116+0000 7f5a47fff640 1 -- 172.21.15.29:0/1264905444 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5400b840 con 0x7f5a60071900 2024-09-13T18:51:46.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.116+0000 7f5a66241640 1 -- 172.21.15.29:0/1264905444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a600ad7c0 con 0x7f5a60071900 2024-09-13T18:51:46.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.116+0000 7f5a47fff640 1 -- 172.21.15.29:0/1264905444 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5400bbf0 con 0x7f5a60071900 2024-09-13T18:51:46.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.116+0000 7f5a66241640 1 -- 172.21.15.29:0/1264905444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a600ac080 con 0x7f5a60071900 2024-09-13T18:51:46.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.117+0000 7f5a66241640 1 -- 172.21.15.29:0/1264905444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a600a8760 con 0x7f5a60071900 2024-09-13T18:51:46.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.117+0000 7f5a47fff640 1 -- 172.21.15.29:0/1264905444 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5a5400bd50 con 0x7f5a60071900 2024-09-13T18:51:46.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.118+0000 7f5a47fff640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5a4c06ac00 0x7f5a4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:46.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.118+0000 7f5a47fff640 1 -- 172.21.15.29:0/1264905444 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5a54089be0 con 0x7f5a60071900 2024-09-13T18:51:46.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.118+0000 7f5a5f7fe640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5a4c06ac00 0x7f5a4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:46.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.118+0000 7f5a5f7fe640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5a4c06ac00 0x7f5a4c06d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5a601401f0 tx=0x7f5a50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.122+0000 7f5a47fff640 1 -- 172.21.15.29:0/1264905444 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5a54054a90 con 0x7f5a60071900 2024-09-13T18:51:46.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.291+0000 7f5a66241640 1 -- 172.21.15.29:0/1264905444 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a600ac270 con 0x7f5a4c06ac00 2024-09-13T18:51:46.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.301+0000 7f5a47fff640 1 -- 172.21.15.29:0/1264905444 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372833 (secure 0 0 0) 0x7f5a600ac270 con 0x7f5a4c06ac00 2024-09-13T18:51:46.308 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:51:46.311 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-13T18:51:46.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.304+0000 7f5a66241640 1 -- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5a4c06ac00 msgr2=0x7f5a4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.304+0000 7f5a66241640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5a4c06ac00 0x7f5a4c06d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5a601401f0 tx=0x7f5a50009040 comp rx=0 tx=0).stop 2024-09-13T18:51:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.304+0000 7f5a66241640 1 -- 172.21.15.29:0/1264905444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a60071900 msgr2=0x7f5a600a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.304+0000 7f5a66241640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a60071900 0x7f5a600a8a80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400d800 tx=0x7f5a5400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:51:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.304+0000 7f5a66241640 1 -- 172.21.15.29:0/1264905444 shutdown_connections 2024-09-13T18:51:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.304+0000 7f5a66241640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5a4c06ac00 0x7f5a4c06d0c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.305+0000 7f5a66241640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a600b0cd0 0x7f5a600a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.305+0000 7f5a66241640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a60071900 0x7f5a600a8a80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.305+0000 7f5a66241640 1 --2- 172.21.15.29:0/1264905444 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a600712c0 0x7f5a600abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.305+0000 7f5a66241640 1 -- 172.21.15.29:0/1264905444 >> 172.21.15.29:0/1264905444 conn(0x7f5a6006a890 msgr2=0x7f5a600b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.305+0000 7f5a66241640 1 -- 172.21.15.29:0/1264905444 shutdown_connections 2024-09-13T18:51:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:51:46.305+0000 7f5a66241640 1 -- 172.21.15.29:0/1264905444 wait complete. 2024-09-13T18:51:46.318 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-09-13T18:51:45.689159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1544628,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":156,"num_read_kb":140,"num_write":437,"num_write_kb":3501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":981,"ondisk_log_size":981,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235616,"kb_used_data":3104,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739104,"statfs":{"total":773094113280,"available":772852842496,"internally_reserved":0,"allocated":3178496,"data_stored":3996160,"data_compressed":310028,"data_compressed_allocated":385024,"data_compressed_original":2588672,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003389"},"pg_stats":[{"pgid":"2.1f","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.536748+0000","last_change":"2024-09-13T18:50:48.536748+0000","last_active":"2024-09-13T18:50:48.536748+0000","last_peered":"2024-09-13T18:50:48.536748+0000","last_clean":"2024-09-13T18:50:48.536748+0000","last_became_active":"2024-09-13T18:45:21.667985+0000","last_became_peered":"2024-09-13T18:45:21.667985+0000","last_unstale":"2024-09-13T18:50:48.536748+0000","last_undegraded":"2024-09-13T18:50:48.536748+0000","last_fullsized":"2024-09-13T18:50:48.536748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:48.536623+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:48.536623+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.536623+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:34.362710+0000","scrub_duration":0.0039049509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:23.629992+0000","last_change":"2024-09-13T18:51:23.629992+0000","last_active":"2024-09-13T18:51:23.629992+0000","last_peered":"2024-09-13T18:51:23.629992+0000","last_clean":"2024-09-13T18:51:23.629992+0000","last_became_active":"2024-09-13T18:45:22.034125+0000","last_became_peered":"2024-09-13T18:45:22.034125+0000","last_unstale":"2024-09-13T18:51:23.629992+0000","last_undegraded":"2024-09-13T18:51:23.629992+0000","last_fullsized":"2024-09-13T18:51:23.629992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:23.629854+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:23.629854+0000","last_clean_scrub_stamp":"2024-09-13T18:51:23.629854+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:56.558159+0000","scrub_duration":0.001719728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:16.632775+0000","last_change":"2024-09-13T18:45:26.253118+0000","last_active":"2024-09-13T18:50:16.632775+0000","last_peered":"2024-09-13T18:50:16.632775+0000","last_clean":"2024-09-13T18:50:16.632775+0000","last_became_active":"2024-09-13T18:45:26.252747+0000","last_became_peered":"2024-09-13T18:45:26.252747+0000","last_unstale":"2024-09-13T18:50:16.632775+0000","last_undegraded":"2024-09-13T18:50:16.632775+0000","last_fullsized":"2024-09-13T18:50:16.632775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:55.823028+0000","last_change":"2024-09-13T18:50:55.823028+0000","last_active":"2024-09-13T18:50:55.823028+0000","last_peered":"2024-09-13T18:50:55.823028+0000","last_clean":"2024-09-13T18:50:55.823028+0000","last_became_active":"2024-09-13T18:45:21.666398+0000","last_became_peered":"2024-09-13T18:45:21.666398+0000","last_unstale":"2024-09-13T18:50:55.823028+0000","last_undegraded":"2024-09-13T18:50:55.823028+0000","last_fullsized":"2024-09-13T18:50:55.823028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:55.822888+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:55.822888+0000","last_clean_scrub_stamp":"2024-09-13T18:50:55.822888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:09.382112+0000","scrub_duration":0.001447315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:03.501489+0000","last_change":"2024-09-13T18:51:03.501489+0000","last_active":"2024-09-13T18:51:03.501489+0000","last_peered":"2024-09-13T18:51:03.501489+0000","last_clean":"2024-09-13T18:51:03.501489+0000","last_became_active":"2024-09-13T18:45:22.024424+0000","last_became_peered":"2024-09-13T18:45:22.024424+0000","last_unstale":"2024-09-13T18:51:03.501489+0000","last_undegraded":"2024-09-13T18:51:03.501489+0000","last_fullsized":"2024-09-13T18:51:03.501489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:03.501346+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:03.501346+0000","last_clean_scrub_stamp":"2024-09-13T18:51:03.501346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:30.116732+0000","scrub_duration":0.001917361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:04.839924+0000","last_change":"2024-09-13T18:51:04.840041+0000","last_active":"2024-09-13T18:51:04.839924+0000","last_peered":"2024-09-13T18:51:04.839924+0000","last_clean":"2024-09-13T18:51:04.839924+0000","last_became_active":"2024-09-13T18:45:26.049414+0000","last_became_peered":"2024-09-13T18:45:26.049414+0000","last_unstale":"2024-09-13T18:51:04.839924+0000","last_undegraded":"2024-09-13T18:51:04.839924+0000","last_fullsized":"2024-09-13T18:51:04.839924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:04.839896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:04.839896+0000","last_clean_scrub_stamp":"2024-09-13T18:51:04.839896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:31.455281+0000","scrub_duration":0.0018258759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:00.920349+0000","last_change":"2024-09-13T18:51:00.920443+0000","last_active":"2024-09-13T18:51:00.920349+0000","last_peered":"2024-09-13T18:51:00.920349+0000","last_clean":"2024-09-13T18:51:00.920349+0000","last_became_active":"2024-09-13T18:45:21.667602+0000","last_became_peered":"2024-09-13T18:45:21.667602+0000","last_unstale":"2024-09-13T18:51:00.920349+0000","last_undegraded":"2024-09-13T18:51:00.920349+0000","last_fullsized":"2024-09-13T18:51:00.920349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:00.920324+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:00.920324+0000","last_clean_scrub_stamp":"2024-09-13T18:51:00.920324+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:59.320550+0000","scrub_duration":0.0027812430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:30.504702+0000","last_change":"2024-09-13T18:51:30.504795+0000","last_active":"2024-09-13T18:51:30.504702+0000","last_peered":"2024-09-13T18:51:30.504702+0000","last_clean":"2024-09-13T18:51:30.504702+0000","last_became_active":"2024-09-13T18:45:22.035790+0000","last_became_peered":"2024-09-13T18:45:22.035790+0000","last_unstale":"2024-09-13T18:51:30.504702+0000","last_undegraded":"2024-09-13T18:51:30.504702+0000","last_fullsized":"2024-09-13T18:51:30.504702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:30.504676+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:30.504676+0000","last_clean_scrub_stamp":"2024-09-13T18:51:30.504676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:42.258958+0000","scrub_duration":0.0014297890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:34.978876+0000","last_change":"2024-09-13T18:51:34.978993+0000","last_active":"2024-09-13T18:51:34.978876+0000","last_peered":"2024-09-13T18:51:34.978876+0000","last_clean":"2024-09-13T18:51:34.978876+0000","last_became_active":"2024-09-13T18:45:26.051873+0000","last_became_peered":"2024-09-13T18:45:26.051873+0000","last_unstale":"2024-09-13T18:51:34.978876+0000","last_undegraded":"2024-09-13T18:51:34.978876+0000","last_fullsized":"2024-09-13T18:51:34.978876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:34.978853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:34.978853+0000","last_clean_scrub_stamp":"2024-09-13T18:51:34.978853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:15.355473+0000","scrub_duration":0.0019576440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.931169+0000","last_change":"2024-09-13T18:50:51.931266+0000","last_active":"2024-09-13T18:50:51.931169+0000","last_peered":"2024-09-13T18:50:51.931169+0000","last_clean":"2024-09-13T18:50:51.931169+0000","last_became_active":"2024-09-13T18:45:21.669622+0000","last_became_peered":"2024-09-13T18:45:21.669622+0000","last_unstale":"2024-09-13T18:50:51.931169+0000","last_undegraded":"2024-09-13T18:50:51.931169+0000","last_fullsized":"2024-09-13T18:50:51.931169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:51.931146+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:51.931146+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.931146+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:13.786431+0000","scrub_duration":0.0028583060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'14","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:13.440684+0000","last_change":"2024-09-13T18:51:13.440828+0000","last_active":"2024-09-13T18:51:13.440684+0000","last_peered":"2024-09-13T18:51:13.440684+0000","last_clean":"2024-09-13T18:51:13.440684+0000","last_became_active":"2024-09-13T18:45:22.034431+0000","last_became_peered":"2024-09-13T18:45:22.034431+0000","last_unstale":"2024-09-13T18:51:13.440684+0000","last_undegraded":"2024-09-13T18:51:13.440684+0000","last_fullsized":"2024-09-13T18:51:13.440684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-09-13T18:51:13.440661+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-09-13T18:51:13.440661+0000","last_clean_scrub_stamp":"2024-09-13T18:51:13.440661+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:58.336878+0000","scrub_duration":0.001315384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:12.893027+0000","last_change":"2024-09-13T18:51:12.893188+0000","last_active":"2024-09-13T18:51:12.893027+0000","last_peered":"2024-09-13T18:51:12.893027+0000","last_clean":"2024-09-13T18:51:12.893027+0000","last_became_active":"2024-09-13T18:45:26.052441+0000","last_became_peered":"2024-09-13T18:45:26.052441+0000","last_unstale":"2024-09-13T18:51:12.893027+0000","last_undegraded":"2024-09-13T18:51:12.893027+0000","last_fullsized":"2024-09-13T18:51:12.893027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:12.893003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:12.893003+0000","last_clean_scrub_stamp":"2024-09-13T18:51:12.893003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:15.183557+0000","scrub_duration":0.0022650729999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.253089+0000","last_change":"2024-09-13T18:50:53.253185+0000","last_active":"2024-09-13T18:50:53.253089+0000","last_peered":"2024-09-13T18:50:53.253089+0000","last_clean":"2024-09-13T18:50:53.253089+0000","last_became_active":"2024-09-13T18:45:22.015758+0000","last_became_peered":"2024-09-13T18:45:22.015758+0000","last_unstale":"2024-09-13T18:50:53.253089+0000","last_undegraded":"2024-09-13T18:50:53.253089+0000","last_fullsized":"2024-09-13T18:50:53.253089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:53.253065+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:53.253065+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.253065+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:15.108350+0000","scrub_duration":0.001311446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:58.974434+0000","last_change":"2024-09-13T18:50:58.974551+0000","last_active":"2024-09-13T18:50:58.974434+0000","last_peered":"2024-09-13T18:50:58.974434+0000","last_clean":"2024-09-13T18:50:58.974434+0000","last_became_active":"2024-09-13T18:45:21.672388+0000","last_became_peered":"2024-09-13T18:45:21.672388+0000","last_unstale":"2024-09-13T18:50:58.974434+0000","last_undegraded":"2024-09-13T18:50:58.974434+0000","last_fullsized":"2024-09-13T18:50:58.974434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:50:58.974396+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:50:58.974396+0000","last_clean_scrub_stamp":"2024-09-13T18:50:58.974396+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:13.454414+0000","scrub_duration":0.0026098369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:27.949112+0000","last_change":"2024-09-13T18:51:27.949292+0000","last_active":"2024-09-13T18:51:27.949112+0000","last_peered":"2024-09-13T18:51:27.949112+0000","last_clean":"2024-09-13T18:51:27.949112+0000","last_became_active":"2024-09-13T18:46:11.149623+0000","last_became_peered":"2024-09-13T18:46:11.149623+0000","last_unstale":"2024-09-13T18:51:27.949112+0000","last_undegraded":"2024-09-13T18:51:27.949112+0000","last_fullsized":"2024-09-13T18:51:27.949112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:27.949088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:27.949088+0000","last_clean_scrub_stamp":"2024-09-13T18:51:27.949088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:35.324463+0000","scrub_duration":0.0023065080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:25.658533+0000","last_change":"2024-09-13T18:51:25.658624+0000","last_active":"2024-09-13T18:51:25.658533+0000","last_peered":"2024-09-13T18:51:25.658533+0000","last_clean":"2024-09-13T18:51:25.658533+0000","last_became_active":"2024-09-13T18:45:22.028336+0000","last_became_peered":"2024-09-13T18:45:22.028336+0000","last_unstale":"2024-09-13T18:51:25.658533+0000","last_undegraded":"2024-09-13T18:51:25.658533+0000","last_fullsized":"2024-09-13T18:51:25.658533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:51:25.658511+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:51:25.658511+0000","last_clean_scrub_stamp":"2024-09-13T18:51:25.658511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:33.033886+0000","scrub_duration":0.0014485850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.227304+0000","last_change":"2024-09-13T18:50:51.227414+0000","last_active":"2024-09-13T18:50:51.227304+0000","last_peered":"2024-09-13T18:50:51.227304+0000","last_clean":"2024-09-13T18:50:51.227304+0000","last_became_active":"2024-09-13T18:45:21.667625+0000","last_became_peered":"2024-09-13T18:45:21.667625+0000","last_unstale":"2024-09-13T18:50:51.227304+0000","last_undegraded":"2024-09-13T18:50:51.227304+0000","last_fullsized":"2024-09-13T18:50:51.227304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:51.227280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:51.227280+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.227280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:05.707299+0000","scrub_duration":0.001427123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:29.924495+0000","last_change":"2024-09-13T18:51:29.924650+0000","last_active":"2024-09-13T18:51:29.924495+0000","last_peered":"2024-09-13T18:51:29.924495+0000","last_clean":"2024-09-13T18:51:29.924495+0000","last_became_active":"2024-09-13T18:45:26.049129+0000","last_became_peered":"2024-09-13T18:45:26.049129+0000","last_unstale":"2024-09-13T18:51:29.924495+0000","last_undegraded":"2024-09-13T18:51:29.924495+0000","last_fullsized":"2024-09-13T18:51:29.924495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:29.924469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:29.924469+0000","last_clean_scrub_stamp":"2024-09-13T18:51:29.924469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:41.678751+0000","scrub_duration":0.002172322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:54.649259+0000","last_change":"2024-09-13T18:50:54.649378+0000","last_active":"2024-09-13T18:50:54.649259+0000","last_peered":"2024-09-13T18:50:54.649259+0000","last_clean":"2024-09-13T18:50:54.649259+0000","last_became_active":"2024-09-13T18:46:11.149036+0000","last_became_peered":"2024-09-13T18:46:11.149036+0000","last_unstale":"2024-09-13T18:50:54.649259+0000","last_undegraded":"2024-09-13T18:50:54.649259+0000","last_fullsized":"2024-09-13T18:50:54.649259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:54.649236+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:54.649236+0000","last_clean_scrub_stamp":"2024-09-13T18:50:54.649236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:09.129255+0000","scrub_duration":0.001480161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:45.276110+0000","last_change":"2024-09-13T18:50:45.276213+0000","last_active":"2024-09-13T18:50:45.276110+0000","last_peered":"2024-09-13T18:50:45.276110+0000","last_clean":"2024-09-13T18:50:45.276110+0000","last_became_active":"2024-09-13T18:45:21.668242+0000","last_became_peered":"2024-09-13T18:45:21.668242+0000","last_unstale":"2024-09-13T18:50:45.276110+0000","last_undegraded":"2024-09-13T18:50:45.276110+0000","last_fullsized":"2024-09-13T18:50:45.276110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:45.276090+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:45.276090+0000","last_clean_scrub_stamp":"2024-09-13T18:50:45.276090+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:32.233036+0000","scrub_duration":0.001724461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:37.418838+0000","last_change":"2024-09-13T18:51:37.418967+0000","last_active":"2024-09-13T18:51:37.418838+0000","last_peered":"2024-09-13T18:51:37.418838+0000","last_clean":"2024-09-13T18:51:37.418838+0000","last_became_active":"2024-09-13T18:45:26.254886+0000","last_became_peered":"2024-09-13T18:45:26.254886+0000","last_unstale":"2024-09-13T18:51:37.418838+0000","last_undegraded":"2024-09-13T18:51:37.418838+0000","last_fullsized":"2024-09-13T18:51:37.418838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:37.418814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:37.418814+0000","last_clean_scrub_stamp":"2024-09-13T18:51:37.418814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:42.292574+0000","scrub_duration":0.0017496129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.741575+0000","last_change":"2024-09-13T18:50:48.741674+0000","last_active":"2024-09-13T18:50:48.741575+0000","last_peered":"2024-09-13T18:50:48.741575+0000","last_clean":"2024-09-13T18:50:48.741575+0000","last_became_active":"2024-09-13T18:45:22.027835+0000","last_became_peered":"2024-09-13T18:45:22.027835+0000","last_unstale":"2024-09-13T18:50:48.741575+0000","last_undegraded":"2024-09-13T18:50:48.741575+0000","last_fullsized":"2024-09-13T18:50:48.741575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:48.741554+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:48.741554+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.741554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:34.567640+0000","scrub_duration":0.0017755049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.907598+0000","last_change":"2024-09-13T18:51:01.907727+0000","last_active":"2024-09-13T18:51:01.907598+0000","last_peered":"2024-09-13T18:51:01.907598+0000","last_clean":"2024-09-13T18:51:01.907598+0000","last_became_active":"2024-09-13T18:45:21.668765+0000","last_became_peered":"2024-09-13T18:45:21.668765+0000","last_unstale":"2024-09-13T18:51:01.907598+0000","last_undegraded":"2024-09-13T18:51:01.907598+0000","last_fullsized":"2024-09-13T18:51:01.907598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:51:01.907558+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:51:01.907558+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.907558+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:56.338211+0000","scrub_duration":0.0021193679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:03.860763+0000","last_change":"2024-09-13T18:51:03.860929+0000","last_active":"2024-09-13T18:51:03.860763+0000","last_peered":"2024-09-13T18:51:03.860763+0000","last_clean":"2024-09-13T18:51:03.860763+0000","last_became_active":"2024-09-13T18:45:26.049408+0000","last_became_peered":"2024-09-13T18:45:26.049408+0000","last_unstale":"2024-09-13T18:51:03.860763+0000","last_undegraded":"2024-09-13T18:51:03.860763+0000","last_fullsized":"2024-09-13T18:51:03.860763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:03.860740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:03.860740+0000","last_clean_scrub_stamp":"2024-09-13T18:51:03.860740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:12.491143+0000","scrub_duration":0.0020454399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:52.560168+0000","last_change":"2024-09-13T18:50:52.560268+0000","last_active":"2024-09-13T18:50:52.560168+0000","last_peered":"2024-09-13T18:50:52.560168+0000","last_clean":"2024-09-13T18:50:52.560168+0000","last_became_active":"2024-09-13T18:45:22.021976+0000","last_became_peered":"2024-09-13T18:45:22.021976+0000","last_unstale":"2024-09-13T18:50:52.560168+0000","last_undegraded":"2024-09-13T18:50:52.560168+0000","last_fullsized":"2024-09-13T18:50:52.560168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:52.560142+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:52.560142+0000","last_clean_scrub_stamp":"2024-09-13T18:50:52.560142+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:48.429003+0000","scrub_duration":0.0016215960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.229700+0000","last_change":"2024-09-13T18:50:48.229823+0000","last_active":"2024-09-13T18:50:48.229700+0000","last_peered":"2024-09-13T18:50:48.229700+0000","last_clean":"2024-09-13T18:50:48.229700+0000","last_became_active":"2024-09-13T18:45:21.667680+0000","last_became_peered":"2024-09-13T18:45:21.667680+0000","last_unstale":"2024-09-13T18:50:48.229700+0000","last_undegraded":"2024-09-13T18:50:48.229700+0000","last_fullsized":"2024-09-13T18:50:48.229700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:48.229676+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:48.229676+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.229676+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:38.239939+0000","scrub_duration":0.0024150930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:15.834041+0000","last_change":"2024-09-13T18:51:15.834041+0000","last_active":"2024-09-13T18:51:15.834041+0000","last_peered":"2024-09-13T18:51:15.834041+0000","last_clean":"2024-09-13T18:51:15.834041+0000","last_became_active":"2024-09-13T18:45:26.254662+0000","last_became_peered":"2024-09-13T18:45:26.254662+0000","last_unstale":"2024-09-13T18:51:15.834041+0000","last_undegraded":"2024-09-13T18:51:15.834041+0000","last_fullsized":"2024-09-13T18:51:15.834041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:15.833861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:15.833861+0000","last_clean_scrub_stamp":"2024-09-13T18:51:15.833861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:39.007889+0000","scrub_duration":0.0017530099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.804602+0000","last_change":"2024-09-13T18:51:01.804727+0000","last_active":"2024-09-13T18:51:01.804602+0000","last_peered":"2024-09-13T18:51:01.804602+0000","last_clean":"2024-09-13T18:51:01.804602+0000","last_became_active":"2024-09-13T18:45:22.026419+0000","last_became_peered":"2024-09-13T18:45:22.026419+0000","last_unstale":"2024-09-13T18:51:01.804602+0000","last_undegraded":"2024-09-13T18:51:01.804602+0000","last_fullsized":"2024-09-13T18:51:01.804602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:01.804577+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:01.804577+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.804577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:28.419963+0000","scrub_duration":0.001887402,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'37","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:54.195045+0000","last_change":"2024-09-13T18:50:54.195184+0000","last_active":"2024-09-13T18:50:54.195045+0000","last_peered":"2024-09-13T18:50:54.195045+0000","last_clean":"2024-09-13T18:50:54.195045+0000","last_became_active":"2024-09-13T18:45:21.664066+0000","last_became_peered":"2024-09-13T18:45:21.664066+0000","last_unstale":"2024-09-13T18:50:54.195045+0000","last_undegraded":"2024-09-13T18:50:54.195045+0000","last_fullsized":"2024-09-13T18:50:54.195045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'37","last_scrub_stamp":"2024-09-13T18:50:54.195018+0000","last_deep_scrub":"26'37","last_deep_scrub_stamp":"2024-09-13T18:50:54.195018+0000","last_clean_scrub_stamp":"2024-09-13T18:50:54.195018+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:48.625670+0000","scrub_duration":0.0018610250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:43.139826+0000","last_change":"2024-09-13T18:45:26.253888+0000","last_active":"2024-09-13T18:50:43.139826+0000","last_peered":"2024-09-13T18:50:43.139826+0000","last_clean":"2024-09-13T18:50:43.139826+0000","last_became_active":"2024-09-13T18:45:26.253488+0000","last_became_peered":"2024-09-13T18:45:26.253488+0000","last_unstale":"2024-09-13T18:50:43.139826+0000","last_undegraded":"2024-09-13T18:50:43.139826+0000","last_fullsized":"2024-09-13T18:50:43.139826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'11","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:07.332449+0000","last_change":"2024-09-13T18:51:07.332449+0000","last_active":"2024-09-13T18:51:07.332449+0000","last_peered":"2024-09-13T18:51:07.332449+0000","last_clean":"2024-09-13T18:51:07.332449+0000","last_became_active":"2024-09-13T18:45:22.022628+0000","last_became_peered":"2024-09-13T18:45:22.022628+0000","last_unstale":"2024-09-13T18:51:07.332449+0000","last_undegraded":"2024-09-13T18:51:07.332449+0000","last_fullsized":"2024-09-13T18:51:07.332449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:51:07.332316+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:51:07.332316+0000","last_clean_scrub_stamp":"2024-09-13T18:51:07.332316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:15.962718+0000","scrub_duration":0.0015008759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:50.944283+0000","last_change":"2024-09-13T18:50:50.944283+0000","last_active":"2024-09-13T18:50:50.944283+0000","last_peered":"2024-09-13T18:50:50.944283+0000","last_clean":"2024-09-13T18:50:50.944283+0000","last_became_active":"2024-09-13T18:45:21.668645+0000","last_became_peered":"2024-09-13T18:45:21.668645+0000","last_unstale":"2024-09-13T18:50:50.944283+0000","last_undegraded":"2024-09-13T18:50:50.944283+0000","last_fullsized":"2024-09-13T18:50:50.944283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:50.944170+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:50.944170+0000","last_clean_scrub_stamp":"2024-09-13T18:50:50.944170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:50.702974+0000","scrub_duration":0.0019259710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'5","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:27.651545+0000","last_change":"2024-09-13T18:51:27.651545+0000","last_active":"2024-09-13T18:51:27.651545+0000","last_peered":"2024-09-13T18:51:27.651545+0000","last_clean":"2024-09-13T18:51:27.651545+0000","last_became_active":"2024-09-13T18:46:11.658190+0000","last_became_peered":"2024-09-13T18:46:11.658190+0000","last_unstale":"2024-09-13T18:51:27.651545+0000","last_undegraded":"2024-09-13T18:51:27.651545+0000","last_fullsized":"2024-09-13T18:51:27.651545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:27.651359+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:27.651359+0000","last_clean_scrub_stamp":"2024-09-13T18:51:27.651359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:39.405641+0000","scrub_duration":0.0020187199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:56.652546+0000","last_change":"2024-09-13T18:50:56.652677+0000","last_active":"2024-09-13T18:50:56.652546+0000","last_peered":"2024-09-13T18:50:56.652546+0000","last_clean":"2024-09-13T18:50:56.652546+0000","last_became_active":"2024-09-13T18:46:11.145524+0000","last_became_peered":"2024-09-13T18:46:11.145524+0000","last_unstale":"2024-09-13T18:50:56.652546+0000","last_undegraded":"2024-09-13T18:50:56.652546+0000","last_fullsized":"2024-09-13T18:50:56.652546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:56.652521+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:56.652521+0000","last_clean_scrub_stamp":"2024-09-13T18:50:56.652521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:42.478607+0000","scrub_duration":0.0014878630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:58.294183+0000","last_change":"2024-09-13T18:50:58.294183+0000","last_active":"2024-09-13T18:50:58.294183+0000","last_peered":"2024-09-13T18:50:58.294183+0000","last_clean":"2024-09-13T18:50:58.294183+0000","last_became_active":"2024-09-13T18:45:21.660577+0000","last_became_peered":"2024-09-13T18:45:21.660577+0000","last_unstale":"2024-09-13T18:50:58.294183+0000","last_undegraded":"2024-09-13T18:50:58.294183+0000","last_fullsized":"2024-09-13T18:50:58.294183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:58.294026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:58.294026+0000","last_clean_scrub_stamp":"2024-09-13T18:50:58.294026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:54.162887+0000","scrub_duration":0.001538322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:39.381210+0000","last_change":"2024-09-13T18:51:39.381210+0000","last_active":"2024-09-13T18:51:39.381210+0000","last_peered":"2024-09-13T18:51:39.381210+0000","last_clean":"2024-09-13T18:51:39.381210+0000","last_became_active":"2024-09-13T18:45:26.053877+0000","last_became_peered":"2024-09-13T18:45:26.053877+0000","last_unstale":"2024-09-13T18:51:39.381210+0000","last_undegraded":"2024-09-13T18:51:39.381210+0000","last_fullsized":"2024-09-13T18:51:39.381210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:39.381056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:39.381056+0000","last_clean_scrub_stamp":"2024-09-13T18:51:39.381056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:19.757676+0000","scrub_duration":0.0019067769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.737342+0000","last_change":"2024-09-13T18:50:49.737342+0000","last_active":"2024-09-13T18:50:49.737342+0000","last_peered":"2024-09-13T18:50:49.737342+0000","last_clean":"2024-09-13T18:50:49.737342+0000","last_became_active":"2024-09-13T18:45:22.028714+0000","last_became_peered":"2024-09-13T18:45:22.028714+0000","last_unstale":"2024-09-13T18:50:49.737342+0000","last_undegraded":"2024-09-13T18:50:49.737342+0000","last_fullsized":"2024-09-13T18:50:49.737342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:49.737225+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:49.737225+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.737225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:11.076096+0000","scrub_duration":0.0019902909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.620039+0000","last_change":"2024-09-13T18:50:51.620039+0000","last_active":"2024-09-13T18:50:51.620039+0000","last_peered":"2024-09-13T18:50:51.620039+0000","last_clean":"2024-09-13T18:50:51.620039+0000","last_became_active":"2024-09-13T18:45:21.667320+0000","last_became_peered":"2024-09-13T18:45:21.667320+0000","last_unstale":"2024-09-13T18:50:51.620039+0000","last_undegraded":"2024-09-13T18:50:51.620039+0000","last_fullsized":"2024-09-13T18:50:51.620039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:51.619900+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:51.619900+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.619900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:12.958770+0000","scrub_duration":0.0015549559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:35.174779+0000","last_change":"2024-09-13T18:46:11.148369+0000","last_active":"2024-09-13T18:50:35.174779+0000","last_peered":"2024-09-13T18:50:35.174779+0000","last_clean":"2024-09-13T18:50:35.174779+0000","last_became_active":"2024-09-13T18:46:11.147801+0000","last_became_peered":"2024-09-13T18:46:11.147801+0000","last_unstale":"2024-09-13T18:50:35.174779+0000","last_undegraded":"2024-09-13T18:50:35.174779+0000","last_fullsized":"2024-09-13T18:50:35.174779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.265385+0000","last_change":"2024-09-13T18:51:01.265385+0000","last_active":"2024-09-13T18:51:01.265385+0000","last_peered":"2024-09-13T18:51:01.265385+0000","last_clean":"2024-09-13T18:51:01.265385+0000","last_became_active":"2024-09-13T18:45:22.023357+0000","last_became_peered":"2024-09-13T18:45:22.023357+0000","last_unstale":"2024-09-13T18:51:01.265385+0000","last_undegraded":"2024-09-13T18:51:01.265385+0000","last_fullsized":"2024-09-13T18:51:01.265385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:01.265221+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:01.265221+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.265221+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:14.824444+0000","scrub_duration":0.0015610520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'46","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.567062+0000","last_change":"2024-09-13T18:50:47.567062+0000","last_active":"2024-09-13T18:50:47.567062+0000","last_peered":"2024-09-13T18:50:47.567062+0000","last_clean":"2024-09-13T18:50:47.567062+0000","last_became_active":"2024-09-13T18:45:21.667768+0000","last_became_peered":"2024-09-13T18:45:21.667768+0000","last_unstale":"2024-09-13T18:50:47.567062+0000","last_undegraded":"2024-09-13T18:50:47.567062+0000","last_fullsized":"2024-09-13T18:50:47.567062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'46","last_scrub_stamp":"2024-09-13T18:50:47.566865+0000","last_deep_scrub":"26'46","last_deep_scrub_stamp":"2024-09-13T18:50:47.566865+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.566865+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:09.704431+0000","scrub_duration":0.0017576639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":40,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:33.454230+0000","last_change":"2024-09-13T18:51:33.454365+0000","last_active":"2024-09-13T18:51:33.454230+0000","last_peered":"2024-09-13T18:51:33.454230+0000","last_clean":"2024-09-13T18:51:33.454230+0000","last_became_active":"2024-09-13T18:45:26.056850+0000","last_became_peered":"2024-09-13T18:45:26.056850+0000","last_unstale":"2024-09-13T18:51:33.454230+0000","last_undegraded":"2024-09-13T18:51:33.454230+0000","last_fullsized":"2024-09-13T18:51:33.454230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:33.454207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:33.454207+0000","last_clean_scrub_stamp":"2024-09-13T18:51:33.454207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:40.829582+0000","scrub_duration":0.001871422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.560377+0000","last_change":"2024-09-13T18:50:49.560377+0000","last_active":"2024-09-13T18:50:49.560377+0000","last_peered":"2024-09-13T18:50:49.560377+0000","last_clean":"2024-09-13T18:50:49.560377+0000","last_became_active":"2024-09-13T18:45:22.020317+0000","last_became_peered":"2024-09-13T18:45:22.020317+0000","last_unstale":"2024-09-13T18:50:49.560377+0000","last_undegraded":"2024-09-13T18:50:49.560377+0000","last_fullsized":"2024-09-13T18:50:49.560377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:49.560243+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:49.560243+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.560243+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:10.899114+0000","scrub_duration":0.001921554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.990780+0000","last_change":"2024-09-13T18:50:49.990780+0000","last_active":"2024-09-13T18:50:49.990780+0000","last_peered":"2024-09-13T18:50:49.990780+0000","last_clean":"2024-09-13T18:50:49.990780+0000","last_became_active":"2024-09-13T18:45:21.667483+0000","last_became_peered":"2024-09-13T18:45:21.667483+0000","last_unstale":"2024-09-13T18:50:49.990780+0000","last_undegraded":"2024-09-13T18:50:49.990780+0000","last_fullsized":"2024-09-13T18:50:49.990780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:49.990664+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:49.990664+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.990664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:12.128230+0000","scrub_duration":0.002034138,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:25.718056+0000","last_change":"2024-09-13T18:51:25.718158+0000","last_active":"2024-09-13T18:51:25.718056+0000","last_peered":"2024-09-13T18:51:25.718056+0000","last_clean":"2024-09-13T18:51:25.718056+0000","last_became_active":"2024-09-13T18:45:26.253533+0000","last_became_peered":"2024-09-13T18:45:26.253533+0000","last_unstale":"2024-09-13T18:51:25.718056+0000","last_undegraded":"2024-09-13T18:51:25.718056+0000","last_fullsized":"2024-09-13T18:51:25.718056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:25.718035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:25.718035+0000","last_clean_scrub_stamp":"2024-09-13T18:51:25.718035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:33.093410+0000","scrub_duration":0.0016015700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:45.898842+0000","last_change":"2024-09-13T18:50:45.898842+0000","last_active":"2024-09-13T18:50:45.898842+0000","last_peered":"2024-09-13T18:50:45.898842+0000","last_clean":"2024-09-13T18:50:45.898842+0000","last_became_active":"2024-09-13T18:45:22.032109+0000","last_became_peered":"2024-09-13T18:45:22.032109+0000","last_unstale":"2024-09-13T18:50:45.898842+0000","last_undegraded":"2024-09-13T18:50:45.898842+0000","last_fullsized":"2024-09-13T18:50:45.898842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:50:45.898727+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:50:45.898727+0000","last_clean_scrub_stamp":"2024-09-13T18:50:45.898727+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:31.724813+0000","scrub_duration":0.002426119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'4","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:55.584126+0000","last_change":"2024-09-13T18:50:55.584126+0000","last_active":"2024-09-13T18:50:55.584126+0000","last_peered":"2024-09-13T18:50:55.584126+0000","last_clean":"2024-09-13T18:50:55.584126+0000","last_became_active":"2024-09-13T18:45:21.662344+0000","last_became_peered":"2024-09-13T18:45:21.662344+0000","last_unstale":"2024-09-13T18:50:55.584126+0000","last_undegraded":"2024-09-13T18:50:55.584126+0000","last_fullsized":"2024-09-13T18:50:55.584126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:55.583980+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:55.583980+0000","last_clean_scrub_stamp":"2024-09-13T18:50:55.583980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.452841+0000","scrub_duration":0.0022605720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":185,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.963592+0000","last_change":"2024-09-13T18:50:47.963592+0000","last_active":"2024-09-13T18:50:47.963592+0000","last_peered":"2024-09-13T18:50:47.963592+0000","last_clean":"2024-09-13T18:50:47.963592+0000","last_became_active":"2024-09-13T18:45:19.777172+0000","last_became_peered":"2024-09-13T18:45:19.777172+0000","last_unstale":"2024-09-13T18:50:47.963592+0000","last_undegraded":"2024-09-13T18:50:47.963592+0000","last_fullsized":"2024-09-13T18:50:47.963592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-09-13T18:50:47.963462+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-09-13T18:50:47.963462+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.963462+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:32.776049+0000","scrub_duration":0.0045475369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:19.229290+0000","last_change":"2024-09-13T18:51:19.229290+0000","last_active":"2024-09-13T18:51:19.229290+0000","last_peered":"2024-09-13T18:51:19.229290+0000","last_clean":"2024-09-13T18:51:19.229290+0000","last_became_active":"2024-09-13T18:45:26.252890+0000","last_became_peered":"2024-09-13T18:45:26.252890+0000","last_unstale":"2024-09-13T18:51:19.229290+0000","last_undegraded":"2024-09-13T18:51:19.229290+0000","last_fullsized":"2024-09-13T18:51:19.229290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:19.229136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:19.229136+0000","last_clean_scrub_stamp":"2024-09-13T18:51:19.229136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:45.844522+0000","scrub_duration":0.0018592859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:08.902874+0000","last_change":"2024-09-13T18:51:08.902981+0000","last_active":"2024-09-13T18:51:08.902874+0000","last_peered":"2024-09-13T18:51:08.902874+0000","last_clean":"2024-09-13T18:51:08.902874+0000","last_became_active":"2024-09-13T18:45:22.036153+0000","last_became_peered":"2024-09-13T18:45:22.036153+0000","last_unstale":"2024-09-13T18:51:08.902874+0000","last_undegraded":"2024-09-13T18:51:08.902874+0000","last_fullsized":"2024-09-13T18:51:08.902874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:08.902849+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:08.902849+0000","last_clean_scrub_stamp":"2024-09-13T18:51:08.902849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:22.462073+0000","scrub_duration":0.001591044,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:43.612187+0000","last_change":"2024-09-13T18:50:43.612278+0000","last_active":"2024-09-13T18:50:43.612187+0000","last_peered":"2024-09-13T18:50:43.612187+0000","last_clean":"2024-09-13T18:50:43.612187+0000","last_became_active":"2024-09-13T18:45:21.665582+0000","last_became_peered":"2024-09-13T18:45:21.665582+0000","last_unstale":"2024-09-13T18:50:43.612187+0000","last_undegraded":"2024-09-13T18:50:43.612187+0000","last_fullsized":"2024-09-13T18:50:43.612187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:43.612164+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:43.612164+0000","last_clean_scrub_stamp":"2024-09-13T18:50:43.612164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:38.969573+0000","scrub_duration":0.0020111640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:25.204618+0000","last_change":"2024-09-13T18:51:25.204734+0000","last_active":"2024-09-13T18:51:25.204618+0000","last_peered":"2024-09-13T18:51:25.204618+0000","last_clean":"2024-09-13T18:51:25.204618+0000","last_became_active":"2024-09-13T18:45:26.249986+0000","last_became_peered":"2024-09-13T18:45:26.249986+0000","last_unstale":"2024-09-13T18:51:25.204618+0000","last_undegraded":"2024-09-13T18:51:25.204618+0000","last_fullsized":"2024-09-13T18:51:25.204618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:25.204595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:25.204595+0000","last_clean_scrub_stamp":"2024-09-13T18:51:25.204595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:03.481360+0000","scrub_duration":0.0022130019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.591676+0000","last_change":"2024-09-13T18:50:48.591788+0000","last_active":"2024-09-13T18:50:48.591676+0000","last_peered":"2024-09-13T18:50:48.591676+0000","last_clean":"2024-09-13T18:50:48.591676+0000","last_became_active":"2024-09-13T18:45:22.036523+0000","last_became_peered":"2024-09-13T18:45:22.036523+0000","last_unstale":"2024-09-13T18:50:48.591676+0000","last_undegraded":"2024-09-13T18:50:48.591676+0000","last_fullsized":"2024-09-13T18:50:48.591676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:48.591652+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:48.591652+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.591652+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:03.071671+0000","scrub_duration":0.001672523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.185355+0000","last_change":"2024-09-13T18:50:53.185451+0000","last_active":"2024-09-13T18:50:53.185355+0000","last_peered":"2024-09-13T18:50:53.185355+0000","last_clean":"2024-09-13T18:50:53.185355+0000","last_became_active":"2024-09-13T18:45:21.662405+0000","last_became_peered":"2024-09-13T18:45:21.662405+0000","last_unstale":"2024-09-13T18:50:53.185355+0000","last_undegraded":"2024-09-13T18:50:53.185355+0000","last_fullsized":"2024-09-13T18:50:53.185355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:53.185332+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:53.185332+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.185332+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:51.585557+0000","scrub_duration":0.0032345479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:23.651586+0000","last_change":"2024-09-13T18:51:23.651725+0000","last_active":"2024-09-13T18:51:23.651586+0000","last_peered":"2024-09-13T18:51:23.651586+0000","last_clean":"2024-09-13T18:51:23.651586+0000","last_became_active":"2024-09-13T18:45:26.054449+0000","last_became_peered":"2024-09-13T18:45:26.054449+0000","last_unstale":"2024-09-13T18:51:23.651586+0000","last_undegraded":"2024-09-13T18:51:23.651586+0000","last_fullsized":"2024-09-13T18:51:23.651586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:23.651560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:23.651560+0000","last_clean_scrub_stamp":"2024-09-13T18:51:23.651560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:17.307564+0000","scrub_duration":0.001733273,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'9","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:41.413184+0000","last_change":"2024-09-13T18:51:41.413291+0000","last_active":"2024-09-13T18:51:41.413184+0000","last_peered":"2024-09-13T18:51:41.413184+0000","last_clean":"2024-09-13T18:51:41.413184+0000","last_became_active":"2024-09-13T18:46:11.150605+0000","last_became_peered":"2024-09-13T18:46:11.150605+0000","last_unstale":"2024-09-13T18:51:41.413184+0000","last_undegraded":"2024-09-13T18:51:41.413184+0000","last_fullsized":"2024-09-13T18:51:41.413184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:51:41.413157+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:51:41.413157+0000","last_clean_scrub_stamp":"2024-09-13T18:51:41.413157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:37.669991+0000","scrub_duration":0.0020204899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:44.581874+0000","last_change":"2024-09-13T18:50:44.581951+0000","last_active":"2024-09-13T18:50:44.581874+0000","last_peered":"2024-09-13T18:50:44.581874+0000","last_clean":"2024-09-13T18:50:44.581874+0000","last_became_active":"2024-09-13T18:45:21.667340+0000","last_became_peered":"2024-09-13T18:45:21.667340+0000","last_unstale":"2024-09-13T18:50:44.581874+0000","last_undegraded":"2024-09-13T18:50:44.581874+0000","last_fullsized":"2024-09-13T18:50:44.581874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:44.581853+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:44.581853+0000","last_clean_scrub_stamp":"2024-09-13T18:50:44.581853+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:34.592117+0000","scrub_duration":0.002403325,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:34.443485+0000","last_change":"2024-09-13T18:51:34.443633+0000","last_active":"2024-09-13T18:51:34.443485+0000","last_peered":"2024-09-13T18:51:34.443485+0000","last_clean":"2024-09-13T18:51:34.443485+0000","last_became_active":"2024-09-13T18:45:26.250020+0000","last_became_peered":"2024-09-13T18:45:26.250020+0000","last_unstale":"2024-09-13T18:51:34.443485+0000","last_undegraded":"2024-09-13T18:51:34.443485+0000","last_fullsized":"2024-09-13T18:51:34.443485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:34.443460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:34.443460+0000","last_clean_scrub_stamp":"2024-09-13T18:51:34.443460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:14.820080+0000","scrub_duration":0.0018253639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:06.933020+0000","last_change":"2024-09-13T18:51:06.933112+0000","last_active":"2024-09-13T18:51:06.933020+0000","last_peered":"2024-09-13T18:51:06.933020+0000","last_clean":"2024-09-13T18:51:06.933020+0000","last_became_active":"2024-09-13T18:45:22.030275+0000","last_became_peered":"2024-09-13T18:45:22.030275+0000","last_unstale":"2024-09-13T18:51:06.933020+0000","last_undegraded":"2024-09-13T18:51:06.933020+0000","last_fullsized":"2024-09-13T18:51:06.933020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:06.932993+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:06.932993+0000","last_clean_scrub_stamp":"2024-09-13T18:51:06.932993+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:30.946801+0000","scrub_duration":0.001459723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:46.747039+0000","last_change":"2024-09-13T18:50:46.747141+0000","last_active":"2024-09-13T18:50:46.747039+0000","last_peered":"2024-09-13T18:50:46.747039+0000","last_clean":"2024-09-13T18:50:46.747039+0000","last_became_active":"2024-09-13T18:45:21.662210+0000","last_became_peered":"2024-09-13T18:45:21.662210+0000","last_unstale":"2024-09-13T18:50:46.747039+0000","last_undegraded":"2024-09-13T18:50:46.747039+0000","last_fullsized":"2024-09-13T18:50:46.747039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:46.747013+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:46.747013+0000","last_clean_scrub_stamp":"2024-09-13T18:50:46.747013+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:01.227032+0000","scrub_duration":0.0037197200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:36.962102+0000","last_change":"2024-09-13T18:51:36.962268+0000","last_active":"2024-09-13T18:51:36.962102+0000","last_peered":"2024-09-13T18:51:36.962102+0000","last_clean":"2024-09-13T18:51:36.962102+0000","last_became_active":"2024-09-13T18:45:26.053195+0000","last_became_peered":"2024-09-13T18:45:26.053195+0000","last_unstale":"2024-09-13T18:51:36.962102+0000","last_undegraded":"2024-09-13T18:51:36.962102+0000","last_fullsized":"2024-09-13T18:51:36.962102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:36.962063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:36.962063+0000","last_clean_scrub_stamp":"2024-09-13T18:51:36.962063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:33.218898+0000","scrub_duration":0.0019864520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:14.842758+0000","last_change":"2024-09-13T18:51:14.842898+0000","last_active":"2024-09-13T18:51:14.842758+0000","last_peered":"2024-09-13T18:51:14.842758+0000","last_clean":"2024-09-13T18:51:14.842758+0000","last_became_active":"2024-09-13T18:45:22.031312+0000","last_became_peered":"2024-09-13T18:45:22.031312+0000","last_unstale":"2024-09-13T18:51:14.842758+0000","last_undegraded":"2024-09-13T18:51:14.842758+0000","last_fullsized":"2024-09-13T18:51:14.842758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:14.842734+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:14.842734+0000","last_clean_scrub_stamp":"2024-09-13T18:51:14.842734+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:23.473137+0000","scrub_duration":0.0016508709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:45.608053+0000","last_change":"2024-09-13T18:50:45.608171+0000","last_active":"2024-09-13T18:50:45.608053+0000","last_peered":"2024-09-13T18:50:45.608053+0000","last_clean":"2024-09-13T18:50:45.608053+0000","last_became_active":"2024-09-13T18:45:21.654844+0000","last_became_peered":"2024-09-13T18:45:21.654844+0000","last_unstale":"2024-09-13T18:50:45.608053+0000","last_undegraded":"2024-09-13T18:50:45.608053+0000","last_fullsized":"2024-09-13T18:50:45.608053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2024-09-13T18:50:45.608031+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2024-09-13T18:50:45.608031+0000","last_clean_scrub_stamp":"2024-09-13T18:50:45.608031+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:30.420618+0000","scrub_duration":0.0035795750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:29.598362+0000","last_change":"2024-09-13T18:51:29.598532+0000","last_active":"2024-09-13T18:51:29.598362+0000","last_peered":"2024-09-13T18:51:29.598362+0000","last_clean":"2024-09-13T18:51:29.598362+0000","last_became_active":"2024-09-13T18:45:26.055955+0000","last_became_peered":"2024-09-13T18:45:26.055955+0000","last_unstale":"2024-09-13T18:51:29.598362+0000","last_undegraded":"2024-09-13T18:51:29.598362+0000","last_fullsized":"2024-09-13T18:51:29.598362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:29.598337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:29.598337+0000","last_clean_scrub_stamp":"2024-09-13T18:51:29.598337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:34.472096+0000","scrub_duration":0.0021141910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:03.236973+0000","last_change":"2024-09-13T18:51:03.237150+0000","last_active":"2024-09-13T18:51:03.236973+0000","last_peered":"2024-09-13T18:51:03.236973+0000","last_clean":"2024-09-13T18:51:03.236973+0000","last_became_active":"2024-09-13T18:45:22.027172+0000","last_became_peered":"2024-09-13T18:45:22.027172+0000","last_unstale":"2024-09-13T18:51:03.236973+0000","last_undegraded":"2024-09-13T18:51:03.236973+0000","last_fullsized":"2024-09-13T18:51:03.236973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:51:03.236933+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:51:03.236933+0000","last_clean_scrub_stamp":"2024-09-13T18:51:03.236933+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:49.063019+0000","scrub_duration":0.0022569790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.190482+0000","last_change":"2024-09-13T18:50:49.190582+0000","last_active":"2024-09-13T18:50:49.190482+0000","last_peered":"2024-09-13T18:50:49.190482+0000","last_clean":"2024-09-13T18:50:49.190482+0000","last_became_active":"2024-09-13T18:45:21.663746+0000","last_became_peered":"2024-09-13T18:45:21.663746+0000","last_unstale":"2024-09-13T18:50:49.190482+0000","last_undegraded":"2024-09-13T18:50:49.190482+0000","last_fullsized":"2024-09-13T18:50:49.190482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:49.190457+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:49.190457+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.190457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:34.003043+0000","scrub_duration":0.0013612330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:16.632923+0000","last_change":"2024-09-13T18:45:26.253221+0000","last_active":"2024-09-13T18:50:16.632923+0000","last_peered":"2024-09-13T18:50:16.632923+0000","last_clean":"2024-09-13T18:50:16.632923+0000","last_became_active":"2024-09-13T18:45:26.252841+0000","last_became_peered":"2024-09-13T18:45:26.252841+0000","last_unstale":"2024-09-13T18:50:16.632923+0000","last_undegraded":"2024-09-13T18:50:16.632923+0000","last_fullsized":"2024-09-13T18:50:16.632923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'20","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:05.973224+0000","last_change":"2024-09-13T18:51:05.973322+0000","last_active":"2024-09-13T18:51:05.973224+0000","last_peered":"2024-09-13T18:51:05.973224+0000","last_clean":"2024-09-13T18:51:05.973224+0000","last_became_active":"2024-09-13T18:45:22.032862+0000","last_became_peered":"2024-09-13T18:45:22.032862+0000","last_unstale":"2024-09-13T18:51:05.973224+0000","last_undegraded":"2024-09-13T18:51:05.973224+0000","last_fullsized":"2024-09-13T18:51:05.973224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-09-13T18:51:05.973201+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-09-13T18:51:05.973201+0000","last_clean_scrub_stamp":"2024-09-13T18:51:05.973201+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:01.842061+0000","scrub_duration":0.001409771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:05.497671+0000","last_change":"2024-09-13T18:51:05.497769+0000","last_active":"2024-09-13T18:51:05.497671+0000","last_peered":"2024-09-13T18:51:05.497671+0000","last_clean":"2024-09-13T18:51:05.497671+0000","last_became_active":"2024-09-13T18:45:21.667457+0000","last_became_peered":"2024-09-13T18:45:21.667457+0000","last_unstale":"2024-09-13T18:51:05.497671+0000","last_undegraded":"2024-09-13T18:51:05.497671+0000","last_fullsized":"2024-09-13T18:51:05.497671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:05.497646+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:05.497646+0000","last_clean_scrub_stamp":"2024-09-13T18:51:05.497646+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:14.128049+0000","scrub_duration":0.001432996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:30.589549+0000","last_change":"2024-09-13T18:51:30.589685+0000","last_active":"2024-09-13T18:51:30.589549+0000","last_peered":"2024-09-13T18:51:30.589549+0000","last_clean":"2024-09-13T18:51:30.589549+0000","last_became_active":"2024-09-13T18:45:26.250041+0000","last_became_peered":"2024-09-13T18:45:26.250041+0000","last_unstale":"2024-09-13T18:51:30.589549+0000","last_undegraded":"2024-09-13T18:51:30.589549+0000","last_fullsized":"2024-09-13T18:51:30.589549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:30.589525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:30.589525+0000","last_clean_scrub_stamp":"2024-09-13T18:51:30.589525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:10.966145+0000","scrub_duration":0.0019254669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:54.569727+0000","last_change":"2024-09-13T18:50:54.569854+0000","last_active":"2024-09-13T18:50:54.569727+0000","last_peered":"2024-09-13T18:50:54.569727+0000","last_clean":"2024-09-13T18:50:54.569727+0000","last_became_active":"2024-09-13T18:45:22.023882+0000","last_became_peered":"2024-09-13T18:45:22.023882+0000","last_unstale":"2024-09-13T18:50:54.569727+0000","last_undegraded":"2024-09-13T18:50:54.569727+0000","last_fullsized":"2024-09-13T18:50:54.569727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:54.569702+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:54.569702+0000","last_clean_scrub_stamp":"2024-09-13T18:50:54.569702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:45.447629+0000","scrub_duration":0.0017254239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.525039+0000","last_change":"2024-09-13T18:50:47.525152+0000","last_active":"2024-09-13T18:50:47.525039+0000","last_peered":"2024-09-13T18:50:47.525039+0000","last_clean":"2024-09-13T18:50:47.525039+0000","last_became_active":"2024-09-13T18:45:21.662980+0000","last_became_peered":"2024-09-13T18:45:21.662980+0000","last_unstale":"2024-09-13T18:50:47.525039+0000","last_undegraded":"2024-09-13T18:50:47.525039+0000","last_fullsized":"2024-09-13T18:50:47.525039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:47.525016+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:47.525016+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.525016+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:46.204054+0000","scrub_duration":0.0038760959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:36.432772+0000","last_change":"2024-09-13T18:51:36.432948+0000","last_active":"2024-09-13T18:51:36.432772+0000","last_peered":"2024-09-13T18:51:36.432772+0000","last_clean":"2024-09-13T18:51:36.432772+0000","last_became_active":"2024-09-13T18:45:26.252786+0000","last_became_peered":"2024-09-13T18:45:26.252786+0000","last_unstale":"2024-09-13T18:51:36.432772+0000","last_undegraded":"2024-09-13T18:51:36.432772+0000","last_fullsized":"2024-09-13T18:51:36.432772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:36.432737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:36.432737+0000","last_clean_scrub_stamp":"2024-09-13T18:51:36.432737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:32.689571+0000","scrub_duration":0.001880151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:23.943522+0000","last_change":"2024-09-13T18:51:23.943638+0000","last_active":"2024-09-13T18:51:23.943522+0000","last_peered":"2024-09-13T18:51:23.943522+0000","last_clean":"2024-09-13T18:51:23.943522+0000","last_became_active":"2024-09-13T18:45:22.034765+0000","last_became_peered":"2024-09-13T18:45:22.034765+0000","last_unstale":"2024-09-13T18:51:23.943522+0000","last_undegraded":"2024-09-13T18:51:23.943522+0000","last_fullsized":"2024-09-13T18:51:23.943522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:23.943497+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:23.943497+0000","last_clean_scrub_stamp":"2024-09-13T18:51:23.943497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:26.234050+0000","scrub_duration":0.0021370650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'104","reported_seq":135,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.203053+0000","last_change":"2024-09-13T18:50:47.203181+0000","last_active":"2024-09-13T18:50:47.203053+0000","last_peered":"2024-09-13T18:50:47.203053+0000","last_clean":"2024-09-13T18:50:47.203053+0000","last_became_active":"2024-09-13T18:45:21.667587+0000","last_became_peered":"2024-09-13T18:45:21.667587+0000","last_unstale":"2024-09-13T18:50:47.203053+0000","last_undegraded":"2024-09-13T18:50:47.203053+0000","last_fullsized":"2024-09-13T18:50:47.203053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'104","last_scrub_stamp":"2024-09-13T18:50:47.203030+0000","last_deep_scrub":"26'104","last_deep_scrub_stamp":"2024-09-13T18:50:47.203030+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.203030+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:42.560439+0000","scrub_duration":0.020188185000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":942437,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:35.433796+0000","last_change":"2024-09-13T18:51:35.433927+0000","last_active":"2024-09-13T18:51:35.433796+0000","last_peered":"2024-09-13T18:51:35.433796+0000","last_clean":"2024-09-13T18:51:35.433796+0000","last_became_active":"2024-09-13T18:45:26.052614+0000","last_became_peered":"2024-09-13T18:45:26.052614+0000","last_unstale":"2024-09-13T18:51:35.433796+0000","last_undegraded":"2024-09-13T18:51:35.433796+0000","last_fullsized":"2024-09-13T18:51:35.433796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:35.433770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:35.433770+0000","last_clean_scrub_stamp":"2024-09-13T18:51:35.433770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:47.188051+0000","scrub_duration":0.0019198749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'12","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:55.746737+0000","last_change":"2024-09-13T18:50:55.746842+0000","last_active":"2024-09-13T18:50:55.746737+0000","last_peered":"2024-09-13T18:50:55.746737+0000","last_clean":"2024-09-13T18:50:55.746737+0000","last_became_active":"2024-09-13T18:45:22.020461+0000","last_became_peered":"2024-09-13T18:45:22.020461+0000","last_unstale":"2024-09-13T18:50:55.746737+0000","last_undegraded":"2024-09-13T18:50:55.746737+0000","last_fullsized":"2024-09-13T18:50:55.746737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-09-13T18:50:55.746712+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-09-13T18:50:55.746712+0000","last_clean_scrub_stamp":"2024-09-13T18:50:55.746712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:46.624639+0000","scrub_duration":0.001397379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'30","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:59.319018+0000","last_change":"2024-09-13T18:50:59.319133+0000","last_active":"2024-09-13T18:50:59.319018+0000","last_peered":"2024-09-13T18:50:59.319018+0000","last_clean":"2024-09-13T18:50:59.319018+0000","last_became_active":"2024-09-13T18:45:21.663941+0000","last_became_peered":"2024-09-13T18:45:21.663941+0000","last_unstale":"2024-09-13T18:50:59.319018+0000","last_undegraded":"2024-09-13T18:50:59.319018+0000","last_fullsized":"2024-09-13T18:50:59.319018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'30","last_scrub_stamp":"2024-09-13T18:50:59.318992+0000","last_deep_scrub":"26'30","last_deep_scrub_stamp":"2024-09-13T18:50:59.318992+0000","last_clean_scrub_stamp":"2024-09-13T18:50:59.318992+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:23.332800+0000","scrub_duration":0.0038590220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:24.977060+0000","last_change":"2024-09-13T18:51:24.977208+0000","last_active":"2024-09-13T18:51:24.977060+0000","last_peered":"2024-09-13T18:51:24.977060+0000","last_clean":"2024-09-13T18:51:24.977060+0000","last_became_active":"2024-09-13T18:45:26.050757+0000","last_became_peered":"2024-09-13T18:45:26.050757+0000","last_unstale":"2024-09-13T18:51:24.977060+0000","last_undegraded":"2024-09-13T18:51:24.977060+0000","last_fullsized":"2024-09-13T18:51:24.977060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:24.977038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:24.977038+0000","last_clean_scrub_stamp":"2024-09-13T18:51:24.977038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:57.905342+0000","scrub_duration":0.0018483219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:57.568366+0000","last_change":"2024-09-13T18:50:57.568488+0000","last_active":"2024-09-13T18:50:57.568366+0000","last_peered":"2024-09-13T18:50:57.568366+0000","last_clean":"2024-09-13T18:50:57.568366+0000","last_became_active":"2024-09-13T18:45:22.024972+0000","last_became_peered":"2024-09-13T18:45:22.024972+0000","last_unstale":"2024-09-13T18:50:57.568366+0000","last_undegraded":"2024-09-13T18:50:57.568366+0000","last_fullsized":"2024-09-13T18:50:57.568366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:50:57.568343+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:50:57.568343+0000","last_clean_scrub_stamp":"2024-09-13T18:50:57.568343+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:11.127567+0000","scrub_duration":0.0016603970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'7","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:57.516274+0000","last_change":"2024-09-13T18:50:57.516394+0000","last_active":"2024-09-13T18:50:57.516274+0000","last_peered":"2024-09-13T18:50:57.516274+0000","last_clean":"2024-09-13T18:50:57.516274+0000","last_became_active":"2024-09-13T18:45:21.666516+0000","last_became_peered":"2024-09-13T18:45:21.666516+0000","last_unstale":"2024-09-13T18:50:57.516274+0000","last_undegraded":"2024-09-13T18:50:57.516274+0000","last_fullsized":"2024-09-13T18:50:57.516274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:57.516252+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:57.516252+0000","last_clean_scrub_stamp":"2024-09-13T18:50:57.516252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:48.394179+0000","scrub_duration":0.001474358,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:32.654365+0000","last_change":"2024-09-13T18:51:32.654493+0000","last_active":"2024-09-13T18:51:32.654365+0000","last_peered":"2024-09-13T18:51:32.654365+0000","last_clean":"2024-09-13T18:51:32.654365+0000","last_became_active":"2024-09-13T18:45:26.057285+0000","last_became_peered":"2024-09-13T18:45:26.057285+0000","last_unstale":"2024-09-13T18:51:32.654365+0000","last_undegraded":"2024-09-13T18:51:32.654365+0000","last_fullsized":"2024-09-13T18:51:32.654365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:32.654342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:32.654342+0000","last_clean_scrub_stamp":"2024-09-13T18:51:32.654342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:28.911177+0000","scrub_duration":0.0021565410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:50.580387+0000","last_change":"2024-09-13T18:50:50.580490+0000","last_active":"2024-09-13T18:50:50.580387+0000","last_peered":"2024-09-13T18:50:50.580387+0000","last_clean":"2024-09-13T18:50:50.580387+0000","last_became_active":"2024-09-13T18:45:22.031341+0000","last_became_peered":"2024-09-13T18:45:22.031341+0000","last_unstale":"2024-09-13T18:50:50.580387+0000","last_undegraded":"2024-09-13T18:50:50.580387+0000","last_fullsized":"2024-09-13T18:50:50.580387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:50.580363+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:50.580363+0000","last_clean_scrub_stamp":"2024-09-13T18:50:50.580363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:36.406449+0000","scrub_duration":0.0013669019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:52.209692+0000","last_change":"2024-09-13T18:50:52.209792+0000","last_active":"2024-09-13T18:50:52.209692+0000","last_peered":"2024-09-13T18:50:52.209692+0000","last_clean":"2024-09-13T18:50:52.209692+0000","last_became_active":"2024-09-13T18:45:21.664401+0000","last_became_peered":"2024-09-13T18:45:21.664401+0000","last_unstale":"2024-09-13T18:50:52.209692+0000","last_undegraded":"2024-09-13T18:50:52.209692+0000","last_fullsized":"2024-09-13T18:50:52.209692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:52.209668+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:52.209668+0000","last_clean_scrub_stamp":"2024-09-13T18:50:52.209668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:51.968472+0000","scrub_duration":0.001304253,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.631569+0000","last_change":"2024-09-13T18:45:26.254041+0000","last_active":"2024-09-13T18:50:06.631569+0000","last_peered":"2024-09-13T18:50:06.631569+0000","last_clean":"2024-09-13T18:50:06.631569+0000","last_became_active":"2024-09-13T18:45:26.253579+0000","last_became_peered":"2024-09-13T18:45:26.253579+0000","last_unstale":"2024-09-13T18:50:06.631569+0000","last_undegraded":"2024-09-13T18:50:06.631569+0000","last_fullsized":"2024-09-13T18:50:06.631569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:25.026379+0000","last_clean_scrub_stamp":"2024-09-13T18:45:25.026379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:31.601658+0000","last_change":"2024-09-13T18:51:31.601779+0000","last_active":"2024-09-13T18:51:31.601658+0000","last_peered":"2024-09-13T18:51:31.601658+0000","last_clean":"2024-09-13T18:51:31.601658+0000","last_became_active":"2024-09-13T18:45:26.252979+0000","last_became_peered":"2024-09-13T18:45:26.252979+0000","last_unstale":"2024-09-13T18:51:31.601658+0000","last_undegraded":"2024-09-13T18:51:31.601658+0000","last_fullsized":"2024-09-13T18:51:31.601658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:31.601634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:31.601634+0000","last_clean_scrub_stamp":"2024-09-13T18:51:31.601634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:11.978254+0000","scrub_duration":0.001725173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'11","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:44.232716+0000","last_change":"2024-09-13T18:50:44.232835+0000","last_active":"2024-09-13T18:50:44.232716+0000","last_peered":"2024-09-13T18:50:44.232716+0000","last_clean":"2024-09-13T18:50:44.232716+0000","last_became_active":"2024-09-13T18:45:22.030453+0000","last_became_peered":"2024-09-13T18:45:22.030453+0000","last_unstale":"2024-09-13T18:50:44.232716+0000","last_undegraded":"2024-09-13T18:50:44.232716+0000","last_fullsized":"2024-09-13T18:50:44.232716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:50:44.232671+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:50:44.232671+0000","last_clean_scrub_stamp":"2024-09-13T18:50:44.232671+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:43.991475+0000","scrub_duration":0.0014480770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:00.539547+0000","last_change":"2024-09-13T18:51:00.539669+0000","last_active":"2024-09-13T18:51:00.539547+0000","last_peered":"2024-09-13T18:51:00.539547+0000","last_clean":"2024-09-13T18:51:00.539547+0000","last_became_active":"2024-09-13T18:45:21.664571+0000","last_became_peered":"2024-09-13T18:45:21.664571+0000","last_unstale":"2024-09-13T18:51:00.539547+0000","last_undegraded":"2024-09-13T18:51:00.539547+0000","last_fullsized":"2024-09-13T18:51:00.539547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:00.539521+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:00.539521+0000","last_clean_scrub_stamp":"2024-09-13T18:51:00.539521+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:14.098745+0000","scrub_duration":0.001600532,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:18.256601+0000","last_change":"2024-09-13T18:51:18.256601+0000","last_active":"2024-09-13T18:51:18.256601+0000","last_peered":"2024-09-13T18:51:18.256601+0000","last_clean":"2024-09-13T18:51:18.256601+0000","last_became_active":"2024-09-13T18:45:26.054510+0000","last_became_peered":"2024-09-13T18:45:26.054510+0000","last_unstale":"2024-09-13T18:51:18.256601+0000","last_undegraded":"2024-09-13T18:51:18.256601+0000","last_fullsized":"2024-09-13T18:51:18.256601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:18.256436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:18.256436+0000","last_clean_scrub_stamp":"2024-09-13T18:51:18.256436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:26.886838+0000","scrub_duration":0.0019428430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:46.866498+0000","last_change":"2024-09-13T18:50:46.866594+0000","last_active":"2024-09-13T18:50:46.866498+0000","last_peered":"2024-09-13T18:50:46.866498+0000","last_clean":"2024-09-13T18:50:46.866498+0000","last_became_active":"2024-09-13T18:45:22.028062+0000","last_became_peered":"2024-09-13T18:45:22.028062+0000","last_unstale":"2024-09-13T18:50:46.866498+0000","last_undegraded":"2024-09-13T18:50:46.866498+0000","last_fullsized":"2024-09-13T18:50:46.866498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:46.866474+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:46.866474+0000","last_clean_scrub_stamp":"2024-09-13T18:50:46.866474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:08.205344+0000","scrub_duration":0.0015895569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:52.891038+0000","last_change":"2024-09-13T18:50:52.891140+0000","last_active":"2024-09-13T18:50:52.891038+0000","last_peered":"2024-09-13T18:50:52.891038+0000","last_clean":"2024-09-13T18:50:52.891038+0000","last_became_active":"2024-09-13T18:45:21.672470+0000","last_became_peered":"2024-09-13T18:45:21.672470+0000","last_unstale":"2024-09-13T18:50:52.891038+0000","last_undegraded":"2024-09-13T18:50:52.891038+0000","last_fullsized":"2024-09-13T18:50:52.891038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:50:52.891015+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:50:52.891015+0000","last_clean_scrub_stamp":"2024-09-13T18:50:52.891015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:43.768942+0000","scrub_duration":0.001947734,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.207387+0000","last_change":"2024-09-13T18:50:51.207489+0000","last_active":"2024-09-13T18:50:51.207387+0000","last_peered":"2024-09-13T18:50:51.207387+0000","last_clean":"2024-09-13T18:50:51.207387+0000","last_became_active":"2024-09-13T18:45:21.659912+0000","last_became_peered":"2024-09-13T18:45:21.659912+0000","last_unstale":"2024-09-13T18:50:51.207387+0000","last_undegraded":"2024-09-13T18:50:51.207387+0000","last_fullsized":"2024-09-13T18:50:51.207387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:51.207360+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:51.207360+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.207360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:13.344926+0000","scrub_duration":0.0013910459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:02.505731+0000","last_change":"2024-09-13T18:51:02.505849+0000","last_active":"2024-09-13T18:51:02.505731+0000","last_peered":"2024-09-13T18:51:02.505731+0000","last_clean":"2024-09-13T18:51:02.505731+0000","last_became_active":"2024-09-13T18:45:22.024305+0000","last_became_peered":"2024-09-13T18:45:22.024305+0000","last_unstale":"2024-09-13T18:51:02.505731+0000","last_undegraded":"2024-09-13T18:51:02.505731+0000","last_fullsized":"2024-09-13T18:51:02.505731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:02.505710+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:02.505710+0000","last_clean_scrub_stamp":"2024-09-13T18:51:02.505710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:11.136113+0000","scrub_duration":0.0020117059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.634442+0000","last_change":"2024-09-13T18:50:53.634577+0000","last_active":"2024-09-13T18:50:53.634442+0000","last_peered":"2024-09-13T18:50:53.634442+0000","last_clean":"2024-09-13T18:50:53.634442+0000","last_became_active":"2024-09-13T18:45:26.055794+0000","last_became_peered":"2024-09-13T18:45:26.055794+0000","last_unstale":"2024-09-13T18:50:53.634442+0000","last_undegraded":"2024-09-13T18:50:53.634442+0000","last_fullsized":"2024-09-13T18:50:53.634442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:53.634420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:53.634420+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.634420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:29.073415+0000","scrub_duration":0.0018457149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:00.849167+0000","last_change":"2024-09-13T18:51:00.849278+0000","last_active":"2024-09-13T18:51:00.849167+0000","last_peered":"2024-09-13T18:51:00.849167+0000","last_clean":"2024-09-13T18:51:00.849167+0000","last_became_active":"2024-09-13T18:45:21.670083+0000","last_became_peered":"2024-09-13T18:45:21.670083+0000","last_unstale":"2024-09-13T18:51:00.849167+0000","last_undegraded":"2024-09-13T18:51:00.849167+0000","last_fullsized":"2024-09-13T18:51:00.849167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:51:00.849140+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:51:00.849140+0000","last_clean_scrub_stamp":"2024-09-13T18:51:00.849140+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:09.479543+0000","scrub_duration":0.0018400650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.752295+0000","last_change":"2024-09-13T18:50:53.752405+0000","last_active":"2024-09-13T18:50:53.752295+0000","last_peered":"2024-09-13T18:50:53.752295+0000","last_clean":"2024-09-13T18:50:53.752295+0000","last_became_active":"2024-09-13T18:45:22.021496+0000","last_became_peered":"2024-09-13T18:45:22.021496+0000","last_unstale":"2024-09-13T18:50:53.752295+0000","last_undegraded":"2024-09-13T18:50:53.752295+0000","last_fullsized":"2024-09-13T18:50:53.752295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:53.752270+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:53.752270+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.752270+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:49.621131+0000","scrub_duration":0.0017525349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:29.602329+0000","last_change":"2024-09-13T18:51:29.602438+0000","last_active":"2024-09-13T18:51:29.602329+0000","last_peered":"2024-09-13T18:51:29.602329+0000","last_clean":"2024-09-13T18:51:29.602329+0000","last_became_active":"2024-09-13T18:45:26.050095+0000","last_became_peered":"2024-09-13T18:45:26.050095+0000","last_unstale":"2024-09-13T18:51:29.602329+0000","last_undegraded":"2024-09-13T18:51:29.602329+0000","last_fullsized":"2024-09-13T18:51:29.602329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:29.602308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:29.602308+0000","last_clean_scrub_stamp":"2024-09-13T18:51:29.602308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:34.476068+0000","scrub_duration":0.0016547560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:13.281140+0000","last_change":"2024-09-13T18:51:13.281140+0000","last_active":"2024-09-13T18:51:13.281140+0000","last_peered":"2024-09-13T18:51:13.281140+0000","last_clean":"2024-09-13T18:51:13.281140+0000","last_became_active":"2024-09-13T18:45:22.027528+0000","last_became_peered":"2024-09-13T18:45:22.027528+0000","last_unstale":"2024-09-13T18:51:13.281140+0000","last_undegraded":"2024-09-13T18:51:13.281140+0000","last_fullsized":"2024-09-13T18:51:13.281140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:13.281016+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:13.281016+0000","last_clean_scrub_stamp":"2024-09-13T18:51:13.281016+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:26.840240+0000","scrub_duration":0.001715488,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.607907+0000","last_change":"2024-09-13T18:50:48.607907+0000","last_active":"2024-09-13T18:50:48.607907+0000","last_peered":"2024-09-13T18:50:48.607907+0000","last_clean":"2024-09-13T18:50:48.607907+0000","last_became_active":"2024-09-13T18:45:22.024369+0000","last_became_peered":"2024-09-13T18:45:22.024369+0000","last_unstale":"2024-09-13T18:50:48.607907+0000","last_undegraded":"2024-09-13T18:50:48.607907+0000","last_fullsized":"2024-09-13T18:50:48.607907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:50:48.607766+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:50:48.607766+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.607766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:48.366570+0000","scrub_duration":0.0018146099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:16.527317+0000","last_change":"2024-09-13T18:51:16.527317+0000","last_active":"2024-09-13T18:51:16.527317+0000","last_peered":"2024-09-13T18:51:16.527317+0000","last_clean":"2024-09-13T18:51:16.527317+0000","last_became_active":"2024-09-13T18:45:22.034318+0000","last_became_peered":"2024-09-13T18:45:22.034318+0000","last_unstale":"2024-09-13T18:51:16.527317+0000","last_undegraded":"2024-09-13T18:51:16.527317+0000","last_fullsized":"2024-09-13T18:51:16.527317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:16.527167+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:16.527167+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.527167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:39.701195+0000","scrub_duration":0.001722756,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:44.490637+0000","last_change":"2024-09-13T18:50:44.490637+0000","last_active":"2024-09-13T18:50:44.490637+0000","last_peered":"2024-09-13T18:50:44.490637+0000","last_clean":"2024-09-13T18:50:44.490637+0000","last_became_active":"2024-09-13T18:45:22.032851+0000","last_became_peered":"2024-09-13T18:45:22.032851+0000","last_unstale":"2024-09-13T18:50:44.490637+0000","last_undegraded":"2024-09-13T18:50:44.490637+0000","last_fullsized":"2024-09-13T18:50:44.490637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:44.490540+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:44.490540+0000","last_clean_scrub_stamp":"2024-09-13T18:50:44.490540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:19.929534+0000","scrub_duration":0.0012625819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:13.781325+0000","last_change":"2024-09-13T18:51:13.781438+0000","last_active":"2024-09-13T18:51:13.781325+0000","last_peered":"2024-09-13T18:51:13.781325+0000","last_clean":"2024-09-13T18:51:13.781325+0000","last_became_active":"2024-09-13T18:45:22.033156+0000","last_became_peered":"2024-09-13T18:45:22.033156+0000","last_unstale":"2024-09-13T18:51:13.781325+0000","last_undegraded":"2024-09-13T18:51:13.781325+0000","last_fullsized":"2024-09-13T18:51:13.781325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:13.781297+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:13.781297+0000","last_clean_scrub_stamp":"2024-09-13T18:51:13.781297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:36.955325+0000","scrub_duration":0.001953104,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:08.342365+0000","last_change":"2024-09-13T18:51:08.342520+0000","last_active":"2024-09-13T18:51:08.342365+0000","last_peered":"2024-09-13T18:51:08.342365+0000","last_clean":"2024-09-13T18:51:08.342365+0000","last_became_active":"2024-09-13T18:45:22.029654+0000","last_became_peered":"2024-09-13T18:45:22.029654+0000","last_unstale":"2024-09-13T18:51:08.342365+0000","last_undegraded":"2024-09-13T18:51:08.342365+0000","last_fullsized":"2024-09-13T18:51:08.342365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:08.342338+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:08.342338+0000","last_clean_scrub_stamp":"2024-09-13T18:51:08.342338+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:26.590827+0000","scrub_duration":0.0017863480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'13","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.289706+0000","last_change":"2024-09-13T18:51:01.289810+0000","last_active":"2024-09-13T18:51:01.289706+0000","last_peered":"2024-09-13T18:51:01.289706+0000","last_clean":"2024-09-13T18:51:01.289706+0000","last_became_active":"2024-09-13T18:45:22.028031+0000","last_became_peered":"2024-09-13T18:45:22.028031+0000","last_unstale":"2024-09-13T18:51:01.289706+0000","last_undegraded":"2024-09-13T18:51:01.289706+0000","last_fullsized":"2024-09-13T18:51:01.289706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-09-13T18:51:01.289682+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-09-13T18:51:01.289682+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.289682+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:15.769701+0000","scrub_duration":0.0012523860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:10.763853+0000","last_change":"2024-09-13T18:51:10.763987+0000","last_active":"2024-09-13T18:51:10.763853+0000","last_peered":"2024-09-13T18:51:10.763853+0000","last_clean":"2024-09-13T18:51:10.763853+0000","last_became_active":"2024-09-13T18:45:22.032561+0000","last_became_peered":"2024-09-13T18:45:22.032561+0000","last_unstale":"2024-09-13T18:51:10.763853+0000","last_undegraded":"2024-09-13T18:51:10.763853+0000","last_fullsized":"2024-09-13T18:51:10.763853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:10.763829+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:10.763829+0000","last_clean_scrub_stamp":"2024-09-13T18:51:10.763829+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:55.660046+0000","scrub_duration":0.0021163110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:06.469308+0000","last_change":"2024-09-13T18:51:06.469397+0000","last_active":"2024-09-13T18:51:06.469308+0000","last_peered":"2024-09-13T18:51:06.469308+0000","last_clean":"2024-09-13T18:51:06.469308+0000","last_became_active":"2024-09-13T18:45:22.036380+0000","last_became_peered":"2024-09-13T18:45:22.036380+0000","last_unstale":"2024-09-13T18:51:06.469308+0000","last_undegraded":"2024-09-13T18:51:06.469308+0000","last_fullsized":"2024-09-13T18:51:06.469308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:51:06.469283+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:51:06.469283+0000","last_clean_scrub_stamp":"2024-09-13T18:51:06.469283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:33.084669+0000","scrub_duration":0.0018037019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:43.876477+0000","last_change":"2024-09-13T18:50:43.876558+0000","last_active":"2024-09-13T18:50:43.876477+0000","last_peered":"2024-09-13T18:50:43.876477+0000","last_clean":"2024-09-13T18:50:43.876477+0000","last_became_active":"2024-09-13T18:45:22.034646+0000","last_became_peered":"2024-09-13T18:45:22.034646+0000","last_unstale":"2024-09-13T18:50:43.876477+0000","last_undegraded":"2024-09-13T18:50:43.876477+0000","last_fullsized":"2024-09-13T18:50:43.876477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:50:43.876456+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:50:43.876456+0000","last_clean_scrub_stamp":"2024-09-13T18:50:43.876456+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.356475+0000","scrub_duration":0.0016307299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'13","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:26.517651+0000","last_change":"2024-09-13T18:51:26.517762+0000","last_active":"2024-09-13T18:51:26.517651+0000","last_peered":"2024-09-13T18:51:26.517651+0000","last_clean":"2024-09-13T18:51:26.517651+0000","last_became_active":"2024-09-13T18:45:22.028430+0000","last_became_peered":"2024-09-13T18:45:22.028430+0000","last_unstale":"2024-09-13T18:51:26.517651+0000","last_undegraded":"2024-09-13T18:51:26.517651+0000","last_fullsized":"2024-09-13T18:51:26.517651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-09-13T18:51:26.517628+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-09-13T18:51:26.517628+0000","last_clean_scrub_stamp":"2024-09-13T18:51:26.517628+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:20.173632+0000","scrub_duration":0.0014095889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'11","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:09.582511+0000","last_change":"2024-09-13T18:51:09.582639+0000","last_active":"2024-09-13T18:51:09.582511+0000","last_peered":"2024-09-13T18:51:09.582511+0000","last_clean":"2024-09-13T18:51:09.582511+0000","last_became_active":"2024-09-13T18:45:22.019733+0000","last_became_peered":"2024-09-13T18:45:22.019733+0000","last_unstale":"2024-09-13T18:51:09.582511+0000","last_undegraded":"2024-09-13T18:51:09.582511+0000","last_fullsized":"2024-09-13T18:51:09.582511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:51:09.582487+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:51:09.582487+0000","last_clean_scrub_stamp":"2024-09-13T18:51:09.582487+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:47.859252+0000","scrub_duration":0.0019273700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:08.225956+0000","last_change":"2024-09-13T18:51:08.226058+0000","last_active":"2024-09-13T18:51:08.225956+0000","last_peered":"2024-09-13T18:51:08.225956+0000","last_clean":"2024-09-13T18:51:08.225956+0000","last_became_active":"2024-09-13T18:45:22.015868+0000","last_became_peered":"2024-09-13T18:45:22.015868+0000","last_unstale":"2024-09-13T18:51:08.225956+0000","last_undegraded":"2024-09-13T18:51:08.225956+0000","last_fullsized":"2024-09-13T18:51:08.225956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:08.225930+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:08.225930+0000","last_clean_scrub_stamp":"2024-09-13T18:51:08.225930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:04.094791+0000","scrub_duration":0.0015192599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:46.911973+0000","last_change":"2024-09-13T18:50:46.912064+0000","last_active":"2024-09-13T18:50:46.911973+0000","last_peered":"2024-09-13T18:50:46.911973+0000","last_clean":"2024-09-13T18:50:46.911973+0000","last_became_active":"2024-09-13T18:45:22.034019+0000","last_became_peered":"2024-09-13T18:45:22.034019+0000","last_unstale":"2024-09-13T18:50:46.911973+0000","last_undegraded":"2024-09-13T18:50:46.911973+0000","last_fullsized":"2024-09-13T18:50:46.911973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:46.911953+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:46.911953+0000","last_clean_scrub_stamp":"2024-09-13T18:50:46.911953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:36.922217+0000","scrub_duration":0.0017146489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'12","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.657819+0000","last_change":"2024-09-13T18:50:49.657990+0000","last_active":"2024-09-13T18:50:49.657819+0000","last_peered":"2024-09-13T18:50:49.657819+0000","last_clean":"2024-09-13T18:50:49.657819+0000","last_became_active":"2024-09-13T18:45:22.020415+0000","last_became_peered":"2024-09-13T18:45:22.020415+0000","last_unstale":"2024-09-13T18:50:49.657819+0000","last_undegraded":"2024-09-13T18:50:49.657819+0000","last_fullsized":"2024-09-13T18:50:49.657819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-09-13T18:50:49.657795+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-09-13T18:50:49.657795+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.657795+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:11.513081+0000","scrub_duration":0.0020089489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:12.465521+0000","last_change":"2024-09-13T18:51:12.465623+0000","last_active":"2024-09-13T18:51:12.465521+0000","last_peered":"2024-09-13T18:51:12.465521+0000","last_clean":"2024-09-13T18:51:12.465521+0000","last_became_active":"2024-09-13T18:45:22.035491+0000","last_became_peered":"2024-09-13T18:45:22.035491+0000","last_unstale":"2024-09-13T18:51:12.465521+0000","last_undegraded":"2024-09-13T18:51:12.465521+0000","last_fullsized":"2024-09-13T18:51:12.465521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:12.465495+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:12.465495+0000","last_clean_scrub_stamp":"2024-09-13T18:51:12.465495+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:50.742260+0000","scrub_duration":0.0014084880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'11","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:57.604594+0000","last_change":"2024-09-13T18:50:57.604705+0000","last_active":"2024-09-13T18:50:57.604594+0000","last_peered":"2024-09-13T18:50:57.604594+0000","last_clean":"2024-09-13T18:50:57.604594+0000","last_became_active":"2024-09-13T18:46:11.146859+0000","last_became_peered":"2024-09-13T18:46:11.146859+0000","last_unstale":"2024-09-13T18:50:57.604594+0000","last_undegraded":"2024-09-13T18:50:57.604594+0000","last_fullsized":"2024-09-13T18:50:57.604594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:50:57.604573+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:50:57.604573+0000","last_clean_scrub_stamp":"2024-09-13T18:50:57.604573+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:18.943443+0000","scrub_duration":0.001354744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.403472+0000","last_change":"2024-09-13T18:51:17.403572+0000","last_active":"2024-09-13T18:51:17.403472+0000","last_peered":"2024-09-13T18:51:17.403472+0000","last_clean":"2024-09-13T18:51:17.403472+0000","last_became_active":"2024-09-13T18:45:22.021042+0000","last_became_peered":"2024-09-13T18:45:22.021042+0000","last_unstale":"2024-09-13T18:51:17.403472+0000","last_undegraded":"2024-09-13T18:51:17.403472+0000","last_fullsized":"2024-09-13T18:51:17.403472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:17.403444+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:17.403444+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.403444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:19.693997+0000","scrub_duration":0.0017615700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:10.562357+0000","last_change":"2024-09-13T18:51:10.562498+0000","last_active":"2024-09-13T18:51:10.562357+0000","last_peered":"2024-09-13T18:51:10.562357+0000","last_clean":"2024-09-13T18:51:10.562357+0000","last_became_active":"2024-09-13T18:45:22.021366+0000","last_became_peered":"2024-09-13T18:45:22.021366+0000","last_unstale":"2024-09-13T18:51:10.562357+0000","last_undegraded":"2024-09-13T18:51:10.562357+0000","last_fullsized":"2024-09-13T18:51:10.562357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:10.562334+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:10.562334+0000","last_clean_scrub_stamp":"2024-09-13T18:51:10.562334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:55.458551+0000","scrub_duration":0.001601419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'10","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:50.854309+0000","last_change":"2024-09-13T18:50:50.854426+0000","last_active":"2024-09-13T18:50:50.854309+0000","last_peered":"2024-09-13T18:50:50.854309+0000","last_clean":"2024-09-13T18:50:50.854309+0000","last_became_active":"2024-09-13T18:45:22.028594+0000","last_became_peered":"2024-09-13T18:45:22.028594+0000","last_unstale":"2024-09-13T18:50:50.854309+0000","last_undegraded":"2024-09-13T18:50:50.854309+0000","last_fullsized":"2024-09-13T18:50:50.854309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-09-13T18:50:50.854284+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-09-13T18:50:50.854284+0000","last_clean_scrub_stamp":"2024-09-13T18:50:50.854284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:46.723145+0000","scrub_duration":0.0018955790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:58.758344+0000","last_change":"2024-09-13T18:50:58.758450+0000","last_active":"2024-09-13T18:50:58.758344+0000","last_peered":"2024-09-13T18:50:58.758344+0000","last_clean":"2024-09-13T18:50:58.758344+0000","last_became_active":"2024-09-13T18:45:22.016731+0000","last_became_peered":"2024-09-13T18:45:22.016731+0000","last_unstale":"2024-09-13T18:50:58.758344+0000","last_undegraded":"2024-09-13T18:50:58.758344+0000","last_fullsized":"2024-09-13T18:50:58.758344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:58.758323+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:58.758323+0000","last_clean_scrub_stamp":"2024-09-13T18:50:58.758323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:12.317546+0000","scrub_duration":0.0014195729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:04.219420+0000","last_change":"2024-09-13T18:51:04.219534+0000","last_active":"2024-09-13T18:51:04.219420+0000","last_peered":"2024-09-13T18:51:04.219420+0000","last_clean":"2024-09-13T18:51:04.219420+0000","last_became_active":"2024-09-13T18:45:22.027899+0000","last_became_peered":"2024-09-13T18:45:22.027899+0000","last_unstale":"2024-09-13T18:51:04.219420+0000","last_undegraded":"2024-09-13T18:51:04.219420+0000","last_fullsized":"2024-09-13T18:51:04.219420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:04.219395+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:04.219395+0000","last_clean_scrub_stamp":"2024-09-13T18:51:04.219395+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:25.558266+0000","scrub_duration":0.0013989510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:10.239934+0000","last_change":"2024-09-13T18:51:10.240028+0000","last_active":"2024-09-13T18:51:10.239934+0000","last_peered":"2024-09-13T18:51:10.239934+0000","last_clean":"2024-09-13T18:51:10.239934+0000","last_became_active":"2024-09-13T18:45:22.024014+0000","last_became_peered":"2024-09-13T18:45:22.024014+0000","last_unstale":"2024-09-13T18:51:10.239934+0000","last_undegraded":"2024-09-13T18:51:10.239934+0000","last_fullsized":"2024-09-13T18:51:10.239934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2024-09-13T18:51:10.239911+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2024-09-13T18:51:10.239911+0000","last_clean_scrub_stamp":"2024-09-13T18:51:10.239911+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.117838+0000","scrub_duration":0.0014525180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:24.955844+0000","last_change":"2024-09-13T18:51:24.955946+0000","last_active":"2024-09-13T18:51:24.955844+0000","last_peered":"2024-09-13T18:51:24.955844+0000","last_clean":"2024-09-13T18:51:24.955844+0000","last_became_active":"2024-09-13T18:45:22.036269+0000","last_became_peered":"2024-09-13T18:45:22.036269+0000","last_unstale":"2024-09-13T18:51:24.955844+0000","last_undegraded":"2024-09-13T18:51:24.955844+0000","last_fullsized":"2024-09-13T18:51:24.955844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:51:24.955820+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:51:24.955820+0000","last_clean_scrub_stamp":"2024-09-13T18:51:24.955820+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:51.833988+0000","scrub_duration":0.0015012879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:27.661539+0000","last_change":"2024-09-13T18:51:27.661675+0000","last_active":"2024-09-13T18:51:27.661539+0000","last_peered":"2024-09-13T18:51:27.661539+0000","last_clean":"2024-09-13T18:51:27.661539+0000","last_became_active":"2024-09-13T18:45:22.027605+0000","last_became_peered":"2024-09-13T18:45:22.027605+0000","last_unstale":"2024-09-13T18:51:27.661539+0000","last_undegraded":"2024-09-13T18:51:27.661539+0000","last_fullsized":"2024-09-13T18:51:27.661539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:27.661479+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:27.661479+0000","last_clean_scrub_stamp":"2024-09-13T18:51:27.661479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:39.415761+0000","scrub_duration":0.0017052829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:22.976933+0000","last_change":"2024-09-13T18:51:22.977040+0000","last_active":"2024-09-13T18:51:22.976933+0000","last_peered":"2024-09-13T18:51:22.976933+0000","last_clean":"2024-09-13T18:51:22.976933+0000","last_became_active":"2024-09-13T18:45:22.029018+0000","last_became_peered":"2024-09-13T18:45:22.029018+0000","last_unstale":"2024-09-13T18:51:22.976933+0000","last_undegraded":"2024-09-13T18:51:22.976933+0000","last_fullsized":"2024-09-13T18:51:22.976933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:22.976908+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:22.976908+0000","last_clean_scrub_stamp":"2024-09-13T18:51:22.976908+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:01.253674+0000","scrub_duration":0.0020635290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:28.530330+0000","last_change":"2024-09-13T18:51:28.530447+0000","last_active":"2024-09-13T18:51:28.530330+0000","last_peered":"2024-09-13T18:51:28.530330+0000","last_clean":"2024-09-13T18:51:28.530330+0000","last_became_active":"2024-09-13T18:45:22.028758+0000","last_became_peered":"2024-09-13T18:45:22.028758+0000","last_unstale":"2024-09-13T18:51:28.530330+0000","last_undegraded":"2024-09-13T18:51:28.530330+0000","last_fullsized":"2024-09-13T18:51:28.530330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:28.530306+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:28.530306+0000","last_clean_scrub_stamp":"2024-09-13T18:51:28.530306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:35.905681+0000","scrub_duration":0.0019418599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:15.836886+0000","last_change":"2024-09-13T18:51:15.837024+0000","last_active":"2024-09-13T18:51:15.836886+0000","last_peered":"2024-09-13T18:51:15.836886+0000","last_clean":"2024-09-13T18:51:15.836886+0000","last_became_active":"2024-09-13T18:45:22.029403+0000","last_became_peered":"2024-09-13T18:45:22.029403+0000","last_unstale":"2024-09-13T18:51:15.836886+0000","last_undegraded":"2024-09-13T18:51:15.836886+0000","last_fullsized":"2024-09-13T18:51:15.836886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:15.836847+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:15.836847+0000","last_clean_scrub_stamp":"2024-09-13T18:51:15.836847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:34.085336+0000","scrub_duration":0.0017205300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:32.474492+0000","last_change":"2024-09-13T18:51:32.474599+0000","last_active":"2024-09-13T18:51:32.474492+0000","last_peered":"2024-09-13T18:51:32.474492+0000","last_clean":"2024-09-13T18:51:32.474492+0000","last_became_active":"2024-09-13T18:45:22.036877+0000","last_became_peered":"2024-09-13T18:45:22.036877+0000","last_unstale":"2024-09-13T18:51:32.474492+0000","last_undegraded":"2024-09-13T18:51:32.474492+0000","last_fullsized":"2024-09-13T18:51:32.474492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:32.474467+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:32.474467+0000","last_clean_scrub_stamp":"2024-09-13T18:51:32.474467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:37.348226+0000","scrub_duration":0.0021976470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:13.581085+0000","last_change":"2024-09-13T18:51:13.581085+0000","last_active":"2024-09-13T18:51:13.581085+0000","last_peered":"2024-09-13T18:51:13.581085+0000","last_clean":"2024-09-13T18:51:13.581085+0000","last_became_active":"2024-09-13T18:45:22.022618+0000","last_became_peered":"2024-09-13T18:45:22.022618+0000","last_unstale":"2024-09-13T18:51:13.581085+0000","last_undegraded":"2024-09-13T18:51:13.581085+0000","last_fullsized":"2024-09-13T18:51:13.581085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:13.580921+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:13.580921+0000","last_clean_scrub_stamp":"2024-09-13T18:51:13.580921+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:36.754949+0000","scrub_duration":0.001570622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:31.470445+0000","last_change":"2024-09-13T18:51:31.470445+0000","last_active":"2024-09-13T18:51:31.470445+0000","last_peered":"2024-09-13T18:51:31.470445+0000","last_clean":"2024-09-13T18:51:31.470445+0000","last_became_active":"2024-09-13T18:45:22.028291+0000","last_became_peered":"2024-09-13T18:45:22.028291+0000","last_unstale":"2024-09-13T18:51:31.470445+0000","last_undegraded":"2024-09-13T18:51:31.470445+0000","last_fullsized":"2024-09-13T18:51:31.470445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:51:31.470316+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:51:31.470316+0000","last_clean_scrub_stamp":"2024-09-13T18:51:31.470316+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:04.398621+0000","scrub_duration":0.0015283759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'10","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:36.958781+0000","last_change":"2024-09-13T18:51:36.958781+0000","last_active":"2024-09-13T18:51:36.958781+0000","last_peered":"2024-09-13T18:51:36.958781+0000","last_clean":"2024-09-13T18:51:36.958781+0000","last_became_active":"2024-09-13T18:45:22.033974+0000","last_became_peered":"2024-09-13T18:45:22.033974+0000","last_unstale":"2024-09-13T18:51:36.958781+0000","last_undegraded":"2024-09-13T18:51:36.958781+0000","last_fullsized":"2024-09-13T18:51:36.958781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-09-13T18:51:36.958649+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-09-13T18:51:36.958649+0000","last_clean_scrub_stamp":"2024-09-13T18:51:36.958649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:09.886954+0000","scrub_duration":0.001515852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":954260,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":272,"num_write_kb":1081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":1908520,"data_compressed":245052,"data_compressed_allocated":294912,"data_compressed_original":1441792,"omap_allocated":0,"internal_metadata":0},"log_size":353,"ondisk_log_size":353,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":704313,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.36499999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.754},"last":0.624},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.50900000000000001,"15min":0.47699999999999998},"min":{"1min":0.41399999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.5,"15min":0.504},"min":{"1min":0.434,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.72299999999999998,"5min":0.749,"15min":0.749},"last":0.442},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.41699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66300000000000003,"5min":0.70599999999999996,"15min":0.80400000000000005},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.35199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.38200000000000001,"5min":0.31900000000000001,"15min":0.28899999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.42199999999999999,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44500000000000001,"15min":0.46700000000000003},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.56899999999999995,"5min":0.71399999999999997,"15min":0.72399999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45500000000000002,"15min":0.497},"min":{"1min":0.312,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.629,"5min":0.64800000000000002,"15min":0.748},"last":0.35799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48299999999999998,"15min":0.51500000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64700000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48999999999999999,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64200000000000002,"5min":0.73099999999999998,"15min":0.88500000000000001},"last":0.40899999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.57199999999999995},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66100000000000003,"5min":0.75800000000000001,"15min":0.85499999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51200000000000001,"15min":0.56399999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.73599999999999999,"15min":0.81799999999999995},"last":0.51300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":655360,"data_stored":1055800,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.495,"15min":0.47399999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.66500000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.28000000000000003},"max":{"1min":0.625,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.499},"min":{"1min":0.32300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.63900000000000001,"5min":0.73199999999999998,"15min":0.746},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.495,"5min":0.50600000000000001,"15min":0.51400000000000001},"min":{"1min":0.38200000000000001,"5min":0.316,"15min":0.28999999999999998},"max":{"1min":0.67000000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.55100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52600000000000002,"15min":0.53700000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.72199999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.38500000000000001,"5min":0.35799999999999998,"15min":0.35099999999999998},"max":{"1min":0.61099999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73499999999999999,"5min":0.746,"15min":0.81499999999999995},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.32000000000000001,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.66500000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.54600000000000004},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.77500000000000002},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.309,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.72699999999999998},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.33100000000000002,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.755,"15min":0.755},"last":0.439},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52200000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":113453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.71199999999999997,"5min":0.72799999999999998,"15min":0.73599999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52100000000000002,"15min":0.51600000000000001},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.87},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.35799999999999998,"5min":0.314,"15min":0.27000000000000002},"max":{"1min":0.78200000000000003,"5min":0.78700000000000003,"15min":0.91300000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.79300000000000004},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53700000000000003,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.84099999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.45700000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.76300000000000001},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.55200000000000005},"min":{"1min":0.45300000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.85299999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.45500000000000002},"min":{"1min":0.33800000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70299999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47899999999999998,"15min":0.49099999999999999},"min":{"1min":0.30599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66200000000000003,"5min":0.76900000000000002,"15min":0.79900000000000004},"last":0.39500000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72399999999999998,"5min":0.754,"15min":0.81699999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.43099999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74399999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.38600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.67600000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.53700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":113489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.49099999999999999},"min":{"1min":0.309,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.67900000000000005,"5min":0.77900000000000003,"15min":0.80200000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64700000000000002,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.56699999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.40000000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.99099999999999999},"last":0.745},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.53400000000000003},"min":{"1min":0.40100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71399999999999997,"5min":0.746,"15min":0.86099999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.443,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.81699999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.90800000000000003},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.42799999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.69799999999999995,"5min":0.747,"15min":0.88800000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.56100000000000005},"min":{"1min":0.48599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72899999999999998,"5min":0.79000000000000004,"15min":0.93400000000000005},"last":0.59799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.33900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64600000000000002,"5min":0.75700000000000001,"15min":0.95399999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.46300000000000002,"15min":0.49299999999999999},"min":{"1min":0.32900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61699999999999999,"5min":0.67500000000000004,"15min":0.97399999999999998},"last":0.42299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.498},"min":{"1min":0.35699999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.67100000000000004,"5min":0.80200000000000005,"15min":1.0369999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.34399999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68600000000000005,"5min":0.78800000000000003,"15min":1.0549999999999999},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.501,"15min":0.51900000000000002},"min":{"1min":0.39100000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67600000000000005,"5min":0.68700000000000006,"15min":1.0089999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.56200000000000006},"min":{"1min":0.40400000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70099999999999996,"5min":0.82499999999999996,"15min":1.075},"last":0.45100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":667648,"data_stored":1066825,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36799999999999999,"15min":0.378},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48899999999999999,"5min":0.63600000000000001,"15min":1.0449999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.37,"15min":0.378},"min":{"1min":0.28100000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46800000000000003,"5min":0.63400000000000001,"15min":0.98699999999999999},"last":0.40899999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38100000000000001,"15min":0.40300000000000002},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.57299999999999995,"5min":0.753,"15min":1.121},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40999999999999998,"15min":0.41199999999999998},"min":{"1min":0.26800000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63,"5min":0.67200000000000004,"15min":1.0760000000000001},"last":0.378}]},{"osd":2,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.32000000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59999999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.435}]},{"osd":4,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.33800000000000002},"max":{"1min":0.90500000000000003,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.62},"min":{"1min":0.437,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":0.91800000000000004,"15min":1.0780000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83099999999999996,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85699999999999998,"5min":0.86499999999999999,"15min":0.93500000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80700000000000005,"5min":0.83699999999999997,"15min":1.0089999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86799999999999999,"5min":0.89100000000000001,"15min":0.92100000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.66700000000000004},"min":{"1min":0.47699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79800000000000004,"5min":0.88800000000000001,"15min":1.2210000000000001},"last":0.748}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":290816,"data_stored":124388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38900000000000001,"15min":0.36099999999999999},"min":{"1min":0.223,"5min":0.188,"15min":0.188},"max":{"1min":0.51900000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.432},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56100000000000005,"5min":0.70899999999999996,"15min":0.85299999999999998},"last":0.41299999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.41099999999999998,"15min":0.39100000000000001},"min":{"1min":0.28299999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63600000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.441,"15min":0.41499999999999998},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.38400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45900000000000002,"15min":0.438},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.66700000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.47599999999999998,"15min":0.442},"min":{"1min":0.33500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.442,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.629},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60699999999999998,"15min":0.627},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82899999999999996,"5min":0.98499999999999999,"15min":1.0369999999999999},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.97599999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.628,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.438,"15min":0.437},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63100000000000001,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.80400000000000005,"5min":0.94399999999999995,"15min":0.995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63100000000000001,"15min":0.65400000000000003},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.91700000000000004,"15min":0.95899999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":113523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.35799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22900000000000001,"5min":0.192,"15min":0.182},"max":{"1min":0.52300000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.372,"15min":0.34999999999999998},"min":{"1min":0.27900000000000003,"5min":0.192,"15min":0.192},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.36199999999999999,"15min":0.34300000000000003},"min":{"1min":0.22900000000000001,"5min":0.219,"15min":0.20899999999999999},"max":{"1min":0.46300000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.307,"5min":0.249,"15min":0.24099999999999999},"max":{"1min":0.56399999999999995,"5min":0.72299999999999998,"15min":0.84199999999999997},"last":0.41299999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.436,"15min":0.42299999999999999},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65500000000000003,"5min":0.74199999999999999,"15min":0.79000000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50800000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.43099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57099999999999995,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.32300000000000001},"max":{"1min":0.71899999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76500000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.627},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.44600000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.749,"5min":0.83899999999999997,"15min":0.84199999999999997},"last":0.5}]},{"osd":6,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.432,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.746,"5min":0.82999999999999996,"15min":0.85599999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41299999999999998},"max":{"1min":0.70999999999999996,"5min":0.872,"15min":0.872},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.83599999999999997,"15min":1.0449999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69599999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":356352,"data_stored":704369,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.41999999999999998},"min":{"1min":0.23200000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58699999999999997,"5min":0.629,"15min":1.496},"last":0.443},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.38900000000000001,"15min":0.40500000000000003},"min":{"1min":0.255,"5min":0.22600000000000001,"15min":0.20699999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":1.024},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42799999999999999,"15min":0.45700000000000002},"min":{"1min":0.33700000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.66800000000000004,"5min":0.76300000000000001,"15min":1.518},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41999999999999998,"15min":0.434},"min":{"1min":0.28599999999999998,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.60799999999999998,"5min":0.83699999999999997,"15min":1.1679999999999999},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.30399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.69699999999999995,"5min":0.79000000000000004,"15min":1.294},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46600000000000003,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":1.4259999999999999},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.64200000000000002},"min":{"1min":0.44500000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77200000000000002,"5min":0.95099999999999996,"15min":1.198},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":1.3300000000000001},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60999999999999999,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85199999999999998,"5min":0.93300000000000005,"15min":1.4510000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60699999999999998,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":0.96899999999999997,"15min":1.143},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.64800000000000002},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.85899999999999999,"15min":1.391},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63600000000000001,"15min":0.72099999999999997},"min":{"1min":0.46700000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88600000000000001,"5min":0.98299999999999998,"15min":1.4750000000000001},"last":0.86899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.626,"15min":0.67600000000000005},"min":{"1min":0.46200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.879,"5min":0.94499999999999995,"15min":1.0800000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61499999999999999,"15min":0.67500000000000004},"min":{"1min":0.49299999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.82599999999999996,"5min":0.92100000000000004,"15min":1.363},"last":0.90300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":11025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":953462,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":942437,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:51:46.326 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:46.326 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:46.327 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:46.327 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:46.327 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T18:45:25.026379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=50, tm_sec=40, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:51:46.328 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:52:06.329 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:52:06.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.441+0000 7f5c59ba3640 1 Processor -- start 2024-09-13T18:52:06.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.442+0000 7f5c59ba3640 1 -- start start 2024-09-13T18:52:06.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.442+0000 7f5c59ba3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5c540b31d0 0x7f5c540b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:06.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.442+0000 7f5c59ba3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5c5413f8e0 0x7f5c5413fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:06.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.442+0000 7f5c59ba3640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c54149410 con 0x7f5c540b35b0 2024-09-13T18:52:06.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.442+0000 7f5c59ba3640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c54149fb0 con 0x7f5c5413f8e0 2024-09-13T18:52:06.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.442+0000 7f5c59ba3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c540b4550 con 0x7f5c540b31d0 2024-09-13T18:52:06.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.443+0000 7f5c53fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5c5413f8e0 0x7f5c5413fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:06.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.443+0000 7f5c52ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5c540b35b0 0x7f5c541498a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56604/0 (socket says 172.21.15.29:56604) 2024-09-13T18:52:06.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.443+0000 7f5c52ffd640 1 -- 172.21.15.29:0/3038099050 learned_addr learned my addr 172.21.15.29:0/3038099050 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:52:06.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.443+0000 7f5c537fe640 1 --2- 172.21.15.29:0/3038099050 >> v2:172.21.15.96:3300/0 conn(0x7f5c540b31d0 0x7f5c540b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:06.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.443+0000 7f5c53fff640 1 -- 172.21.15.29:0/3038099050 >> v2:172.21.15.96:3300/0 conn(0x7f5c540b31d0 msgr2=0x7f5c540b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:06.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.443+0000 7f5c53fff640 1 --2- 172.21.15.29:0/3038099050 >> v2:172.21.15.96:3300/0 conn(0x7f5c540b31d0 0x7f5c540b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.443+0000 7f5c53fff640 1 -- 172.21.15.29:0/3038099050 >> v1:172.21.15.29:6789/0 conn(0x7f5c540b35b0 legacy=0x7f5c541498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:06.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.443+0000 7f5c53fff640 1 -- 172.21.15.29:0/3038099050 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c540b4810 con 0x7f5c5413f8e0 2024-09-13T18:52:06.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.443+0000 7f5c527fc640 1 -- 172.21.15.29:0/3038099050 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060860338 0 0) 0x7f5c54149410 con 0x7f5c540b35b0 2024-09-13T18:52:06.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.444+0000 7f5c53fff640 1 --2- 172.21.15.29:0/3038099050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c5413f8e0 0x7f5c5413fd00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5c540bb4a0 tx=0x7f5c4c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf9a2a27e658d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:06.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.444+0000 7f5c527fc640 1 -- 172.21.15.29:0/3038099050 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c007740 con 0x7f5c5413f8e0 2024-09-13T18:52:06.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.444+0000 7f5c527fc640 1 -- 172.21.15.29:0/3038099050 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4c02d050 con 0x7f5c5413f8e0 2024-09-13T18:52:06.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.444+0000 7f5c527fc640 1 -- 172.21.15.29:0/3038099050 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c007ac0 con 0x7f5c5413f8e0 2024-09-13T18:52:06.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.444+0000 7f5c59ba3640 1 -- 172.21.15.29:0/3038099050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c5413f8e0 msgr2=0x7f5c5413fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:06.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.444+0000 7f5c59ba3640 1 --2- 172.21.15.29:0/3038099050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c5413f8e0 0x7f5c5413fd00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5c540bb4a0 tx=0x7f5c4c02a5f0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.444+0000 7f5c59ba3640 1 -- 172.21.15.29:0/3038099050 shutdown_connections 2024-09-13T18:52:06.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.444+0000 7f5c59ba3640 1 --2- 172.21.15.29:0/3038099050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c5413f8e0 0x7f5c5413fd00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.444+0000 7f5c59ba3640 1 --2- 172.21.15.29:0/3038099050 >> v2:172.21.15.96:3300/0 conn(0x7f5c540b31d0 0x7f5c540b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.444+0000 7f5c59ba3640 1 -- 172.21.15.29:0/3038099050 >> 172.21.15.29:0/3038099050 conn(0x7f5c540bb590 msgr2=0x7f5c540bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:06.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.445+0000 7f5c59ba3640 1 -- 172.21.15.29:0/3038099050 shutdown_connections 2024-09-13T18:52:06.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.445+0000 7f5c59ba3640 1 -- 172.21.15.29:0/3038099050 wait complete. 2024-09-13T18:52:06.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.446+0000 7f5c59ba3640 1 Processor -- start 2024-09-13T18:52:06.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.446+0000 7f5c59ba3640 1 -- start start 2024-09-13T18:52:06.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.446+0000 7f5c59ba3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540b31d0 0x7f5c541488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:06.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.446+0000 7f5c59ba3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c540b35b0 0x7f5c54144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:06.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.446+0000 7f5c59ba3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5c5413f8e0 0x7f5c54140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:06.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.446+0000 7f5c59ba3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c541445c0 con 0x7f5c540b31d0 2024-09-13T18:52:06.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.446+0000 7f5c59ba3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c54146380 con 0x7f5c540b35b0 2024-09-13T18:52:06.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.446+0000 7f5c59ba3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c54145400 con 0x7f5c5413f8e0 2024-09-13T18:52:06.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c537fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540b31d0 0x7f5c541488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:06.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c537fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540b31d0 0x7f5c541488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40270/0 (socket says 172.21.15.29:40270) 2024-09-13T18:52:06.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c537fe640 1 -- 172.21.15.29:0/2131584020 learned_addr learned my addr 172.21.15.29:0/2131584020 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:06.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c52ffd640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c540b35b0 0x7f5c54144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:06.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c53fff640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5c5413f8e0 0x7f5c54140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:06.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c537fe640 1 -- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5c5413f8e0 msgr2=0x7f5c54140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:06.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c537fe640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5c5413f8e0 0x7f5c54140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c537fe640 1 -- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c540b35b0 msgr2=0x7f5c54144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c537fe640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c540b35b0 0x7f5c54144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c537fe640 1 -- 172.21.15.29:0/2131584020 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c009a70 con 0x7f5c540b31d0 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c52ffd640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c540b35b0 0x7f5c54144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c53fff640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5c5413f8e0 0x7f5c54140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c537fe640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540b31d0 0x7f5c541488d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400ea10 tx=0x7f5c4400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c3bfff640 1 -- 172.21.15.29:0/2131584020 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44009670 con 0x7f5c540b31d0 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c3bfff640 1 -- 172.21.15.29:0/2131584020 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4400ca00 con 0x7f5c540b31d0 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c59ba3640 1 -- 172.21.15.29:0/2131584020 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c54145d30 con 0x7f5c540b31d0 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c3bfff640 1 -- 172.21.15.29:0/2131584020 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400cdb0 con 0x7f5c540b31d0 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.447+0000 7f5c59ba3640 1 -- 172.21.15.29:0/2131584020 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c541415e0 con 0x7f5c540b31d0 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.448+0000 7f5c59ba3640 1 -- 172.21.15.29:0/2131584020 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c54067300 con 0x7f5c540b31d0 2024-09-13T18:52:06.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.449+0000 7f5c3bfff640 1 -- 172.21.15.29:0/2131584020 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5c44013470 con 0x7f5c540b31d0 2024-09-13T18:52:06.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.449+0000 7f5c3bfff640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5c4006ac30 0x7f5c4006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:06.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.449+0000 7f5c3bfff640 1 -- 172.21.15.29:0/2131584020 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5c440898f0 con 0x7f5c540b31d0 2024-09-13T18:52:06.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.450+0000 7f5c52ffd640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5c4006ac30 0x7f5c4006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:06.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.450+0000 7f5c52ffd640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5c4006ac30 0x7f5c4006d0f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c54141d20 tx=0x7f5c48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:06.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.454+0000 7f5c3bfff640 1 -- 172.21.15.29:0/2131584020 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5c440547a0 con 0x7f5c540b31d0 2024-09-13T18:52:06.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.623+0000 7f5c59ba3640 1 -- 172.21.15.29:0/2131584020 --> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c54140240 con 0x7f5c4006ac30 2024-09-13T18:52:06.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.633+0000 7f5c3bfff640 1 -- 172.21.15.29:0/2131584020 <== mgr.4103 v2:172.21.15.96:6832/4217971068 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373079 (secure 0 0 0) 0x7f5c480013d0 con 0x7f5c4006ac30 2024-09-13T18:52:06.641 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:52:06.643 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-13T18:52:06.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.637+0000 7f5c59ba3640 1 -- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5c4006ac30 msgr2=0x7f5c4006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:06.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.637+0000 7f5c59ba3640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5c4006ac30 0x7f5c4006d0f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c54141d20 tx=0x7f5c48009040 comp rx=0 tx=0).stop 2024-09-13T18:52:06.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.637+0000 7f5c59ba3640 1 -- 172.21.15.29:0/2131584020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540b31d0 msgr2=0x7f5c541488d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:06.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.637+0000 7f5c59ba3640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540b31d0 0x7f5c541488d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400ea10 tx=0x7f5c4400eed0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.637+0000 7f5c59ba3640 1 -- 172.21.15.29:0/2131584020 shutdown_connections 2024-09-13T18:52:06.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.637+0000 7f5c59ba3640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f5c4006ac30 0x7f5c4006d0f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.637+0000 7f5c59ba3640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5c5413f8e0 0x7f5c54140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.637+0000 7f5c59ba3640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c540b35b0 0x7f5c54144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.637+0000 7f5c59ba3640 1 --2- 172.21.15.29:0/2131584020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540b31d0 0x7f5c541488d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.637+0000 7f5c59ba3640 1 -- 172.21.15.29:0/2131584020 >> 172.21.15.29:0/2131584020 conn(0x7f5c540bb590 msgr2=0x7f5c5413e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:06.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.637+0000 7f5c59ba3640 1 -- 172.21.15.29:0/2131584020 shutdown_connections 2024-09-13T18:52:06.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.637+0000 7f5c59ba3640 1 -- 172.21.15.29:0/2131584020 wait complete. 2024-09-13T18:52:06.651 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-09-13T18:52:05.694574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1544628,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":156,"num_read_kb":140,"num_write":437,"num_write_kb":3501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":981,"ondisk_log_size":981,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235616,"kb_used_data":3104,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739104,"statfs":{"total":773094113280,"available":772852842496,"internally_reserved":0,"allocated":3178496,"data_stored":3996160,"data_compressed":310028,"data_compressed_allocated":385024,"data_compressed_original":2588672,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003114"},"pg_stats":[{"pgid":"2.1f","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.536748+0000","last_change":"2024-09-13T18:50:48.536748+0000","last_active":"2024-09-13T18:50:48.536748+0000","last_peered":"2024-09-13T18:50:48.536748+0000","last_clean":"2024-09-13T18:50:48.536748+0000","last_became_active":"2024-09-13T18:45:21.667985+0000","last_became_peered":"2024-09-13T18:45:21.667985+0000","last_unstale":"2024-09-13T18:50:48.536748+0000","last_undegraded":"2024-09-13T18:50:48.536748+0000","last_fullsized":"2024-09-13T18:50:48.536748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:48.536623+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:48.536623+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.536623+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:34.362710+0000","scrub_duration":0.0039049509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:23.629992+0000","last_change":"2024-09-13T18:51:23.629992+0000","last_active":"2024-09-13T18:51:23.629992+0000","last_peered":"2024-09-13T18:51:23.629992+0000","last_clean":"2024-09-13T18:51:23.629992+0000","last_became_active":"2024-09-13T18:45:22.034125+0000","last_became_peered":"2024-09-13T18:45:22.034125+0000","last_unstale":"2024-09-13T18:51:23.629992+0000","last_undegraded":"2024-09-13T18:51:23.629992+0000","last_fullsized":"2024-09-13T18:51:23.629992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:23.629854+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:23.629854+0000","last_clean_scrub_stamp":"2024-09-13T18:51:23.629854+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:56.558159+0000","scrub_duration":0.001719728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:52.857548+0000","last_change":"2024-09-13T18:51:52.857696+0000","last_active":"2024-09-13T18:51:52.857548+0000","last_peered":"2024-09-13T18:51:52.857548+0000","last_clean":"2024-09-13T18:51:52.857548+0000","last_became_active":"2024-09-13T18:45:26.252747+0000","last_became_peered":"2024-09-13T18:45:26.252747+0000","last_unstale":"2024-09-13T18:51:52.857548+0000","last_undegraded":"2024-09-13T18:51:52.857548+0000","last_fullsized":"2024-09-13T18:51:52.857548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:52.857521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:52.857521+0000","last_clean_scrub_stamp":"2024-09-13T18:51:52.857521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:30.147452+0000","scrub_duration":0.002051359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:55.823028+0000","last_change":"2024-09-13T18:50:55.823028+0000","last_active":"2024-09-13T18:50:55.823028+0000","last_peered":"2024-09-13T18:50:55.823028+0000","last_clean":"2024-09-13T18:50:55.823028+0000","last_became_active":"2024-09-13T18:45:21.666398+0000","last_became_peered":"2024-09-13T18:45:21.666398+0000","last_unstale":"2024-09-13T18:50:55.823028+0000","last_undegraded":"2024-09-13T18:50:55.823028+0000","last_fullsized":"2024-09-13T18:50:55.823028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:55.822888+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:55.822888+0000","last_clean_scrub_stamp":"2024-09-13T18:50:55.822888+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:09.382112+0000","scrub_duration":0.001447315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:03.501489+0000","last_change":"2024-09-13T18:51:03.501489+0000","last_active":"2024-09-13T18:51:03.501489+0000","last_peered":"2024-09-13T18:51:03.501489+0000","last_clean":"2024-09-13T18:51:03.501489+0000","last_became_active":"2024-09-13T18:45:22.024424+0000","last_became_peered":"2024-09-13T18:45:22.024424+0000","last_unstale":"2024-09-13T18:51:03.501489+0000","last_undegraded":"2024-09-13T18:51:03.501489+0000","last_fullsized":"2024-09-13T18:51:03.501489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:03.501346+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:03.501346+0000","last_clean_scrub_stamp":"2024-09-13T18:51:03.501346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:30.116732+0000","scrub_duration":0.001917361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:04.839924+0000","last_change":"2024-09-13T18:51:04.840041+0000","last_active":"2024-09-13T18:51:04.839924+0000","last_peered":"2024-09-13T18:51:04.839924+0000","last_clean":"2024-09-13T18:51:04.839924+0000","last_became_active":"2024-09-13T18:45:26.049414+0000","last_became_peered":"2024-09-13T18:45:26.049414+0000","last_unstale":"2024-09-13T18:51:04.839924+0000","last_undegraded":"2024-09-13T18:51:04.839924+0000","last_fullsized":"2024-09-13T18:51:04.839924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:04.839896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:04.839896+0000","last_clean_scrub_stamp":"2024-09-13T18:51:04.839896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:31.455281+0000","scrub_duration":0.0018258759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:00.920349+0000","last_change":"2024-09-13T18:51:00.920443+0000","last_active":"2024-09-13T18:51:00.920349+0000","last_peered":"2024-09-13T18:51:00.920349+0000","last_clean":"2024-09-13T18:51:00.920349+0000","last_became_active":"2024-09-13T18:45:21.667602+0000","last_became_peered":"2024-09-13T18:45:21.667602+0000","last_unstale":"2024-09-13T18:51:00.920349+0000","last_undegraded":"2024-09-13T18:51:00.920349+0000","last_fullsized":"2024-09-13T18:51:00.920349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:00.920324+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:00.920324+0000","last_clean_scrub_stamp":"2024-09-13T18:51:00.920324+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:59.320550+0000","scrub_duration":0.0027812430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:30.504702+0000","last_change":"2024-09-13T18:51:30.504795+0000","last_active":"2024-09-13T18:51:30.504702+0000","last_peered":"2024-09-13T18:51:30.504702+0000","last_clean":"2024-09-13T18:51:30.504702+0000","last_became_active":"2024-09-13T18:45:22.035790+0000","last_became_peered":"2024-09-13T18:45:22.035790+0000","last_unstale":"2024-09-13T18:51:30.504702+0000","last_undegraded":"2024-09-13T18:51:30.504702+0000","last_fullsized":"2024-09-13T18:51:30.504702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:30.504676+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:30.504676+0000","last_clean_scrub_stamp":"2024-09-13T18:51:30.504676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:42.258958+0000","scrub_duration":0.0014297890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:34.978876+0000","last_change":"2024-09-13T18:51:34.978993+0000","last_active":"2024-09-13T18:51:34.978876+0000","last_peered":"2024-09-13T18:51:34.978876+0000","last_clean":"2024-09-13T18:51:34.978876+0000","last_became_active":"2024-09-13T18:45:26.051873+0000","last_became_peered":"2024-09-13T18:45:26.051873+0000","last_unstale":"2024-09-13T18:51:34.978876+0000","last_undegraded":"2024-09-13T18:51:34.978876+0000","last_fullsized":"2024-09-13T18:51:34.978876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:34.978853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:34.978853+0000","last_clean_scrub_stamp":"2024-09-13T18:51:34.978853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:15.355473+0000","scrub_duration":0.0019576440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.931169+0000","last_change":"2024-09-13T18:50:51.931266+0000","last_active":"2024-09-13T18:50:51.931169+0000","last_peered":"2024-09-13T18:50:51.931169+0000","last_clean":"2024-09-13T18:50:51.931169+0000","last_became_active":"2024-09-13T18:45:21.669622+0000","last_became_peered":"2024-09-13T18:45:21.669622+0000","last_unstale":"2024-09-13T18:50:51.931169+0000","last_undegraded":"2024-09-13T18:50:51.931169+0000","last_fullsized":"2024-09-13T18:50:51.931169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:51.931146+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:51.931146+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.931146+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:13.786431+0000","scrub_duration":0.0028583060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'14","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:13.440684+0000","last_change":"2024-09-13T18:51:13.440828+0000","last_active":"2024-09-13T18:51:13.440684+0000","last_peered":"2024-09-13T18:51:13.440684+0000","last_clean":"2024-09-13T18:51:13.440684+0000","last_became_active":"2024-09-13T18:45:22.034431+0000","last_became_peered":"2024-09-13T18:45:22.034431+0000","last_unstale":"2024-09-13T18:51:13.440684+0000","last_undegraded":"2024-09-13T18:51:13.440684+0000","last_fullsized":"2024-09-13T18:51:13.440684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-09-13T18:51:13.440661+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-09-13T18:51:13.440661+0000","last_clean_scrub_stamp":"2024-09-13T18:51:13.440661+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:58.336878+0000","scrub_duration":0.001315384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:12.893027+0000","last_change":"2024-09-13T18:51:12.893188+0000","last_active":"2024-09-13T18:51:12.893027+0000","last_peered":"2024-09-13T18:51:12.893027+0000","last_clean":"2024-09-13T18:51:12.893027+0000","last_became_active":"2024-09-13T18:45:26.052441+0000","last_became_peered":"2024-09-13T18:45:26.052441+0000","last_unstale":"2024-09-13T18:51:12.893027+0000","last_undegraded":"2024-09-13T18:51:12.893027+0000","last_fullsized":"2024-09-13T18:51:12.893027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:12.893003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:12.893003+0000","last_clean_scrub_stamp":"2024-09-13T18:51:12.893003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:15.183557+0000","scrub_duration":0.0022650729999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'7","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.253185+0000","last_change":"2024-09-13T18:50:53.253185+0000","last_active":"2024-09-13T18:50:53.253185+0000","last_peered":"2024-09-13T18:50:53.253185+0000","last_clean":"2024-09-13T18:50:53.253185+0000","last_became_active":"2024-09-13T18:45:22.015758+0000","last_became_peered":"2024-09-13T18:45:22.015758+0000","last_unstale":"2024-09-13T18:50:53.253185+0000","last_undegraded":"2024-09-13T18:50:53.253185+0000","last_fullsized":"2024-09-13T18:50:53.253185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:53.253065+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:53.253065+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.253065+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:15.108350+0000","scrub_duration":0.001311446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:58.974434+0000","last_change":"2024-09-13T18:50:58.974551+0000","last_active":"2024-09-13T18:50:58.974434+0000","last_peered":"2024-09-13T18:50:58.974434+0000","last_clean":"2024-09-13T18:50:58.974434+0000","last_became_active":"2024-09-13T18:45:21.672388+0000","last_became_peered":"2024-09-13T18:45:21.672388+0000","last_unstale":"2024-09-13T18:50:58.974434+0000","last_undegraded":"2024-09-13T18:50:58.974434+0000","last_fullsized":"2024-09-13T18:50:58.974434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:50:58.974396+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:50:58.974396+0000","last_clean_scrub_stamp":"2024-09-13T18:50:58.974396+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:13.454414+0000","scrub_duration":0.0026098369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:27.949112+0000","last_change":"2024-09-13T18:51:27.949292+0000","last_active":"2024-09-13T18:51:27.949112+0000","last_peered":"2024-09-13T18:51:27.949112+0000","last_clean":"2024-09-13T18:51:27.949112+0000","last_became_active":"2024-09-13T18:46:11.149623+0000","last_became_peered":"2024-09-13T18:46:11.149623+0000","last_unstale":"2024-09-13T18:51:27.949112+0000","last_undegraded":"2024-09-13T18:51:27.949112+0000","last_fullsized":"2024-09-13T18:51:27.949112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:27.949088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:27.949088+0000","last_clean_scrub_stamp":"2024-09-13T18:51:27.949088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:35.324463+0000","scrub_duration":0.0023065080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:25.658533+0000","last_change":"2024-09-13T18:51:25.658624+0000","last_active":"2024-09-13T18:51:25.658533+0000","last_peered":"2024-09-13T18:51:25.658533+0000","last_clean":"2024-09-13T18:51:25.658533+0000","last_became_active":"2024-09-13T18:45:22.028336+0000","last_became_peered":"2024-09-13T18:45:22.028336+0000","last_unstale":"2024-09-13T18:51:25.658533+0000","last_undegraded":"2024-09-13T18:51:25.658533+0000","last_fullsized":"2024-09-13T18:51:25.658533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:51:25.658511+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:51:25.658511+0000","last_clean_scrub_stamp":"2024-09-13T18:51:25.658511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:33.033886+0000","scrub_duration":0.0014485850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.227414+0000","last_change":"2024-09-13T18:50:51.227414+0000","last_active":"2024-09-13T18:50:51.227414+0000","last_peered":"2024-09-13T18:50:51.227414+0000","last_clean":"2024-09-13T18:50:51.227414+0000","last_became_active":"2024-09-13T18:45:21.667625+0000","last_became_peered":"2024-09-13T18:45:21.667625+0000","last_unstale":"2024-09-13T18:50:51.227414+0000","last_undegraded":"2024-09-13T18:50:51.227414+0000","last_fullsized":"2024-09-13T18:50:51.227414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:51.227280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:51.227280+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.227280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:05.707299+0000","scrub_duration":0.001427123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:29.924495+0000","last_change":"2024-09-13T18:51:29.924650+0000","last_active":"2024-09-13T18:51:29.924495+0000","last_peered":"2024-09-13T18:51:29.924495+0000","last_clean":"2024-09-13T18:51:29.924495+0000","last_became_active":"2024-09-13T18:45:26.049129+0000","last_became_peered":"2024-09-13T18:45:26.049129+0000","last_unstale":"2024-09-13T18:51:29.924495+0000","last_undegraded":"2024-09-13T18:51:29.924495+0000","last_fullsized":"2024-09-13T18:51:29.924495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:29.924469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:29.924469+0000","last_clean_scrub_stamp":"2024-09-13T18:51:29.924469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:41.678751+0000","scrub_duration":0.002172322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:54.649259+0000","last_change":"2024-09-13T18:50:54.649378+0000","last_active":"2024-09-13T18:50:54.649259+0000","last_peered":"2024-09-13T18:50:54.649259+0000","last_clean":"2024-09-13T18:50:54.649259+0000","last_became_active":"2024-09-13T18:46:11.149036+0000","last_became_peered":"2024-09-13T18:46:11.149036+0000","last_unstale":"2024-09-13T18:50:54.649259+0000","last_undegraded":"2024-09-13T18:50:54.649259+0000","last_fullsized":"2024-09-13T18:50:54.649259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:54.649236+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:54.649236+0000","last_clean_scrub_stamp":"2024-09-13T18:50:54.649236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:09.129255+0000","scrub_duration":0.001480161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:45.276213+0000","last_change":"2024-09-13T18:50:45.276213+0000","last_active":"2024-09-13T18:50:45.276213+0000","last_peered":"2024-09-13T18:50:45.276213+0000","last_clean":"2024-09-13T18:50:45.276213+0000","last_became_active":"2024-09-13T18:45:21.668242+0000","last_became_peered":"2024-09-13T18:45:21.668242+0000","last_unstale":"2024-09-13T18:50:45.276213+0000","last_undegraded":"2024-09-13T18:50:45.276213+0000","last_fullsized":"2024-09-13T18:50:45.276213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:45.276090+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:45.276090+0000","last_clean_scrub_stamp":"2024-09-13T18:50:45.276090+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:32.233036+0000","scrub_duration":0.001724461,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:37.418838+0000","last_change":"2024-09-13T18:51:37.418967+0000","last_active":"2024-09-13T18:51:37.418838+0000","last_peered":"2024-09-13T18:51:37.418838+0000","last_clean":"2024-09-13T18:51:37.418838+0000","last_became_active":"2024-09-13T18:45:26.254886+0000","last_became_peered":"2024-09-13T18:45:26.254886+0000","last_unstale":"2024-09-13T18:51:37.418838+0000","last_undegraded":"2024-09-13T18:51:37.418838+0000","last_fullsized":"2024-09-13T18:51:37.418838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:37.418814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:37.418814+0000","last_clean_scrub_stamp":"2024-09-13T18:51:37.418814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:42.292574+0000","scrub_duration":0.0017496129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.741674+0000","last_change":"2024-09-13T18:50:48.741674+0000","last_active":"2024-09-13T18:50:48.741674+0000","last_peered":"2024-09-13T18:50:48.741674+0000","last_clean":"2024-09-13T18:50:48.741674+0000","last_became_active":"2024-09-13T18:45:22.027835+0000","last_became_peered":"2024-09-13T18:45:22.027835+0000","last_unstale":"2024-09-13T18:50:48.741674+0000","last_undegraded":"2024-09-13T18:50:48.741674+0000","last_fullsized":"2024-09-13T18:50:48.741674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:48.741554+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:48.741554+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.741554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:34.567640+0000","scrub_duration":0.0017755049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.907727+0000","last_change":"2024-09-13T18:51:01.907727+0000","last_active":"2024-09-13T18:51:01.907727+0000","last_peered":"2024-09-13T18:51:01.907727+0000","last_clean":"2024-09-13T18:51:01.907727+0000","last_became_active":"2024-09-13T18:45:21.668765+0000","last_became_peered":"2024-09-13T18:45:21.668765+0000","last_unstale":"2024-09-13T18:51:01.907727+0000","last_undegraded":"2024-09-13T18:51:01.907727+0000","last_fullsized":"2024-09-13T18:51:01.907727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:51:01.907558+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:51:01.907558+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.907558+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:56.338211+0000","scrub_duration":0.0021193679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:03.860763+0000","last_change":"2024-09-13T18:51:03.860929+0000","last_active":"2024-09-13T18:51:03.860763+0000","last_peered":"2024-09-13T18:51:03.860763+0000","last_clean":"2024-09-13T18:51:03.860763+0000","last_became_active":"2024-09-13T18:45:26.049408+0000","last_became_peered":"2024-09-13T18:45:26.049408+0000","last_unstale":"2024-09-13T18:51:03.860763+0000","last_undegraded":"2024-09-13T18:51:03.860763+0000","last_fullsized":"2024-09-13T18:51:03.860763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:03.860740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:03.860740+0000","last_clean_scrub_stamp":"2024-09-13T18:51:03.860740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:12.491143+0000","scrub_duration":0.0020454399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:52.560268+0000","last_change":"2024-09-13T18:50:52.560268+0000","last_active":"2024-09-13T18:50:52.560268+0000","last_peered":"2024-09-13T18:50:52.560268+0000","last_clean":"2024-09-13T18:50:52.560268+0000","last_became_active":"2024-09-13T18:45:22.021976+0000","last_became_peered":"2024-09-13T18:45:22.021976+0000","last_unstale":"2024-09-13T18:50:52.560268+0000","last_undegraded":"2024-09-13T18:50:52.560268+0000","last_fullsized":"2024-09-13T18:50:52.560268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:52.560142+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:52.560142+0000","last_clean_scrub_stamp":"2024-09-13T18:50:52.560142+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:48.429003+0000","scrub_duration":0.0016215960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'5","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.229823+0000","last_change":"2024-09-13T18:50:48.229823+0000","last_active":"2024-09-13T18:50:48.229823+0000","last_peered":"2024-09-13T18:50:48.229823+0000","last_clean":"2024-09-13T18:50:48.229823+0000","last_became_active":"2024-09-13T18:45:21.667680+0000","last_became_peered":"2024-09-13T18:45:21.667680+0000","last_unstale":"2024-09-13T18:50:48.229823+0000","last_undegraded":"2024-09-13T18:50:48.229823+0000","last_fullsized":"2024-09-13T18:50:48.229823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:48.229676+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:48.229676+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.229676+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:38.239939+0000","scrub_duration":0.0024150930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:15.834041+0000","last_change":"2024-09-13T18:51:15.834041+0000","last_active":"2024-09-13T18:51:15.834041+0000","last_peered":"2024-09-13T18:51:15.834041+0000","last_clean":"2024-09-13T18:51:15.834041+0000","last_became_active":"2024-09-13T18:45:26.254662+0000","last_became_peered":"2024-09-13T18:45:26.254662+0000","last_unstale":"2024-09-13T18:51:15.834041+0000","last_undegraded":"2024-09-13T18:51:15.834041+0000","last_fullsized":"2024-09-13T18:51:15.834041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:15.833861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:15.833861+0000","last_clean_scrub_stamp":"2024-09-13T18:51:15.833861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:39.007889+0000","scrub_duration":0.0017530099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.804727+0000","last_change":"2024-09-13T18:51:01.804727+0000","last_active":"2024-09-13T18:51:01.804727+0000","last_peered":"2024-09-13T18:51:01.804727+0000","last_clean":"2024-09-13T18:51:01.804727+0000","last_became_active":"2024-09-13T18:45:22.026419+0000","last_became_peered":"2024-09-13T18:45:22.026419+0000","last_unstale":"2024-09-13T18:51:01.804727+0000","last_undegraded":"2024-09-13T18:51:01.804727+0000","last_fullsized":"2024-09-13T18:51:01.804727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:01.804577+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:01.804577+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.804577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:28.419963+0000","scrub_duration":0.001887402,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'37","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:54.195184+0000","last_change":"2024-09-13T18:50:54.195184+0000","last_active":"2024-09-13T18:50:54.195184+0000","last_peered":"2024-09-13T18:50:54.195184+0000","last_clean":"2024-09-13T18:50:54.195184+0000","last_became_active":"2024-09-13T18:45:21.664066+0000","last_became_peered":"2024-09-13T18:45:21.664066+0000","last_unstale":"2024-09-13T18:50:54.195184+0000","last_undegraded":"2024-09-13T18:50:54.195184+0000","last_fullsized":"2024-09-13T18:50:54.195184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'37","last_scrub_stamp":"2024-09-13T18:50:54.195018+0000","last_deep_scrub":"26'37","last_deep_scrub_stamp":"2024-09-13T18:50:54.195018+0000","last_clean_scrub_stamp":"2024-09-13T18:50:54.195018+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:48.625670+0000","scrub_duration":0.0018610250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:53.823790+0000","last_change":"2024-09-13T18:51:53.823939+0000","last_active":"2024-09-13T18:51:53.823790+0000","last_peered":"2024-09-13T18:51:53.823790+0000","last_clean":"2024-09-13T18:51:53.823790+0000","last_became_active":"2024-09-13T18:45:26.253488+0000","last_became_peered":"2024-09-13T18:45:26.253488+0000","last_unstale":"2024-09-13T18:51:53.823790+0000","last_undegraded":"2024-09-13T18:51:53.823790+0000","last_fullsized":"2024-09-13T18:51:53.823790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:53.823766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:53.823766+0000","last_clean_scrub_stamp":"2024-09-13T18:51:53.823766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:29.219012+0000","scrub_duration":0.00178963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'11","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:07.332449+0000","last_change":"2024-09-13T18:51:07.332449+0000","last_active":"2024-09-13T18:51:07.332449+0000","last_peered":"2024-09-13T18:51:07.332449+0000","last_clean":"2024-09-13T18:51:07.332449+0000","last_became_active":"2024-09-13T18:45:22.022628+0000","last_became_peered":"2024-09-13T18:45:22.022628+0000","last_unstale":"2024-09-13T18:51:07.332449+0000","last_undegraded":"2024-09-13T18:51:07.332449+0000","last_fullsized":"2024-09-13T18:51:07.332449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:51:07.332316+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:51:07.332316+0000","last_clean_scrub_stamp":"2024-09-13T18:51:07.332316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:15.962718+0000","scrub_duration":0.0015008759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:50.944283+0000","last_change":"2024-09-13T18:50:50.944283+0000","last_active":"2024-09-13T18:50:50.944283+0000","last_peered":"2024-09-13T18:50:50.944283+0000","last_clean":"2024-09-13T18:50:50.944283+0000","last_became_active":"2024-09-13T18:45:21.668645+0000","last_became_peered":"2024-09-13T18:45:21.668645+0000","last_unstale":"2024-09-13T18:50:50.944283+0000","last_undegraded":"2024-09-13T18:50:50.944283+0000","last_fullsized":"2024-09-13T18:50:50.944283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:50.944170+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:50.944170+0000","last_clean_scrub_stamp":"2024-09-13T18:50:50.944170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:50.702974+0000","scrub_duration":0.0019259710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'5","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:27.651545+0000","last_change":"2024-09-13T18:51:27.651545+0000","last_active":"2024-09-13T18:51:27.651545+0000","last_peered":"2024-09-13T18:51:27.651545+0000","last_clean":"2024-09-13T18:51:27.651545+0000","last_became_active":"2024-09-13T18:46:11.658190+0000","last_became_peered":"2024-09-13T18:46:11.658190+0000","last_unstale":"2024-09-13T18:51:27.651545+0000","last_undegraded":"2024-09-13T18:51:27.651545+0000","last_fullsized":"2024-09-13T18:51:27.651545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:27.651359+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:27.651359+0000","last_clean_scrub_stamp":"2024-09-13T18:51:27.651359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:39.405641+0000","scrub_duration":0.0020187199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:56.652546+0000","last_change":"2024-09-13T18:50:56.652677+0000","last_active":"2024-09-13T18:50:56.652546+0000","last_peered":"2024-09-13T18:50:56.652546+0000","last_clean":"2024-09-13T18:50:56.652546+0000","last_became_active":"2024-09-13T18:46:11.145524+0000","last_became_peered":"2024-09-13T18:46:11.145524+0000","last_unstale":"2024-09-13T18:50:56.652546+0000","last_undegraded":"2024-09-13T18:50:56.652546+0000","last_fullsized":"2024-09-13T18:50:56.652546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:56.652521+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:56.652521+0000","last_clean_scrub_stamp":"2024-09-13T18:50:56.652521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:42.478607+0000","scrub_duration":0.0014878630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:58.294183+0000","last_change":"2024-09-13T18:50:58.294183+0000","last_active":"2024-09-13T18:50:58.294183+0000","last_peered":"2024-09-13T18:50:58.294183+0000","last_clean":"2024-09-13T18:50:58.294183+0000","last_became_active":"2024-09-13T18:45:21.660577+0000","last_became_peered":"2024-09-13T18:45:21.660577+0000","last_unstale":"2024-09-13T18:50:58.294183+0000","last_undegraded":"2024-09-13T18:50:58.294183+0000","last_fullsized":"2024-09-13T18:50:58.294183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:58.294026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:58.294026+0000","last_clean_scrub_stamp":"2024-09-13T18:50:58.294026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:54.162887+0000","scrub_duration":0.001538322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:39.381210+0000","last_change":"2024-09-13T18:51:39.381210+0000","last_active":"2024-09-13T18:51:39.381210+0000","last_peered":"2024-09-13T18:51:39.381210+0000","last_clean":"2024-09-13T18:51:39.381210+0000","last_became_active":"2024-09-13T18:45:26.053877+0000","last_became_peered":"2024-09-13T18:45:26.053877+0000","last_unstale":"2024-09-13T18:51:39.381210+0000","last_undegraded":"2024-09-13T18:51:39.381210+0000","last_fullsized":"2024-09-13T18:51:39.381210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:39.381056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:39.381056+0000","last_clean_scrub_stamp":"2024-09-13T18:51:39.381056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:19.757676+0000","scrub_duration":0.0019067769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.737342+0000","last_change":"2024-09-13T18:50:49.737342+0000","last_active":"2024-09-13T18:50:49.737342+0000","last_peered":"2024-09-13T18:50:49.737342+0000","last_clean":"2024-09-13T18:50:49.737342+0000","last_became_active":"2024-09-13T18:45:22.028714+0000","last_became_peered":"2024-09-13T18:45:22.028714+0000","last_unstale":"2024-09-13T18:50:49.737342+0000","last_undegraded":"2024-09-13T18:50:49.737342+0000","last_fullsized":"2024-09-13T18:50:49.737342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:49.737225+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:49.737225+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.737225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:11.076096+0000","scrub_duration":0.0019902909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.620039+0000","last_change":"2024-09-13T18:50:51.620039+0000","last_active":"2024-09-13T18:50:51.620039+0000","last_peered":"2024-09-13T18:50:51.620039+0000","last_clean":"2024-09-13T18:50:51.620039+0000","last_became_active":"2024-09-13T18:45:21.667320+0000","last_became_peered":"2024-09-13T18:45:21.667320+0000","last_unstale":"2024-09-13T18:50:51.620039+0000","last_undegraded":"2024-09-13T18:50:51.620039+0000","last_fullsized":"2024-09-13T18:50:51.620039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:51.619900+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:51.619900+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.619900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:12.958770+0000","scrub_duration":0.0015549559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:48.499744+0000","last_change":"2024-09-13T18:51:48.499879+0000","last_active":"2024-09-13T18:51:48.499744+0000","last_peered":"2024-09-13T18:51:48.499744+0000","last_clean":"2024-09-13T18:51:48.499744+0000","last_became_active":"2024-09-13T18:46:11.147801+0000","last_became_peered":"2024-09-13T18:46:11.147801+0000","last_unstale":"2024-09-13T18:51:48.499744+0000","last_undegraded":"2024-09-13T18:51:48.499744+0000","last_fullsized":"2024-09-13T18:51:48.499744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:51:48.499716+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:51:48.499716+0000","last_clean_scrub_stamp":"2024-09-13T18:51:48.499716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:25.564430+0000","scrub_duration":0.0019671369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.265385+0000","last_change":"2024-09-13T18:51:01.265385+0000","last_active":"2024-09-13T18:51:01.265385+0000","last_peered":"2024-09-13T18:51:01.265385+0000","last_clean":"2024-09-13T18:51:01.265385+0000","last_became_active":"2024-09-13T18:45:22.023357+0000","last_became_peered":"2024-09-13T18:45:22.023357+0000","last_unstale":"2024-09-13T18:51:01.265385+0000","last_undegraded":"2024-09-13T18:51:01.265385+0000","last_fullsized":"2024-09-13T18:51:01.265385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:01.265221+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:01.265221+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.265221+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:14.824444+0000","scrub_duration":0.0015610520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'46","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.567062+0000","last_change":"2024-09-13T18:50:47.567062+0000","last_active":"2024-09-13T18:50:47.567062+0000","last_peered":"2024-09-13T18:50:47.567062+0000","last_clean":"2024-09-13T18:50:47.567062+0000","last_became_active":"2024-09-13T18:45:21.667768+0000","last_became_peered":"2024-09-13T18:45:21.667768+0000","last_unstale":"2024-09-13T18:50:47.567062+0000","last_undegraded":"2024-09-13T18:50:47.567062+0000","last_fullsized":"2024-09-13T18:50:47.567062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'46","last_scrub_stamp":"2024-09-13T18:50:47.566865+0000","last_deep_scrub":"26'46","last_deep_scrub_stamp":"2024-09-13T18:50:47.566865+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.566865+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:09.704431+0000","scrub_duration":0.0017576639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":40,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:33.454365+0000","last_change":"2024-09-13T18:51:33.454365+0000","last_active":"2024-09-13T18:51:33.454365+0000","last_peered":"2024-09-13T18:51:33.454365+0000","last_clean":"2024-09-13T18:51:33.454365+0000","last_became_active":"2024-09-13T18:45:26.056850+0000","last_became_peered":"2024-09-13T18:45:26.056850+0000","last_unstale":"2024-09-13T18:51:33.454365+0000","last_undegraded":"2024-09-13T18:51:33.454365+0000","last_fullsized":"2024-09-13T18:51:33.454365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:33.454207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:33.454207+0000","last_clean_scrub_stamp":"2024-09-13T18:51:33.454207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:40.829582+0000","scrub_duration":0.001871422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.560377+0000","last_change":"2024-09-13T18:50:49.560377+0000","last_active":"2024-09-13T18:50:49.560377+0000","last_peered":"2024-09-13T18:50:49.560377+0000","last_clean":"2024-09-13T18:50:49.560377+0000","last_became_active":"2024-09-13T18:45:22.020317+0000","last_became_peered":"2024-09-13T18:45:22.020317+0000","last_unstale":"2024-09-13T18:50:49.560377+0000","last_undegraded":"2024-09-13T18:50:49.560377+0000","last_fullsized":"2024-09-13T18:50:49.560377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:49.560243+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:49.560243+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.560243+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:10.899114+0000","scrub_duration":0.001921554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.990780+0000","last_change":"2024-09-13T18:50:49.990780+0000","last_active":"2024-09-13T18:50:49.990780+0000","last_peered":"2024-09-13T18:50:49.990780+0000","last_clean":"2024-09-13T18:50:49.990780+0000","last_became_active":"2024-09-13T18:45:21.667483+0000","last_became_peered":"2024-09-13T18:45:21.667483+0000","last_unstale":"2024-09-13T18:50:49.990780+0000","last_undegraded":"2024-09-13T18:50:49.990780+0000","last_fullsized":"2024-09-13T18:50:49.990780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:49.990664+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:49.990664+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.990664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:12.128230+0000","scrub_duration":0.002034138,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:25.718158+0000","last_change":"2024-09-13T18:51:25.718158+0000","last_active":"2024-09-13T18:51:25.718158+0000","last_peered":"2024-09-13T18:51:25.718158+0000","last_clean":"2024-09-13T18:51:25.718158+0000","last_became_active":"2024-09-13T18:45:26.253533+0000","last_became_peered":"2024-09-13T18:45:26.253533+0000","last_unstale":"2024-09-13T18:51:25.718158+0000","last_undegraded":"2024-09-13T18:51:25.718158+0000","last_fullsized":"2024-09-13T18:51:25.718158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:25.718035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:25.718035+0000","last_clean_scrub_stamp":"2024-09-13T18:51:25.718035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:33.093410+0000","scrub_duration":0.0016015700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:45.898842+0000","last_change":"2024-09-13T18:50:45.898842+0000","last_active":"2024-09-13T18:50:45.898842+0000","last_peered":"2024-09-13T18:50:45.898842+0000","last_clean":"2024-09-13T18:50:45.898842+0000","last_became_active":"2024-09-13T18:45:22.032109+0000","last_became_peered":"2024-09-13T18:45:22.032109+0000","last_unstale":"2024-09-13T18:50:45.898842+0000","last_undegraded":"2024-09-13T18:50:45.898842+0000","last_fullsized":"2024-09-13T18:50:45.898842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:50:45.898727+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:50:45.898727+0000","last_clean_scrub_stamp":"2024-09-13T18:50:45.898727+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:31.724813+0000","scrub_duration":0.002426119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'4","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:55.584126+0000","last_change":"2024-09-13T18:50:55.584126+0000","last_active":"2024-09-13T18:50:55.584126+0000","last_peered":"2024-09-13T18:50:55.584126+0000","last_clean":"2024-09-13T18:50:55.584126+0000","last_became_active":"2024-09-13T18:45:21.662344+0000","last_became_peered":"2024-09-13T18:45:21.662344+0000","last_unstale":"2024-09-13T18:50:55.584126+0000","last_undegraded":"2024-09-13T18:50:55.584126+0000","last_fullsized":"2024-09-13T18:50:55.584126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:55.583980+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:55.583980+0000","last_clean_scrub_stamp":"2024-09-13T18:50:55.583980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:51.452841+0000","scrub_duration":0.0022605720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":185,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.963592+0000","last_change":"2024-09-13T18:50:47.963592+0000","last_active":"2024-09-13T18:50:47.963592+0000","last_peered":"2024-09-13T18:50:47.963592+0000","last_clean":"2024-09-13T18:50:47.963592+0000","last_became_active":"2024-09-13T18:45:19.777172+0000","last_became_peered":"2024-09-13T18:45:19.777172+0000","last_unstale":"2024-09-13T18:50:47.963592+0000","last_undegraded":"2024-09-13T18:50:47.963592+0000","last_fullsized":"2024-09-13T18:50:47.963592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-09-13T18:50:47.963462+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-09-13T18:50:47.963462+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.963462+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:32.776049+0000","scrub_duration":0.0045475369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:19.229290+0000","last_change":"2024-09-13T18:51:19.229290+0000","last_active":"2024-09-13T18:51:19.229290+0000","last_peered":"2024-09-13T18:51:19.229290+0000","last_clean":"2024-09-13T18:51:19.229290+0000","last_became_active":"2024-09-13T18:45:26.252890+0000","last_became_peered":"2024-09-13T18:45:26.252890+0000","last_unstale":"2024-09-13T18:51:19.229290+0000","last_undegraded":"2024-09-13T18:51:19.229290+0000","last_fullsized":"2024-09-13T18:51:19.229290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:19.229136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:19.229136+0000","last_clean_scrub_stamp":"2024-09-13T18:51:19.229136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:45.844522+0000","scrub_duration":0.0018592859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:08.902874+0000","last_change":"2024-09-13T18:51:08.902981+0000","last_active":"2024-09-13T18:51:08.902874+0000","last_peered":"2024-09-13T18:51:08.902874+0000","last_clean":"2024-09-13T18:51:08.902874+0000","last_became_active":"2024-09-13T18:45:22.036153+0000","last_became_peered":"2024-09-13T18:45:22.036153+0000","last_unstale":"2024-09-13T18:51:08.902874+0000","last_undegraded":"2024-09-13T18:51:08.902874+0000","last_fullsized":"2024-09-13T18:51:08.902874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:08.902849+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:08.902849+0000","last_clean_scrub_stamp":"2024-09-13T18:51:08.902849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:22.462073+0000","scrub_duration":0.001591044,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:43.612187+0000","last_change":"2024-09-13T18:50:43.612278+0000","last_active":"2024-09-13T18:50:43.612187+0000","last_peered":"2024-09-13T18:50:43.612187+0000","last_clean":"2024-09-13T18:50:43.612187+0000","last_became_active":"2024-09-13T18:45:21.665582+0000","last_became_peered":"2024-09-13T18:45:21.665582+0000","last_unstale":"2024-09-13T18:50:43.612187+0000","last_undegraded":"2024-09-13T18:50:43.612187+0000","last_fullsized":"2024-09-13T18:50:43.612187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:43.612164+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:43.612164+0000","last_clean_scrub_stamp":"2024-09-13T18:50:43.612164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:38.969573+0000","scrub_duration":0.0020111640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:25.204734+0000","last_change":"2024-09-13T18:51:25.204734+0000","last_active":"2024-09-13T18:51:25.204734+0000","last_peered":"2024-09-13T18:51:25.204734+0000","last_clean":"2024-09-13T18:51:25.204734+0000","last_became_active":"2024-09-13T18:45:26.249986+0000","last_became_peered":"2024-09-13T18:45:26.249986+0000","last_unstale":"2024-09-13T18:51:25.204734+0000","last_undegraded":"2024-09-13T18:51:25.204734+0000","last_fullsized":"2024-09-13T18:51:25.204734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:25.204595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:25.204595+0000","last_clean_scrub_stamp":"2024-09-13T18:51:25.204595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:03.481360+0000","scrub_duration":0.0022130019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.591676+0000","last_change":"2024-09-13T18:50:48.591788+0000","last_active":"2024-09-13T18:50:48.591676+0000","last_peered":"2024-09-13T18:50:48.591676+0000","last_clean":"2024-09-13T18:50:48.591676+0000","last_became_active":"2024-09-13T18:45:22.036523+0000","last_became_peered":"2024-09-13T18:45:22.036523+0000","last_unstale":"2024-09-13T18:50:48.591676+0000","last_undegraded":"2024-09-13T18:50:48.591676+0000","last_fullsized":"2024-09-13T18:50:48.591676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:48.591652+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:48.591652+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.591652+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:03.071671+0000","scrub_duration":0.001672523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.185355+0000","last_change":"2024-09-13T18:50:53.185451+0000","last_active":"2024-09-13T18:50:53.185355+0000","last_peered":"2024-09-13T18:50:53.185355+0000","last_clean":"2024-09-13T18:50:53.185355+0000","last_became_active":"2024-09-13T18:45:21.662405+0000","last_became_peered":"2024-09-13T18:45:21.662405+0000","last_unstale":"2024-09-13T18:50:53.185355+0000","last_undegraded":"2024-09-13T18:50:53.185355+0000","last_fullsized":"2024-09-13T18:50:53.185355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:53.185332+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:53.185332+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.185332+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:51.585557+0000","scrub_duration":0.0032345479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:23.651586+0000","last_change":"2024-09-13T18:51:23.651725+0000","last_active":"2024-09-13T18:51:23.651586+0000","last_peered":"2024-09-13T18:51:23.651586+0000","last_clean":"2024-09-13T18:51:23.651586+0000","last_became_active":"2024-09-13T18:45:26.054449+0000","last_became_peered":"2024-09-13T18:45:26.054449+0000","last_unstale":"2024-09-13T18:51:23.651586+0000","last_undegraded":"2024-09-13T18:51:23.651586+0000","last_fullsized":"2024-09-13T18:51:23.651586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:23.651560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:23.651560+0000","last_clean_scrub_stamp":"2024-09-13T18:51:23.651560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:17.307564+0000","scrub_duration":0.001733273,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'9","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:41.413184+0000","last_change":"2024-09-13T18:51:41.413291+0000","last_active":"2024-09-13T18:51:41.413184+0000","last_peered":"2024-09-13T18:51:41.413184+0000","last_clean":"2024-09-13T18:51:41.413184+0000","last_became_active":"2024-09-13T18:46:11.150605+0000","last_became_peered":"2024-09-13T18:46:11.150605+0000","last_unstale":"2024-09-13T18:51:41.413184+0000","last_undegraded":"2024-09-13T18:51:41.413184+0000","last_fullsized":"2024-09-13T18:51:41.413184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:51:41.413157+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:51:41.413157+0000","last_clean_scrub_stamp":"2024-09-13T18:51:41.413157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:37.669991+0000","scrub_duration":0.0020204899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:44.581874+0000","last_change":"2024-09-13T18:50:44.581951+0000","last_active":"2024-09-13T18:50:44.581874+0000","last_peered":"2024-09-13T18:50:44.581874+0000","last_clean":"2024-09-13T18:50:44.581874+0000","last_became_active":"2024-09-13T18:45:21.667340+0000","last_became_peered":"2024-09-13T18:45:21.667340+0000","last_unstale":"2024-09-13T18:50:44.581874+0000","last_undegraded":"2024-09-13T18:50:44.581874+0000","last_fullsized":"2024-09-13T18:50:44.581874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:44.581853+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:44.581853+0000","last_clean_scrub_stamp":"2024-09-13T18:50:44.581853+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:34.592117+0000","scrub_duration":0.002403325,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:34.443633+0000","last_change":"2024-09-13T18:51:34.443633+0000","last_active":"2024-09-13T18:51:34.443633+0000","last_peered":"2024-09-13T18:51:34.443633+0000","last_clean":"2024-09-13T18:51:34.443633+0000","last_became_active":"2024-09-13T18:45:26.250020+0000","last_became_peered":"2024-09-13T18:45:26.250020+0000","last_unstale":"2024-09-13T18:51:34.443633+0000","last_undegraded":"2024-09-13T18:51:34.443633+0000","last_fullsized":"2024-09-13T18:51:34.443633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:34.443460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:34.443460+0000","last_clean_scrub_stamp":"2024-09-13T18:51:34.443460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:14.820080+0000","scrub_duration":0.0018253639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:06.933020+0000","last_change":"2024-09-13T18:51:06.933112+0000","last_active":"2024-09-13T18:51:06.933020+0000","last_peered":"2024-09-13T18:51:06.933020+0000","last_clean":"2024-09-13T18:51:06.933020+0000","last_became_active":"2024-09-13T18:45:22.030275+0000","last_became_peered":"2024-09-13T18:45:22.030275+0000","last_unstale":"2024-09-13T18:51:06.933020+0000","last_undegraded":"2024-09-13T18:51:06.933020+0000","last_fullsized":"2024-09-13T18:51:06.933020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:06.932993+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:06.932993+0000","last_clean_scrub_stamp":"2024-09-13T18:51:06.932993+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:30.946801+0000","scrub_duration":0.001459723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:46.747039+0000","last_change":"2024-09-13T18:50:46.747141+0000","last_active":"2024-09-13T18:50:46.747039+0000","last_peered":"2024-09-13T18:50:46.747039+0000","last_clean":"2024-09-13T18:50:46.747039+0000","last_became_active":"2024-09-13T18:45:21.662210+0000","last_became_peered":"2024-09-13T18:45:21.662210+0000","last_unstale":"2024-09-13T18:50:46.747039+0000","last_undegraded":"2024-09-13T18:50:46.747039+0000","last_fullsized":"2024-09-13T18:50:46.747039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:46.747013+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:46.747013+0000","last_clean_scrub_stamp":"2024-09-13T18:50:46.747013+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:01.227032+0000","scrub_duration":0.0037197200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:36.962268+0000","last_change":"2024-09-13T18:51:36.962268+0000","last_active":"2024-09-13T18:51:36.962268+0000","last_peered":"2024-09-13T18:51:36.962268+0000","last_clean":"2024-09-13T18:51:36.962268+0000","last_became_active":"2024-09-13T18:45:26.053195+0000","last_became_peered":"2024-09-13T18:45:26.053195+0000","last_unstale":"2024-09-13T18:51:36.962268+0000","last_undegraded":"2024-09-13T18:51:36.962268+0000","last_fullsized":"2024-09-13T18:51:36.962268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:36.962063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:36.962063+0000","last_clean_scrub_stamp":"2024-09-13T18:51:36.962063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:33.218898+0000","scrub_duration":0.0019864520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:14.842758+0000","last_change":"2024-09-13T18:51:14.842898+0000","last_active":"2024-09-13T18:51:14.842758+0000","last_peered":"2024-09-13T18:51:14.842758+0000","last_clean":"2024-09-13T18:51:14.842758+0000","last_became_active":"2024-09-13T18:45:22.031312+0000","last_became_peered":"2024-09-13T18:45:22.031312+0000","last_unstale":"2024-09-13T18:51:14.842758+0000","last_undegraded":"2024-09-13T18:51:14.842758+0000","last_fullsized":"2024-09-13T18:51:14.842758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:14.842734+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:14.842734+0000","last_clean_scrub_stamp":"2024-09-13T18:51:14.842734+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:23.473137+0000","scrub_duration":0.0016508709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:45.608053+0000","last_change":"2024-09-13T18:50:45.608171+0000","last_active":"2024-09-13T18:50:45.608053+0000","last_peered":"2024-09-13T18:50:45.608053+0000","last_clean":"2024-09-13T18:50:45.608053+0000","last_became_active":"2024-09-13T18:45:21.654844+0000","last_became_peered":"2024-09-13T18:45:21.654844+0000","last_unstale":"2024-09-13T18:50:45.608053+0000","last_undegraded":"2024-09-13T18:50:45.608053+0000","last_fullsized":"2024-09-13T18:50:45.608053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2024-09-13T18:50:45.608031+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2024-09-13T18:50:45.608031+0000","last_clean_scrub_stamp":"2024-09-13T18:50:45.608031+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:30.420618+0000","scrub_duration":0.0035795750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:29.598362+0000","last_change":"2024-09-13T18:51:29.598532+0000","last_active":"2024-09-13T18:51:29.598362+0000","last_peered":"2024-09-13T18:51:29.598362+0000","last_clean":"2024-09-13T18:51:29.598362+0000","last_became_active":"2024-09-13T18:45:26.055955+0000","last_became_peered":"2024-09-13T18:45:26.055955+0000","last_unstale":"2024-09-13T18:51:29.598362+0000","last_undegraded":"2024-09-13T18:51:29.598362+0000","last_fullsized":"2024-09-13T18:51:29.598362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:29.598337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:29.598337+0000","last_clean_scrub_stamp":"2024-09-13T18:51:29.598337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:34.472096+0000","scrub_duration":0.0021141910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:03.236973+0000","last_change":"2024-09-13T18:51:03.237150+0000","last_active":"2024-09-13T18:51:03.236973+0000","last_peered":"2024-09-13T18:51:03.236973+0000","last_clean":"2024-09-13T18:51:03.236973+0000","last_became_active":"2024-09-13T18:45:22.027172+0000","last_became_peered":"2024-09-13T18:45:22.027172+0000","last_unstale":"2024-09-13T18:51:03.236973+0000","last_undegraded":"2024-09-13T18:51:03.236973+0000","last_fullsized":"2024-09-13T18:51:03.236973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:51:03.236933+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:51:03.236933+0000","last_clean_scrub_stamp":"2024-09-13T18:51:03.236933+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:49.063019+0000","scrub_duration":0.0022569790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.190482+0000","last_change":"2024-09-13T18:50:49.190582+0000","last_active":"2024-09-13T18:50:49.190482+0000","last_peered":"2024-09-13T18:50:49.190482+0000","last_clean":"2024-09-13T18:50:49.190482+0000","last_became_active":"2024-09-13T18:45:21.663746+0000","last_became_peered":"2024-09-13T18:45:21.663746+0000","last_unstale":"2024-09-13T18:50:49.190482+0000","last_undegraded":"2024-09-13T18:50:49.190482+0000","last_fullsized":"2024-09-13T18:50:49.190482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:50:49.190457+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:50:49.190457+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.190457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:34.003043+0000","scrub_duration":0.0013612330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:51.870891+0000","last_change":"2024-09-13T18:51:51.871081+0000","last_active":"2024-09-13T18:51:51.870891+0000","last_peered":"2024-09-13T18:51:51.870891+0000","last_clean":"2024-09-13T18:51:51.870891+0000","last_became_active":"2024-09-13T18:45:26.252841+0000","last_became_peered":"2024-09-13T18:45:26.252841+0000","last_unstale":"2024-09-13T18:51:51.870891+0000","last_undegraded":"2024-09-13T18:51:51.870891+0000","last_fullsized":"2024-09-13T18:51:51.870891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:51.870868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:51.870868+0000","last_clean_scrub_stamp":"2024-09-13T18:51:51.870868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:18.919936+0000","scrub_duration":0.001932918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'20","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:05.973224+0000","last_change":"2024-09-13T18:51:05.973322+0000","last_active":"2024-09-13T18:51:05.973224+0000","last_peered":"2024-09-13T18:51:05.973224+0000","last_clean":"2024-09-13T18:51:05.973224+0000","last_became_active":"2024-09-13T18:45:22.032862+0000","last_became_peered":"2024-09-13T18:45:22.032862+0000","last_unstale":"2024-09-13T18:51:05.973224+0000","last_undegraded":"2024-09-13T18:51:05.973224+0000","last_fullsized":"2024-09-13T18:51:05.973224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-09-13T18:51:05.973201+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-09-13T18:51:05.973201+0000","last_clean_scrub_stamp":"2024-09-13T18:51:05.973201+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:01.842061+0000","scrub_duration":0.001409771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:05.497671+0000","last_change":"2024-09-13T18:51:05.497769+0000","last_active":"2024-09-13T18:51:05.497671+0000","last_peered":"2024-09-13T18:51:05.497671+0000","last_clean":"2024-09-13T18:51:05.497671+0000","last_became_active":"2024-09-13T18:45:21.667457+0000","last_became_peered":"2024-09-13T18:45:21.667457+0000","last_unstale":"2024-09-13T18:51:05.497671+0000","last_undegraded":"2024-09-13T18:51:05.497671+0000","last_fullsized":"2024-09-13T18:51:05.497671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:05.497646+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:05.497646+0000","last_clean_scrub_stamp":"2024-09-13T18:51:05.497646+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:14.128049+0000","scrub_duration":0.001432996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:30.589549+0000","last_change":"2024-09-13T18:51:30.589685+0000","last_active":"2024-09-13T18:51:30.589549+0000","last_peered":"2024-09-13T18:51:30.589549+0000","last_clean":"2024-09-13T18:51:30.589549+0000","last_became_active":"2024-09-13T18:45:26.250041+0000","last_became_peered":"2024-09-13T18:45:26.250041+0000","last_unstale":"2024-09-13T18:51:30.589549+0000","last_undegraded":"2024-09-13T18:51:30.589549+0000","last_fullsized":"2024-09-13T18:51:30.589549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:30.589525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:30.589525+0000","last_clean_scrub_stamp":"2024-09-13T18:51:30.589525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:10.966145+0000","scrub_duration":0.0019254669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:54.569727+0000","last_change":"2024-09-13T18:50:54.569854+0000","last_active":"2024-09-13T18:50:54.569727+0000","last_peered":"2024-09-13T18:50:54.569727+0000","last_clean":"2024-09-13T18:50:54.569727+0000","last_became_active":"2024-09-13T18:45:22.023882+0000","last_became_peered":"2024-09-13T18:45:22.023882+0000","last_unstale":"2024-09-13T18:50:54.569727+0000","last_undegraded":"2024-09-13T18:50:54.569727+0000","last_fullsized":"2024-09-13T18:50:54.569727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:54.569702+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:54.569702+0000","last_clean_scrub_stamp":"2024-09-13T18:50:54.569702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:45.447629+0000","scrub_duration":0.0017254239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.525039+0000","last_change":"2024-09-13T18:50:47.525152+0000","last_active":"2024-09-13T18:50:47.525039+0000","last_peered":"2024-09-13T18:50:47.525039+0000","last_clean":"2024-09-13T18:50:47.525039+0000","last_became_active":"2024-09-13T18:45:21.662980+0000","last_became_peered":"2024-09-13T18:45:21.662980+0000","last_unstale":"2024-09-13T18:50:47.525039+0000","last_undegraded":"2024-09-13T18:50:47.525039+0000","last_fullsized":"2024-09-13T18:50:47.525039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:47.525016+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:47.525016+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.525016+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:46.204054+0000","scrub_duration":0.0038760959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:36.432772+0000","last_change":"2024-09-13T18:51:36.432948+0000","last_active":"2024-09-13T18:51:36.432772+0000","last_peered":"2024-09-13T18:51:36.432772+0000","last_clean":"2024-09-13T18:51:36.432772+0000","last_became_active":"2024-09-13T18:45:26.252786+0000","last_became_peered":"2024-09-13T18:45:26.252786+0000","last_unstale":"2024-09-13T18:51:36.432772+0000","last_undegraded":"2024-09-13T18:51:36.432772+0000","last_fullsized":"2024-09-13T18:51:36.432772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:36.432737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:36.432737+0000","last_clean_scrub_stamp":"2024-09-13T18:51:36.432737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:32.689571+0000","scrub_duration":0.001880151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:23.943522+0000","last_change":"2024-09-13T18:51:23.943638+0000","last_active":"2024-09-13T18:51:23.943522+0000","last_peered":"2024-09-13T18:51:23.943522+0000","last_clean":"2024-09-13T18:51:23.943522+0000","last_became_active":"2024-09-13T18:45:22.034765+0000","last_became_peered":"2024-09-13T18:45:22.034765+0000","last_unstale":"2024-09-13T18:51:23.943522+0000","last_undegraded":"2024-09-13T18:51:23.943522+0000","last_fullsized":"2024-09-13T18:51:23.943522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:23.943497+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:23.943497+0000","last_clean_scrub_stamp":"2024-09-13T18:51:23.943497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:26.234050+0000","scrub_duration":0.0021370650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'104","reported_seq":135,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:47.203053+0000","last_change":"2024-09-13T18:50:47.203181+0000","last_active":"2024-09-13T18:50:47.203053+0000","last_peered":"2024-09-13T18:50:47.203053+0000","last_clean":"2024-09-13T18:50:47.203053+0000","last_became_active":"2024-09-13T18:45:21.667587+0000","last_became_peered":"2024-09-13T18:45:21.667587+0000","last_unstale":"2024-09-13T18:50:47.203053+0000","last_undegraded":"2024-09-13T18:50:47.203053+0000","last_fullsized":"2024-09-13T18:50:47.203053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'104","last_scrub_stamp":"2024-09-13T18:50:47.203030+0000","last_deep_scrub":"26'104","last_deep_scrub_stamp":"2024-09-13T18:50:47.203030+0000","last_clean_scrub_stamp":"2024-09-13T18:50:47.203030+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:42.560439+0000","scrub_duration":0.020188185000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":942437,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:35.433796+0000","last_change":"2024-09-13T18:51:35.433927+0000","last_active":"2024-09-13T18:51:35.433796+0000","last_peered":"2024-09-13T18:51:35.433796+0000","last_clean":"2024-09-13T18:51:35.433796+0000","last_became_active":"2024-09-13T18:45:26.052614+0000","last_became_peered":"2024-09-13T18:45:26.052614+0000","last_unstale":"2024-09-13T18:51:35.433796+0000","last_undegraded":"2024-09-13T18:51:35.433796+0000","last_fullsized":"2024-09-13T18:51:35.433796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:35.433770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:35.433770+0000","last_clean_scrub_stamp":"2024-09-13T18:51:35.433770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:47.188051+0000","scrub_duration":0.0019198749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'12","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:55.746737+0000","last_change":"2024-09-13T18:50:55.746842+0000","last_active":"2024-09-13T18:50:55.746737+0000","last_peered":"2024-09-13T18:50:55.746737+0000","last_clean":"2024-09-13T18:50:55.746737+0000","last_became_active":"2024-09-13T18:45:22.020461+0000","last_became_peered":"2024-09-13T18:45:22.020461+0000","last_unstale":"2024-09-13T18:50:55.746737+0000","last_undegraded":"2024-09-13T18:50:55.746737+0000","last_fullsized":"2024-09-13T18:50:55.746737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-09-13T18:50:55.746712+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-09-13T18:50:55.746712+0000","last_clean_scrub_stamp":"2024-09-13T18:50:55.746712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:46.624639+0000","scrub_duration":0.001397379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'30","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:59.319018+0000","last_change":"2024-09-13T18:50:59.319133+0000","last_active":"2024-09-13T18:50:59.319018+0000","last_peered":"2024-09-13T18:50:59.319018+0000","last_clean":"2024-09-13T18:50:59.319018+0000","last_became_active":"2024-09-13T18:45:21.663941+0000","last_became_peered":"2024-09-13T18:45:21.663941+0000","last_unstale":"2024-09-13T18:50:59.319018+0000","last_undegraded":"2024-09-13T18:50:59.319018+0000","last_fullsized":"2024-09-13T18:50:59.319018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'30","last_scrub_stamp":"2024-09-13T18:50:59.318992+0000","last_deep_scrub":"26'30","last_deep_scrub_stamp":"2024-09-13T18:50:59.318992+0000","last_clean_scrub_stamp":"2024-09-13T18:50:59.318992+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:23.332800+0000","scrub_duration":0.0038590220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:24.977060+0000","last_change":"2024-09-13T18:51:24.977208+0000","last_active":"2024-09-13T18:51:24.977060+0000","last_peered":"2024-09-13T18:51:24.977060+0000","last_clean":"2024-09-13T18:51:24.977060+0000","last_became_active":"2024-09-13T18:45:26.050757+0000","last_became_peered":"2024-09-13T18:45:26.050757+0000","last_unstale":"2024-09-13T18:51:24.977060+0000","last_undegraded":"2024-09-13T18:51:24.977060+0000","last_fullsized":"2024-09-13T18:51:24.977060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:24.977038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:24.977038+0000","last_clean_scrub_stamp":"2024-09-13T18:51:24.977038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:57.905342+0000","scrub_duration":0.0018483219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:57.568366+0000","last_change":"2024-09-13T18:50:57.568488+0000","last_active":"2024-09-13T18:50:57.568366+0000","last_peered":"2024-09-13T18:50:57.568366+0000","last_clean":"2024-09-13T18:50:57.568366+0000","last_became_active":"2024-09-13T18:45:22.024972+0000","last_became_peered":"2024-09-13T18:45:22.024972+0000","last_unstale":"2024-09-13T18:50:57.568366+0000","last_undegraded":"2024-09-13T18:50:57.568366+0000","last_fullsized":"2024-09-13T18:50:57.568366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:50:57.568343+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:50:57.568343+0000","last_clean_scrub_stamp":"2024-09-13T18:50:57.568343+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:11.127567+0000","scrub_duration":0.0016603970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'7","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:57.516274+0000","last_change":"2024-09-13T18:50:57.516394+0000","last_active":"2024-09-13T18:50:57.516274+0000","last_peered":"2024-09-13T18:50:57.516274+0000","last_clean":"2024-09-13T18:50:57.516274+0000","last_became_active":"2024-09-13T18:45:21.666516+0000","last_became_peered":"2024-09-13T18:45:21.666516+0000","last_unstale":"2024-09-13T18:50:57.516274+0000","last_undegraded":"2024-09-13T18:50:57.516274+0000","last_fullsized":"2024-09-13T18:50:57.516274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:57.516252+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:57.516252+0000","last_clean_scrub_stamp":"2024-09-13T18:50:57.516252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:48.394179+0000","scrub_duration":0.001474358,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:32.654365+0000","last_change":"2024-09-13T18:51:32.654493+0000","last_active":"2024-09-13T18:51:32.654365+0000","last_peered":"2024-09-13T18:51:32.654365+0000","last_clean":"2024-09-13T18:51:32.654365+0000","last_became_active":"2024-09-13T18:45:26.057285+0000","last_became_peered":"2024-09-13T18:45:26.057285+0000","last_unstale":"2024-09-13T18:51:32.654365+0000","last_undegraded":"2024-09-13T18:51:32.654365+0000","last_fullsized":"2024-09-13T18:51:32.654365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:32.654342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:32.654342+0000","last_clean_scrub_stamp":"2024-09-13T18:51:32.654342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:28.911177+0000","scrub_duration":0.0021565410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:50.580387+0000","last_change":"2024-09-13T18:50:50.580490+0000","last_active":"2024-09-13T18:50:50.580387+0000","last_peered":"2024-09-13T18:50:50.580387+0000","last_clean":"2024-09-13T18:50:50.580387+0000","last_became_active":"2024-09-13T18:45:22.031341+0000","last_became_peered":"2024-09-13T18:45:22.031341+0000","last_unstale":"2024-09-13T18:50:50.580387+0000","last_undegraded":"2024-09-13T18:50:50.580387+0000","last_fullsized":"2024-09-13T18:50:50.580387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:50.580363+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:50.580363+0000","last_clean_scrub_stamp":"2024-09-13T18:50:50.580363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:36.406449+0000","scrub_duration":0.0013669019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:52.209692+0000","last_change":"2024-09-13T18:50:52.209792+0000","last_active":"2024-09-13T18:50:52.209692+0000","last_peered":"2024-09-13T18:50:52.209692+0000","last_clean":"2024-09-13T18:50:52.209692+0000","last_became_active":"2024-09-13T18:45:21.664401+0000","last_became_peered":"2024-09-13T18:45:21.664401+0000","last_unstale":"2024-09-13T18:50:52.209692+0000","last_undegraded":"2024-09-13T18:50:52.209692+0000","last_fullsized":"2024-09-13T18:50:52.209692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:52.209668+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:52.209668+0000","last_clean_scrub_stamp":"2024-09-13T18:50:52.209668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:51.968472+0000","scrub_duration":0.001304253,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:45.870093+0000","last_change":"2024-09-13T18:51:45.870235+0000","last_active":"2024-09-13T18:51:45.870093+0000","last_peered":"2024-09-13T18:51:45.870093+0000","last_clean":"2024-09-13T18:51:45.870093+0000","last_became_active":"2024-09-13T18:45:26.253579+0000","last_became_peered":"2024-09-13T18:45:26.253579+0000","last_unstale":"2024-09-13T18:51:45.870093+0000","last_undegraded":"2024-09-13T18:51:45.870093+0000","last_fullsized":"2024-09-13T18:51:45.870093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:45.870069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:45.870069+0000","last_clean_scrub_stamp":"2024-09-13T18:51:45.870069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:22.934783+0000","scrub_duration":0.002030362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:31.601658+0000","last_change":"2024-09-13T18:51:31.601779+0000","last_active":"2024-09-13T18:51:31.601658+0000","last_peered":"2024-09-13T18:51:31.601658+0000","last_clean":"2024-09-13T18:51:31.601658+0000","last_became_active":"2024-09-13T18:45:26.252979+0000","last_became_peered":"2024-09-13T18:45:26.252979+0000","last_unstale":"2024-09-13T18:51:31.601658+0000","last_undegraded":"2024-09-13T18:51:31.601658+0000","last_fullsized":"2024-09-13T18:51:31.601658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:31.601634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:31.601634+0000","last_clean_scrub_stamp":"2024-09-13T18:51:31.601634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:11.978254+0000","scrub_duration":0.001725173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'11","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:44.232716+0000","last_change":"2024-09-13T18:50:44.232835+0000","last_active":"2024-09-13T18:50:44.232716+0000","last_peered":"2024-09-13T18:50:44.232716+0000","last_clean":"2024-09-13T18:50:44.232716+0000","last_became_active":"2024-09-13T18:45:22.030453+0000","last_became_peered":"2024-09-13T18:45:22.030453+0000","last_unstale":"2024-09-13T18:50:44.232716+0000","last_undegraded":"2024-09-13T18:50:44.232716+0000","last_fullsized":"2024-09-13T18:50:44.232716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:50:44.232671+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:50:44.232671+0000","last_clean_scrub_stamp":"2024-09-13T18:50:44.232671+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:43.991475+0000","scrub_duration":0.0014480770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:00.539547+0000","last_change":"2024-09-13T18:51:00.539669+0000","last_active":"2024-09-13T18:51:00.539547+0000","last_peered":"2024-09-13T18:51:00.539547+0000","last_clean":"2024-09-13T18:51:00.539547+0000","last_became_active":"2024-09-13T18:45:21.664571+0000","last_became_peered":"2024-09-13T18:45:21.664571+0000","last_unstale":"2024-09-13T18:51:00.539547+0000","last_undegraded":"2024-09-13T18:51:00.539547+0000","last_fullsized":"2024-09-13T18:51:00.539547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:00.539521+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:00.539521+0000","last_clean_scrub_stamp":"2024-09-13T18:51:00.539521+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:14.098745+0000","scrub_duration":0.001600532,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:18.256601+0000","last_change":"2024-09-13T18:51:18.256601+0000","last_active":"2024-09-13T18:51:18.256601+0000","last_peered":"2024-09-13T18:51:18.256601+0000","last_clean":"2024-09-13T18:51:18.256601+0000","last_became_active":"2024-09-13T18:45:26.054510+0000","last_became_peered":"2024-09-13T18:45:26.054510+0000","last_unstale":"2024-09-13T18:51:18.256601+0000","last_undegraded":"2024-09-13T18:51:18.256601+0000","last_fullsized":"2024-09-13T18:51:18.256601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:18.256436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:18.256436+0000","last_clean_scrub_stamp":"2024-09-13T18:51:18.256436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:26.886838+0000","scrub_duration":0.0019428430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:46.866498+0000","last_change":"2024-09-13T18:50:46.866594+0000","last_active":"2024-09-13T18:50:46.866498+0000","last_peered":"2024-09-13T18:50:46.866498+0000","last_clean":"2024-09-13T18:50:46.866498+0000","last_became_active":"2024-09-13T18:45:22.028062+0000","last_became_peered":"2024-09-13T18:45:22.028062+0000","last_unstale":"2024-09-13T18:50:46.866498+0000","last_undegraded":"2024-09-13T18:50:46.866498+0000","last_fullsized":"2024-09-13T18:50:46.866498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:46.866474+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:46.866474+0000","last_clean_scrub_stamp":"2024-09-13T18:50:46.866474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:08.205344+0000","scrub_duration":0.0015895569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:52.891038+0000","last_change":"2024-09-13T18:50:52.891140+0000","last_active":"2024-09-13T18:50:52.891038+0000","last_peered":"2024-09-13T18:50:52.891038+0000","last_clean":"2024-09-13T18:50:52.891038+0000","last_became_active":"2024-09-13T18:45:21.672470+0000","last_became_peered":"2024-09-13T18:45:21.672470+0000","last_unstale":"2024-09-13T18:50:52.891038+0000","last_undegraded":"2024-09-13T18:50:52.891038+0000","last_fullsized":"2024-09-13T18:50:52.891038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-13T18:50:52.891015+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-13T18:50:52.891015+0000","last_clean_scrub_stamp":"2024-09-13T18:50:52.891015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:43.768942+0000","scrub_duration":0.001947734,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:51.207387+0000","last_change":"2024-09-13T18:50:51.207489+0000","last_active":"2024-09-13T18:50:51.207387+0000","last_peered":"2024-09-13T18:50:51.207387+0000","last_clean":"2024-09-13T18:50:51.207387+0000","last_became_active":"2024-09-13T18:45:21.659912+0000","last_became_peered":"2024-09-13T18:45:21.659912+0000","last_unstale":"2024-09-13T18:50:51.207387+0000","last_undegraded":"2024-09-13T18:50:51.207387+0000","last_fullsized":"2024-09-13T18:50:51.207387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:50:51.207360+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:50:51.207360+0000","last_clean_scrub_stamp":"2024-09-13T18:50:51.207360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:13.344926+0000","scrub_duration":0.0013910459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:02.505731+0000","last_change":"2024-09-13T18:51:02.505849+0000","last_active":"2024-09-13T18:51:02.505731+0000","last_peered":"2024-09-13T18:51:02.505731+0000","last_clean":"2024-09-13T18:51:02.505731+0000","last_became_active":"2024-09-13T18:45:22.024305+0000","last_became_peered":"2024-09-13T18:45:22.024305+0000","last_unstale":"2024-09-13T18:51:02.505731+0000","last_undegraded":"2024-09-13T18:51:02.505731+0000","last_fullsized":"2024-09-13T18:51:02.505731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:02.505710+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:02.505710+0000","last_clean_scrub_stamp":"2024-09-13T18:51:02.505710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:11.136113+0000","scrub_duration":0.0020117059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.634442+0000","last_change":"2024-09-13T18:50:53.634577+0000","last_active":"2024-09-13T18:50:53.634442+0000","last_peered":"2024-09-13T18:50:53.634442+0000","last_clean":"2024-09-13T18:50:53.634442+0000","last_became_active":"2024-09-13T18:45:26.055794+0000","last_became_peered":"2024-09-13T18:45:26.055794+0000","last_unstale":"2024-09-13T18:50:53.634442+0000","last_undegraded":"2024-09-13T18:50:53.634442+0000","last_fullsized":"2024-09-13T18:50:53.634442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:53.634420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:53.634420+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.634420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:29.073415+0000","scrub_duration":0.0018457149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:00.849167+0000","last_change":"2024-09-13T18:51:00.849278+0000","last_active":"2024-09-13T18:51:00.849167+0000","last_peered":"2024-09-13T18:51:00.849167+0000","last_clean":"2024-09-13T18:51:00.849167+0000","last_became_active":"2024-09-13T18:45:21.670083+0000","last_became_peered":"2024-09-13T18:45:21.670083+0000","last_unstale":"2024-09-13T18:51:00.849167+0000","last_undegraded":"2024-09-13T18:51:00.849167+0000","last_fullsized":"2024-09-13T18:51:00.849167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-09-13T18:51:00.849140+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-09-13T18:51:00.849140+0000","last_clean_scrub_stamp":"2024-09-13T18:51:00.849140+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:09.479543+0000","scrub_duration":0.0018400650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:53.752295+0000","last_change":"2024-09-13T18:50:53.752405+0000","last_active":"2024-09-13T18:50:53.752295+0000","last_peered":"2024-09-13T18:50:53.752295+0000","last_clean":"2024-09-13T18:50:53.752295+0000","last_became_active":"2024-09-13T18:45:22.021496+0000","last_became_peered":"2024-09-13T18:45:22.021496+0000","last_unstale":"2024-09-13T18:50:53.752295+0000","last_undegraded":"2024-09-13T18:50:53.752295+0000","last_fullsized":"2024-09-13T18:50:53.752295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:53.752270+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:53.752270+0000","last_clean_scrub_stamp":"2024-09-13T18:50:53.752270+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:49.621131+0000","scrub_duration":0.0017525349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:29.602329+0000","last_change":"2024-09-13T18:51:29.602438+0000","last_active":"2024-09-13T18:51:29.602329+0000","last_peered":"2024-09-13T18:51:29.602329+0000","last_clean":"2024-09-13T18:51:29.602329+0000","last_became_active":"2024-09-13T18:45:26.050095+0000","last_became_peered":"2024-09-13T18:45:26.050095+0000","last_unstale":"2024-09-13T18:51:29.602329+0000","last_undegraded":"2024-09-13T18:51:29.602329+0000","last_fullsized":"2024-09-13T18:51:29.602329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:29.602308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:29.602308+0000","last_clean_scrub_stamp":"2024-09-13T18:51:29.602308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:34.476068+0000","scrub_duration":0.0016547560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:13.281140+0000","last_change":"2024-09-13T18:51:13.281140+0000","last_active":"2024-09-13T18:51:13.281140+0000","last_peered":"2024-09-13T18:51:13.281140+0000","last_clean":"2024-09-13T18:51:13.281140+0000","last_became_active":"2024-09-13T18:45:22.027528+0000","last_became_peered":"2024-09-13T18:45:22.027528+0000","last_unstale":"2024-09-13T18:51:13.281140+0000","last_undegraded":"2024-09-13T18:51:13.281140+0000","last_fullsized":"2024-09-13T18:51:13.281140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:13.281016+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:13.281016+0000","last_clean_scrub_stamp":"2024-09-13T18:51:13.281016+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:26.840240+0000","scrub_duration":0.001715488,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:48.607907+0000","last_change":"2024-09-13T18:50:48.607907+0000","last_active":"2024-09-13T18:50:48.607907+0000","last_peered":"2024-09-13T18:50:48.607907+0000","last_clean":"2024-09-13T18:50:48.607907+0000","last_became_active":"2024-09-13T18:45:22.024369+0000","last_became_peered":"2024-09-13T18:45:22.024369+0000","last_unstale":"2024-09-13T18:50:48.607907+0000","last_undegraded":"2024-09-13T18:50:48.607907+0000","last_fullsized":"2024-09-13T18:50:48.607907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:50:48.607766+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:50:48.607766+0000","last_clean_scrub_stamp":"2024-09-13T18:50:48.607766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:48.366570+0000","scrub_duration":0.0018146099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:16.527317+0000","last_change":"2024-09-13T18:51:16.527317+0000","last_active":"2024-09-13T18:51:16.527317+0000","last_peered":"2024-09-13T18:51:16.527317+0000","last_clean":"2024-09-13T18:51:16.527317+0000","last_became_active":"2024-09-13T18:45:22.034318+0000","last_became_peered":"2024-09-13T18:45:22.034318+0000","last_unstale":"2024-09-13T18:51:16.527317+0000","last_undegraded":"2024-09-13T18:51:16.527317+0000","last_fullsized":"2024-09-13T18:51:16.527317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:16.527167+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:16.527167+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.527167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:39.701195+0000","scrub_duration":0.001722756,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:44.490637+0000","last_change":"2024-09-13T18:50:44.490637+0000","last_active":"2024-09-13T18:50:44.490637+0000","last_peered":"2024-09-13T18:50:44.490637+0000","last_clean":"2024-09-13T18:50:44.490637+0000","last_became_active":"2024-09-13T18:45:22.032851+0000","last_became_peered":"2024-09-13T18:45:22.032851+0000","last_unstale":"2024-09-13T18:50:44.490637+0000","last_undegraded":"2024-09-13T18:50:44.490637+0000","last_fullsized":"2024-09-13T18:50:44.490637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:50:44.490540+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:50:44.490540+0000","last_clean_scrub_stamp":"2024-09-13T18:50:44.490540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:19.929534+0000","scrub_duration":0.0012625819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:13.781438+0000","last_change":"2024-09-13T18:51:13.781438+0000","last_active":"2024-09-13T18:51:13.781438+0000","last_peered":"2024-09-13T18:51:13.781438+0000","last_clean":"2024-09-13T18:51:13.781438+0000","last_became_active":"2024-09-13T18:45:22.033156+0000","last_became_peered":"2024-09-13T18:45:22.033156+0000","last_unstale":"2024-09-13T18:51:13.781438+0000","last_undegraded":"2024-09-13T18:51:13.781438+0000","last_fullsized":"2024-09-13T18:51:13.781438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:13.781297+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:13.781297+0000","last_clean_scrub_stamp":"2024-09-13T18:51:13.781297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:36.955325+0000","scrub_duration":0.001953104,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:08.342520+0000","last_change":"2024-09-13T18:51:08.342520+0000","last_active":"2024-09-13T18:51:08.342520+0000","last_peered":"2024-09-13T18:51:08.342520+0000","last_clean":"2024-09-13T18:51:08.342520+0000","last_became_active":"2024-09-13T18:45:22.029654+0000","last_became_peered":"2024-09-13T18:45:22.029654+0000","last_unstale":"2024-09-13T18:51:08.342520+0000","last_undegraded":"2024-09-13T18:51:08.342520+0000","last_fullsized":"2024-09-13T18:51:08.342520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:08.342338+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:08.342338+0000","last_clean_scrub_stamp":"2024-09-13T18:51:08.342338+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:26.590827+0000","scrub_duration":0.0017863480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'13","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:01.289810+0000","last_change":"2024-09-13T18:51:01.289810+0000","last_active":"2024-09-13T18:51:01.289810+0000","last_peered":"2024-09-13T18:51:01.289810+0000","last_clean":"2024-09-13T18:51:01.289810+0000","last_became_active":"2024-09-13T18:45:22.028031+0000","last_became_peered":"2024-09-13T18:45:22.028031+0000","last_unstale":"2024-09-13T18:51:01.289810+0000","last_undegraded":"2024-09-13T18:51:01.289810+0000","last_fullsized":"2024-09-13T18:51:01.289810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-09-13T18:51:01.289682+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-09-13T18:51:01.289682+0000","last_clean_scrub_stamp":"2024-09-13T18:51:01.289682+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:15.769701+0000","scrub_duration":0.0012523860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:10.763987+0000","last_change":"2024-09-13T18:51:10.763987+0000","last_active":"2024-09-13T18:51:10.763987+0000","last_peered":"2024-09-13T18:51:10.763987+0000","last_clean":"2024-09-13T18:51:10.763987+0000","last_became_active":"2024-09-13T18:45:22.032561+0000","last_became_peered":"2024-09-13T18:45:22.032561+0000","last_unstale":"2024-09-13T18:51:10.763987+0000","last_undegraded":"2024-09-13T18:51:10.763987+0000","last_fullsized":"2024-09-13T18:51:10.763987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:51:10.763829+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:51:10.763829+0000","last_clean_scrub_stamp":"2024-09-13T18:51:10.763829+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:55.660046+0000","scrub_duration":0.0021163110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'9","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:06.469397+0000","last_change":"2024-09-13T18:51:06.469397+0000","last_active":"2024-09-13T18:51:06.469397+0000","last_peered":"2024-09-13T18:51:06.469397+0000","last_clean":"2024-09-13T18:51:06.469397+0000","last_became_active":"2024-09-13T18:45:22.036380+0000","last_became_peered":"2024-09-13T18:45:22.036380+0000","last_unstale":"2024-09-13T18:51:06.469397+0000","last_undegraded":"2024-09-13T18:51:06.469397+0000","last_fullsized":"2024-09-13T18:51:06.469397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:51:06.469283+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:51:06.469283+0000","last_clean_scrub_stamp":"2024-09-13T18:51:06.469283+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:33.084669+0000","scrub_duration":0.0018037019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:43.876477+0000","last_change":"2024-09-13T18:50:43.876558+0000","last_active":"2024-09-13T18:50:43.876477+0000","last_peered":"2024-09-13T18:50:43.876477+0000","last_clean":"2024-09-13T18:50:43.876477+0000","last_became_active":"2024-09-13T18:45:22.034646+0000","last_became_peered":"2024-09-13T18:45:22.034646+0000","last_unstale":"2024-09-13T18:50:43.876477+0000","last_undegraded":"2024-09-13T18:50:43.876477+0000","last_fullsized":"2024-09-13T18:50:43.876477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:50:43.876456+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:50:43.876456+0000","last_clean_scrub_stamp":"2024-09-13T18:50:43.876456+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.356475+0000","scrub_duration":0.0016307299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'13","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:26.517651+0000","last_change":"2024-09-13T18:51:26.517762+0000","last_active":"2024-09-13T18:51:26.517651+0000","last_peered":"2024-09-13T18:51:26.517651+0000","last_clean":"2024-09-13T18:51:26.517651+0000","last_became_active":"2024-09-13T18:45:22.028430+0000","last_became_peered":"2024-09-13T18:45:22.028430+0000","last_unstale":"2024-09-13T18:51:26.517651+0000","last_undegraded":"2024-09-13T18:51:26.517651+0000","last_fullsized":"2024-09-13T18:51:26.517651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-09-13T18:51:26.517628+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-09-13T18:51:26.517628+0000","last_clean_scrub_stamp":"2024-09-13T18:51:26.517628+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:20.173632+0000","scrub_duration":0.0014095889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'11","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:09.582511+0000","last_change":"2024-09-13T18:51:09.582639+0000","last_active":"2024-09-13T18:51:09.582511+0000","last_peered":"2024-09-13T18:51:09.582511+0000","last_clean":"2024-09-13T18:51:09.582511+0000","last_became_active":"2024-09-13T18:45:22.019733+0000","last_became_peered":"2024-09-13T18:45:22.019733+0000","last_unstale":"2024-09-13T18:51:09.582511+0000","last_undegraded":"2024-09-13T18:51:09.582511+0000","last_fullsized":"2024-09-13T18:51:09.582511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:51:09.582487+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:51:09.582487+0000","last_clean_scrub_stamp":"2024-09-13T18:51:09.582487+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:47.859252+0000","scrub_duration":0.0019273700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:08.225956+0000","last_change":"2024-09-13T18:51:08.226058+0000","last_active":"2024-09-13T18:51:08.225956+0000","last_peered":"2024-09-13T18:51:08.225956+0000","last_clean":"2024-09-13T18:51:08.225956+0000","last_became_active":"2024-09-13T18:45:22.015868+0000","last_became_peered":"2024-09-13T18:45:22.015868+0000","last_unstale":"2024-09-13T18:51:08.225956+0000","last_undegraded":"2024-09-13T18:51:08.225956+0000","last_fullsized":"2024-09-13T18:51:08.225956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:08.225930+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:08.225930+0000","last_clean_scrub_stamp":"2024-09-13T18:51:08.225930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:04.094791+0000","scrub_duration":0.0015192599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:46.911973+0000","last_change":"2024-09-13T18:50:46.912064+0000","last_active":"2024-09-13T18:50:46.911973+0000","last_peered":"2024-09-13T18:50:46.911973+0000","last_clean":"2024-09-13T18:50:46.911973+0000","last_became_active":"2024-09-13T18:45:22.034019+0000","last_became_peered":"2024-09-13T18:45:22.034019+0000","last_unstale":"2024-09-13T18:50:46.911973+0000","last_undegraded":"2024-09-13T18:50:46.911973+0000","last_fullsized":"2024-09-13T18:50:46.911973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-09-13T18:50:46.911953+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-09-13T18:50:46.911953+0000","last_clean_scrub_stamp":"2024-09-13T18:50:46.911953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:36.922217+0000","scrub_duration":0.0017146489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'12","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:49.657819+0000","last_change":"2024-09-13T18:50:49.657990+0000","last_active":"2024-09-13T18:50:49.657819+0000","last_peered":"2024-09-13T18:50:49.657819+0000","last_clean":"2024-09-13T18:50:49.657819+0000","last_became_active":"2024-09-13T18:45:22.020415+0000","last_became_peered":"2024-09-13T18:45:22.020415+0000","last_unstale":"2024-09-13T18:50:49.657819+0000","last_undegraded":"2024-09-13T18:50:49.657819+0000","last_fullsized":"2024-09-13T18:50:49.657819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-09-13T18:50:49.657795+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-09-13T18:50:49.657795+0000","last_clean_scrub_stamp":"2024-09-13T18:50:49.657795+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:11.513081+0000","scrub_duration":0.0020089489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:12.465521+0000","last_change":"2024-09-13T18:51:12.465623+0000","last_active":"2024-09-13T18:51:12.465521+0000","last_peered":"2024-09-13T18:51:12.465521+0000","last_clean":"2024-09-13T18:51:12.465521+0000","last_became_active":"2024-09-13T18:45:22.035491+0000","last_became_peered":"2024-09-13T18:45:22.035491+0000","last_unstale":"2024-09-13T18:51:12.465521+0000","last_undegraded":"2024-09-13T18:51:12.465521+0000","last_fullsized":"2024-09-13T18:51:12.465521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:12.465495+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:12.465495+0000","last_clean_scrub_stamp":"2024-09-13T18:51:12.465495+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:50.742260+0000","scrub_duration":0.0014084880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'11","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:57.604594+0000","last_change":"2024-09-13T18:50:57.604705+0000","last_active":"2024-09-13T18:50:57.604594+0000","last_peered":"2024-09-13T18:50:57.604594+0000","last_clean":"2024-09-13T18:50:57.604594+0000","last_became_active":"2024-09-13T18:46:11.146859+0000","last_became_peered":"2024-09-13T18:46:11.146859+0000","last_unstale":"2024-09-13T18:50:57.604594+0000","last_undegraded":"2024-09-13T18:50:57.604594+0000","last_fullsized":"2024-09-13T18:50:57.604594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-09-13T18:50:57.604573+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-09-13T18:50:57.604573+0000","last_clean_scrub_stamp":"2024-09-13T18:50:57.604573+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:18.943443+0000","scrub_duration":0.001354744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.403472+0000","last_change":"2024-09-13T18:51:17.403572+0000","last_active":"2024-09-13T18:51:17.403472+0000","last_peered":"2024-09-13T18:51:17.403472+0000","last_clean":"2024-09-13T18:51:17.403472+0000","last_became_active":"2024-09-13T18:45:22.021042+0000","last_became_peered":"2024-09-13T18:45:22.021042+0000","last_unstale":"2024-09-13T18:51:17.403472+0000","last_undegraded":"2024-09-13T18:51:17.403472+0000","last_fullsized":"2024-09-13T18:51:17.403472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:17.403444+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:17.403444+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.403444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:19.693997+0000","scrub_duration":0.0017615700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:10.562357+0000","last_change":"2024-09-13T18:51:10.562498+0000","last_active":"2024-09-13T18:51:10.562357+0000","last_peered":"2024-09-13T18:51:10.562357+0000","last_clean":"2024-09-13T18:51:10.562357+0000","last_became_active":"2024-09-13T18:45:22.021366+0000","last_became_peered":"2024-09-13T18:45:22.021366+0000","last_unstale":"2024-09-13T18:51:10.562357+0000","last_undegraded":"2024-09-13T18:51:10.562357+0000","last_fullsized":"2024-09-13T18:51:10.562357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:10.562334+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:10.562334+0000","last_clean_scrub_stamp":"2024-09-13T18:51:10.562334+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:55.458551+0000","scrub_duration":0.001601419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'10","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:50.854309+0000","last_change":"2024-09-13T18:50:50.854426+0000","last_active":"2024-09-13T18:50:50.854309+0000","last_peered":"2024-09-13T18:50:50.854309+0000","last_clean":"2024-09-13T18:50:50.854309+0000","last_became_active":"2024-09-13T18:45:22.028594+0000","last_became_peered":"2024-09-13T18:45:22.028594+0000","last_unstale":"2024-09-13T18:50:50.854309+0000","last_undegraded":"2024-09-13T18:50:50.854309+0000","last_fullsized":"2024-09-13T18:50:50.854309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-09-13T18:50:50.854284+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-09-13T18:50:50.854284+0000","last_clean_scrub_stamp":"2024-09-13T18:50:50.854284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:46.723145+0000","scrub_duration":0.0018955790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:50:58.758344+0000","last_change":"2024-09-13T18:50:58.758450+0000","last_active":"2024-09-13T18:50:58.758344+0000","last_peered":"2024-09-13T18:50:58.758344+0000","last_clean":"2024-09-13T18:50:58.758344+0000","last_became_active":"2024-09-13T18:45:22.016731+0000","last_became_peered":"2024-09-13T18:45:22.016731+0000","last_unstale":"2024-09-13T18:50:58.758344+0000","last_undegraded":"2024-09-13T18:50:58.758344+0000","last_fullsized":"2024-09-13T18:50:58.758344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:50:58.758323+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:50:58.758323+0000","last_clean_scrub_stamp":"2024-09-13T18:50:58.758323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:12.317546+0000","scrub_duration":0.0014195729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:04.219420+0000","last_change":"2024-09-13T18:51:04.219534+0000","last_active":"2024-09-13T18:51:04.219420+0000","last_peered":"2024-09-13T18:51:04.219420+0000","last_clean":"2024-09-13T18:51:04.219420+0000","last_became_active":"2024-09-13T18:45:22.027899+0000","last_became_peered":"2024-09-13T18:45:22.027899+0000","last_unstale":"2024-09-13T18:51:04.219420+0000","last_undegraded":"2024-09-13T18:51:04.219420+0000","last_fullsized":"2024-09-13T18:51:04.219420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:04.219395+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:04.219395+0000","last_clean_scrub_stamp":"2024-09-13T18:51:04.219395+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:25.558266+0000","scrub_duration":0.0013989510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:10.239934+0000","last_change":"2024-09-13T18:51:10.240028+0000","last_active":"2024-09-13T18:51:10.239934+0000","last_peered":"2024-09-13T18:51:10.239934+0000","last_clean":"2024-09-13T18:51:10.239934+0000","last_became_active":"2024-09-13T18:45:22.024014+0000","last_became_peered":"2024-09-13T18:45:22.024014+0000","last_unstale":"2024-09-13T18:51:10.239934+0000","last_undegraded":"2024-09-13T18:51:10.239934+0000","last_fullsized":"2024-09-13T18:51:10.239934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2024-09-13T18:51:10.239911+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2024-09-13T18:51:10.239911+0000","last_clean_scrub_stamp":"2024-09-13T18:51:10.239911+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.117838+0000","scrub_duration":0.0014525180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:24.955844+0000","last_change":"2024-09-13T18:51:24.955946+0000","last_active":"2024-09-13T18:51:24.955844+0000","last_peered":"2024-09-13T18:51:24.955844+0000","last_clean":"2024-09-13T18:51:24.955844+0000","last_became_active":"2024-09-13T18:45:22.036269+0000","last_became_peered":"2024-09-13T18:45:22.036269+0000","last_unstale":"2024-09-13T18:51:24.955844+0000","last_undegraded":"2024-09-13T18:51:24.955844+0000","last_fullsized":"2024-09-13T18:51:24.955844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-09-13T18:51:24.955820+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-09-13T18:51:24.955820+0000","last_clean_scrub_stamp":"2024-09-13T18:51:24.955820+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:51.833988+0000","scrub_duration":0.0015012879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:27.661539+0000","last_change":"2024-09-13T18:51:27.661675+0000","last_active":"2024-09-13T18:51:27.661539+0000","last_peered":"2024-09-13T18:51:27.661539+0000","last_clean":"2024-09-13T18:51:27.661539+0000","last_became_active":"2024-09-13T18:45:22.027605+0000","last_became_peered":"2024-09-13T18:45:22.027605+0000","last_unstale":"2024-09-13T18:51:27.661539+0000","last_undegraded":"2024-09-13T18:51:27.661539+0000","last_fullsized":"2024-09-13T18:51:27.661539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:27.661479+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:27.661479+0000","last_clean_scrub_stamp":"2024-09-13T18:51:27.661479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:39.415761+0000","scrub_duration":0.0017052829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:22.976933+0000","last_change":"2024-09-13T18:51:22.977040+0000","last_active":"2024-09-13T18:51:22.976933+0000","last_peered":"2024-09-13T18:51:22.976933+0000","last_clean":"2024-09-13T18:51:22.976933+0000","last_became_active":"2024-09-13T18:45:22.029018+0000","last_became_peered":"2024-09-13T18:45:22.029018+0000","last_unstale":"2024-09-13T18:51:22.976933+0000","last_undegraded":"2024-09-13T18:51:22.976933+0000","last_fullsized":"2024-09-13T18:51:22.976933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:22.976908+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:22.976908+0000","last_clean_scrub_stamp":"2024-09-13T18:51:22.976908+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:01.253674+0000","scrub_duration":0.0020635290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:28.530330+0000","last_change":"2024-09-13T18:51:28.530447+0000","last_active":"2024-09-13T18:51:28.530330+0000","last_peered":"2024-09-13T18:51:28.530330+0000","last_clean":"2024-09-13T18:51:28.530330+0000","last_became_active":"2024-09-13T18:45:22.028758+0000","last_became_peered":"2024-09-13T18:45:22.028758+0000","last_unstale":"2024-09-13T18:51:28.530330+0000","last_undegraded":"2024-09-13T18:51:28.530330+0000","last_fullsized":"2024-09-13T18:51:28.530330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-09-13T18:51:28.530306+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-09-13T18:51:28.530306+0000","last_clean_scrub_stamp":"2024-09-13T18:51:28.530306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:35.905681+0000","scrub_duration":0.0019418599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:15.836886+0000","last_change":"2024-09-13T18:51:15.837024+0000","last_active":"2024-09-13T18:51:15.836886+0000","last_peered":"2024-09-13T18:51:15.836886+0000","last_clean":"2024-09-13T18:51:15.836886+0000","last_became_active":"2024-09-13T18:45:22.029403+0000","last_became_peered":"2024-09-13T18:45:22.029403+0000","last_unstale":"2024-09-13T18:51:15.836886+0000","last_undegraded":"2024-09-13T18:51:15.836886+0000","last_fullsized":"2024-09-13T18:51:15.836886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:15.836847+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:15.836847+0000","last_clean_scrub_stamp":"2024-09-13T18:51:15.836847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:34.085336+0000","scrub_duration":0.0017205300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:32.474492+0000","last_change":"2024-09-13T18:51:32.474599+0000","last_active":"2024-09-13T18:51:32.474492+0000","last_peered":"2024-09-13T18:51:32.474492+0000","last_clean":"2024-09-13T18:51:32.474492+0000","last_became_active":"2024-09-13T18:45:22.036877+0000","last_became_peered":"2024-09-13T18:45:22.036877+0000","last_unstale":"2024-09-13T18:51:32.474492+0000","last_undegraded":"2024-09-13T18:51:32.474492+0000","last_fullsized":"2024-09-13T18:51:32.474492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-09-13T18:51:32.474467+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-09-13T18:51:32.474467+0000","last_clean_scrub_stamp":"2024-09-13T18:51:32.474467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:37.348226+0000","scrub_duration":0.0021976470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'8","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:13.581085+0000","last_change":"2024-09-13T18:51:13.581085+0000","last_active":"2024-09-13T18:51:13.581085+0000","last_peered":"2024-09-13T18:51:13.581085+0000","last_clean":"2024-09-13T18:51:13.581085+0000","last_became_active":"2024-09-13T18:45:22.022618+0000","last_became_peered":"2024-09-13T18:45:22.022618+0000","last_unstale":"2024-09-13T18:51:13.581085+0000","last_undegraded":"2024-09-13T18:51:13.581085+0000","last_fullsized":"2024-09-13T18:51:13.581085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-09-13T18:51:13.580921+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-09-13T18:51:13.580921+0000","last_clean_scrub_stamp":"2024-09-13T18:51:13.580921+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:36.754949+0000","scrub_duration":0.001570622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:31.470445+0000","last_change":"2024-09-13T18:51:31.470445+0000","last_active":"2024-09-13T18:51:31.470445+0000","last_peered":"2024-09-13T18:51:31.470445+0000","last_clean":"2024-09-13T18:51:31.470445+0000","last_became_active":"2024-09-13T18:45:22.028291+0000","last_became_peered":"2024-09-13T18:45:22.028291+0000","last_unstale":"2024-09-13T18:51:31.470445+0000","last_undegraded":"2024-09-13T18:51:31.470445+0000","last_fullsized":"2024-09-13T18:51:31.470445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-09-13T18:51:31.470316+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-09-13T18:51:31.470316+0000","last_clean_scrub_stamp":"2024-09-13T18:51:31.470316+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:04.398621+0000","scrub_duration":0.0015283759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'10","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:51:36.958781+0000","last_change":"2024-09-13T18:51:36.958781+0000","last_active":"2024-09-13T18:51:36.958781+0000","last_peered":"2024-09-13T18:51:36.958781+0000","last_clean":"2024-09-13T18:51:36.958781+0000","last_became_active":"2024-09-13T18:45:22.033974+0000","last_became_peered":"2024-09-13T18:45:22.033974+0000","last_unstale":"2024-09-13T18:51:36.958781+0000","last_undegraded":"2024-09-13T18:51:36.958781+0000","last_fullsized":"2024-09-13T18:51:36.958781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-09-13T18:51:36.958649+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-09-13T18:51:36.958649+0000","last_clean_scrub_stamp":"2024-09-13T18:51:36.958649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:09.886954+0000","scrub_duration":0.001515852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":954260,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":272,"num_write_kb":1081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":1908520,"data_compressed":245052,"data_compressed_allocated":294912,"data_compressed_original":1441792,"omap_allocated":0,"internal_metadata":0},"log_size":353,"ondisk_log_size":353,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64976,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574932,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":704313,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.36499999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.754},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.50900000000000001,"15min":0.47699999999999998},"min":{"1min":0.41399999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.5}]},{"osd":1,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.5,"15min":0.504},"min":{"1min":0.434,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.72299999999999998,"5min":0.749,"15min":0.749},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.41699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66300000000000003,"5min":0.70599999999999996,"15min":0.80400000000000005},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.35199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.38200000000000001,"5min":0.31900000000000001,"15min":0.28899999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.40600000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.42199999999999999,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44500000000000001,"15min":0.46700000000000003},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.56899999999999995,"5min":0.71399999999999997,"15min":0.72399999999999998},"last":0.372},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45500000000000002,"15min":0.497},"min":{"1min":0.312,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.629,"5min":0.64800000000000002,"15min":0.748},"last":0.40899999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48299999999999998,"15min":0.51500000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64700000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48999999999999999,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64200000000000002,"5min":0.73099999999999998,"15min":0.88500000000000001},"last":0.443}]},{"osd":6,"last update":"Fri Sep 13 18:51:31 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.57199999999999995},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66100000000000003,"5min":0.75800000000000001,"15min":0.85499999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51200000000000001,"15min":0.56399999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.73599999999999999,"15min":0.81799999999999995},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":655360,"data_stored":1055800,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.495,"15min":0.47399999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.66500000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.28000000000000003},"max":{"1min":0.625,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.505}]},{"osd":1,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.499},"min":{"1min":0.32300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.63900000000000001,"5min":0.73199999999999998,"15min":0.746},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.50600000000000001,"15min":0.51400000000000001},"min":{"1min":0.38200000000000001,"5min":0.316,"15min":0.28999999999999998},"max":{"1min":0.67000000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52600000000000002,"15min":0.53700000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.72199999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.38500000000000001,"5min":0.35799999999999998,"15min":0.35099999999999998},"max":{"1min":0.61099999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73499999999999999,"5min":0.746,"15min":0.81499999999999995},"last":0.621}]},{"osd":4,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.32000000000000001,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.66500000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.54600000000000004},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.77500000000000002},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.309,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.72699999999999998},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:51:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.33100000000000002,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.755,"15min":0.755},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52200000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.69899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574932,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":113453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.71199999999999997,"5min":0.72799999999999998,"15min":0.73599999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52100000000000002,"15min":0.51600000000000001},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.87},"last":0.64300000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.35799999999999998,"5min":0.314,"15min":0.27000000000000002},"max":{"1min":0.78200000000000003,"5min":0.78700000000000003,"15min":0.91300000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.79300000000000004},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53700000000000003,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.84099999999999997},"last":0.623},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.45700000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.76300000000000001},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.55200000000000005},"min":{"1min":0.45300000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.76100000000000001,"15min":0.85299999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.45500000000000002},"min":{"1min":0.33800000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70299999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47899999999999998,"15min":0.49099999999999999},"min":{"1min":0.30599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66200000000000003,"5min":0.76900000000000002,"15min":0.79900000000000004},"last":0.40500000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72399999999999998,"5min":0.754,"15min":0.81699999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74399999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.38600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.67600000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.49299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":113489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.49099999999999999},"min":{"1min":0.309,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.67900000000000005,"5min":0.77900000000000003,"15min":0.80200000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64700000000000002,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.40000000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.99099999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.53400000000000003},"min":{"1min":0.40100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71399999999999997,"5min":0.746,"15min":0.86099999999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.443,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.81699999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.90800000000000003},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.42799999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.69799999999999995,"5min":0.747,"15min":0.88800000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.56100000000000005},"min":{"1min":0.48599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72899999999999998,"5min":0.79000000000000004,"15min":0.93400000000000005},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.33900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64600000000000002,"5min":0.75700000000000001,"15min":0.95399999999999996},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.46300000000000002,"15min":0.49299999999999999},"min":{"1min":0.32900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61699999999999999,"5min":0.67500000000000004,"15min":0.97399999999999998},"last":0.35099999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.498},"min":{"1min":0.35699999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.67100000000000004,"5min":0.80200000000000005,"15min":1.0369999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.34399999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68600000000000005,"5min":0.78800000000000003,"15min":1.0549999999999999},"last":0.36899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.501,"15min":0.51900000000000002},"min":{"1min":0.39100000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67600000000000005,"5min":0.68700000000000006,"15min":1.0089999999999999},"last":0.308},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.56200000000000006},"min":{"1min":0.40400000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70099999999999996,"5min":0.82499999999999996,"15min":1.075},"last":0.41999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574932,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":667648,"data_stored":1066825,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36799999999999999,"15min":0.378},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48899999999999999,"5min":0.63600000000000001,"15min":1.0449999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.37,"15min":0.378},"min":{"1min":0.28100000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46800000000000003,"5min":0.63400000000000001,"15min":0.98699999999999999},"last":0.42699999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38100000000000001,"15min":0.40300000000000002},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.57299999999999995,"5min":0.753,"15min":1.121},"last":0.496},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40999999999999998,"15min":0.41199999999999998},"min":{"1min":0.26800000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63,"5min":0.67200000000000004,"15min":1.0760000000000001},"last":0.39800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.32000000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59999999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.33800000000000002},"max":{"1min":0.90500000000000003,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.62},"min":{"1min":0.437,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":0.91800000000000004,"15min":1.0780000000000001},"last":0.73299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83099999999999996,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85699999999999998,"5min":0.86499999999999999,"15min":0.93500000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80700000000000005,"5min":0.83699999999999997,"15min":1.0089999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:51:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86799999999999999,"5min":0.89100000000000001,"15min":0.92100000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.66700000000000004},"min":{"1min":0.47699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79800000000000004,"5min":0.88800000000000001,"15min":1.2210000000000001},"last":0.64700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574932,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":290816,"data_stored":124388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38900000000000001,"15min":0.36099999999999999},"min":{"1min":0.223,"5min":0.188,"15min":0.188},"max":{"1min":0.51900000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.495},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.38400000000000001},"min":{"1min":0.29999999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56100000000000005,"5min":0.70899999999999996,"15min":0.85299999999999998},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.41099999999999998,"15min":0.39100000000000001},"min":{"1min":0.28299999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63600000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.441,"15min":0.41499999999999998},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45900000000000002,"15min":0.438},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.66700000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.47599999999999998,"15min":0.442},"min":{"1min":0.33500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.442,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60699999999999998,"15min":0.627},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82899999999999996,"5min":0.98499999999999999,"15min":1.0369999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.97599999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.628,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.438,"15min":0.437},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.626}]},{"osd":6,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63100000000000001,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.80400000000000005,"5min":0.94399999999999995,"15min":0.995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57999999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:51:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63100000000000001,"15min":0.65400000000000003},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.91700000000000004,"15min":0.95899999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.64200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":113523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.35799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22900000000000001,"5min":0.192,"15min":0.182},"max":{"1min":0.52300000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.372,"15min":0.34999999999999998},"min":{"1min":0.27900000000000003,"5min":0.192,"15min":0.192},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.36199999999999999,"15min":0.34300000000000003},"min":{"1min":0.22900000000000001,"5min":0.219,"15min":0.20899999999999999},"max":{"1min":0.46300000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.373},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.307,"5min":0.249,"15min":0.24099999999999999},"max":{"1min":0.56399999999999995,"5min":0.72299999999999998,"15min":0.84199999999999997},"last":0.39000000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.436,"15min":0.42299999999999999},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65500000000000003,"5min":0.74199999999999999,"15min":0.79000000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50800000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.40799999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57099999999999995,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.32300000000000001},"max":{"1min":0.71899999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76500000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.44600000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.749,"5min":0.83899999999999997,"15min":0.84199999999999997},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.432,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.746,"5min":0.82999999999999996,"15min":0.85599999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41299999999999998},"max":{"1min":0.70999999999999996,"5min":0.872,"15min":0.872},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.83599999999999997,"15min":1.0449999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69599999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.56599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":356352,"data_stored":704369,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.41999999999999998},"min":{"1min":0.23200000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58699999999999997,"5min":0.629,"15min":1.496},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.38900000000000001,"15min":0.40500000000000003},"min":{"1min":0.255,"5min":0.22600000000000001,"15min":0.20699999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":1.024},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42799999999999999,"15min":0.45700000000000002},"min":{"1min":0.33700000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.66800000000000004,"5min":0.76300000000000001,"15min":1.518},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41999999999999998,"15min":0.434},"min":{"1min":0.28599999999999998,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.60799999999999998,"5min":0.83699999999999997,"15min":1.1679999999999999},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.30399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.69699999999999995,"5min":0.79000000000000004,"15min":1.294},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46600000000000003,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":1.4259999999999999},"last":0.41799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.64200000000000002},"min":{"1min":0.44500000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77200000000000002,"5min":0.95099999999999996,"15min":1.198},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":1.3300000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60999999999999999,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85199999999999998,"5min":0.93300000000000005,"15min":1.4510000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60699999999999998,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":0.96899999999999997,"15min":1.143},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.64800000000000002},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.85899999999999999,"15min":1.391},"last":0.629},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63600000000000001,"15min":0.72099999999999997},"min":{"1min":0.46700000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88600000000000001,"5min":0.98299999999999998,"15min":1.4750000000000001},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:51:27 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.626,"15min":0.67600000000000005},"min":{"1min":0.46200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.879,"5min":0.94499999999999995,"15min":1.0800000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61499999999999999,"15min":0.67500000000000004},"min":{"1min":0.49299999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.82599999999999996,"5min":0.92100000000000004,"15min":1.363},"last":0.68600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32488,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":11025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":953462,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":942437,"data_compressed":122526,"data_compressed_allocated":147456,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:52:06.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T18:52:06.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.790+0000 7feafb93e640 1 Processor -- start 2024-09-13T18:52:06.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.790+0000 7feafb93e640 1 -- start start 2024-09-13T18:52:06.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feafb93e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feaf40b38b0 0x7feaf4071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:06.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feafb93e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7feaf4071fb0 0x7feaf414d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:06.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feafb93e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf409cdb0 con 0x7feaf40ac9e0 2024-09-13T18:52:06.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feafb93e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf40ad300 con 0x7feaf40b38b0 2024-09-13T18:52:06.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feafb93e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf40adfc0 con 0x7feaf4071fb0 2024-09-13T18:52:06.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feaf8ed9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feaf40b38b0 0x7feaf4071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:06.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feaf8ed9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feaf40b38b0 0x7feaf4071a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40284/0 (socket says 172.21.15.29:40284) 2024-09-13T18:52:06.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feaf8ed9640 1 -- 172.21.15.29:0/722945253 learned_addr learned my addr 172.21.15.29:0/722945253 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:06.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feaf9edb640 1 --2- 172.21.15.29:0/722945253 >> v2:172.21.15.96:3300/0 conn(0x7feaf4071fb0 0x7feaf414d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:06.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feaf8ed9640 1 -- 172.21.15.29:0/722945253 >> v2:172.21.15.96:3300/0 conn(0x7feaf4071fb0 msgr2=0x7feaf414d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:06.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feaf8ed9640 1 --2- 172.21.15.29:0/722945253 >> v2:172.21.15.96:3300/0 conn(0x7feaf4071fb0 0x7feaf414d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feaf8ed9640 1 -- 172.21.15.29:0/722945253 >> v1:172.21.15.96:6789/0 conn(0x7feaf40ac9e0 legacy=0x7feaf4145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:06.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feaf8ed9640 1 -- 172.21.15.29:0/722945253 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf40ae6c0 con 0x7feaf40b38b0 2024-09-13T18:52:06.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.791+0000 7feaf9edb640 1 --2- 172.21.15.29:0/722945253 >> v2:172.21.15.96:3300/0 conn(0x7feaf4071fb0 0x7feaf414d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:06.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.792+0000 7feaf8ed9640 1 --2- 172.21.15.29:0/722945253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaf40b38b0 0x7feaf4071a70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feaf41438a0 tx=0x7feae402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ccdac19f28ed95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:06.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.792+0000 7feaebfff640 1 -- 172.21.15.29:0/722945253 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4032440 con 0x7feaf40b38b0 2024-09-13T18:52:06.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.792+0000 7feaebfff640 1 -- 172.21.15.29:0/722945253 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae40325a0 con 0x7feaf40b38b0 2024-09-13T18:52:06.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.792+0000 7feaebfff640 1 -- 172.21.15.29:0/722945253 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4032930 con 0x7feaf40b38b0 2024-09-13T18:52:06.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.792+0000 7feafb93e640 1 -- 172.21.15.29:0/722945253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaf40b38b0 msgr2=0x7feaf4071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:06.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.792+0000 7feafb93e640 1 --2- 172.21.15.29:0/722945253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaf40b38b0 0x7feaf4071a70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feaf41438a0 tx=0x7feae402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.793+0000 7feafb93e640 1 -- 172.21.15.29:0/722945253 shutdown_connections 2024-09-13T18:52:06.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.793+0000 7feafb93e640 1 --2- 172.21.15.29:0/722945253 >> v2:172.21.15.96:3300/0 conn(0x7feaf4071fb0 0x7feaf414d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.793+0000 7feafb93e640 1 --2- 172.21.15.29:0/722945253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaf40b38b0 0x7feaf4071a70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.793+0000 7feafb93e640 1 -- 172.21.15.29:0/722945253 >> 172.21.15.29:0/722945253 conn(0x7feaf40b3fb0 msgr2=0x7feaf40b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:06.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.793+0000 7feafb93e640 1 -- 172.21.15.29:0/722945253 shutdown_connections 2024-09-13T18:52:06.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.793+0000 7feafb93e640 1 -- 172.21.15.29:0/722945253 wait complete. 2024-09-13T18:52:06.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.794+0000 7feafb93e640 1 Processor -- start 2024-09-13T18:52:06.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.794+0000 7feafb93e640 1 -- start start 2024-09-13T18:52:06.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.794+0000 7feafb93e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf4071fb0 0x7feaf4144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:06.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.794+0000 7feafb93e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feaf40ac9e0 0x7feaf406e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:06.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.794+0000 7feafb93e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaf40b38b0 0x7feaf41dc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:06.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.794+0000 7feafb93e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf4140b10 con 0x7feaf40b38b0 2024-09-13T18:52:06.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.794+0000 7feafb93e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf41459e0 con 0x7feaf4071fb0 2024-09-13T18:52:06.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.794+0000 7feafb93e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf406ed50 con 0x7feaf40ac9e0 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.794+0000 7feaf9edb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaf40b38b0 0x7feaf41dc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.794+0000 7feaf9edb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaf40b38b0 0x7feaf41dc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40294/0 (socket says 172.21.15.29:40294) 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.794+0000 7feaf9edb640 1 -- 172.21.15.29:0/620199469 learned_addr learned my addr 172.21.15.29:0/620199469 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feaf96da640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf4071fb0 0x7feaf4144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feaf8ed9640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feaf40ac9e0 0x7feaf406e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feaf9edb640 1 -- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feaf40ac9e0 msgr2=0x7feaf406e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feaf9edb640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feaf40ac9e0 0x7feaf406e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feaf9edb640 1 -- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf4071fb0 msgr2=0x7feaf4144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feaf9edb640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf4071fb0 0x7feaf4144bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feaf9edb640 1 -- 172.21.15.29:0/620199469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40094d0 con 0x7feaf40b38b0 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feaf9edb640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaf40b38b0 0x7feaf41dc5f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feaec00cf20 tx=0x7feaec00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feae9ffb640 1 -- 172.21.15.29:0/620199469 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec00d840 con 0x7feaf40b38b0 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feae9ffb640 1 -- 172.21.15.29:0/620199469 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec00d9a0 con 0x7feaf40b38b0 2024-09-13T18:52:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feafb93e640 1 -- 172.21.15.29:0/620199469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf4141a80 con 0x7feaf40b38b0 2024-09-13T18:52:06.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feae9ffb640 1 -- 172.21.15.29:0/620199469 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec00dd50 con 0x7feaf40b38b0 2024-09-13T18:52:06.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.795+0000 7feafb93e640 1 -- 172.21.15.29:0/620199469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf4141d60 con 0x7feaf40b38b0 2024-09-13T18:52:06.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.796+0000 7feafb93e640 1 -- 172.21.15.29:0/620199469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf40ad760 con 0x7feaf40b38b0 2024-09-13T18:52:06.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.797+0000 7feae9ffb640 1 -- 172.21.15.29:0/620199469 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feaec01e3b0 con 0x7feaf40b38b0 2024-09-13T18:52:06.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.797+0000 7feae9ffb640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fead806ac00 0x7fead806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:06.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.798+0000 7feae9ffb640 1 -- 172.21.15.29:0/620199469 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feaec08a120 con 0x7feaf40b38b0 2024-09-13T18:52:06.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.798+0000 7feaf96da640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fead806ac00 0x7fead806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:06.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.798+0000 7feaf96da640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fead806ac00 0x7fead806d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feaf0004f60 tx=0x7feaf0007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:06.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.802+0000 7feae9ffb640 1 -- 172.21.15.29:0/620199469 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feaec054fe0 con 0x7feaf40b38b0 2024-09-13T18:52:06.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.975+0000 7feafb93e640 1 -- 172.21.15.29:0/620199469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7feaf4145b90 con 0x7feaf40b38b0 2024-09-13T18:52:06.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.979+0000 7feae9ffb640 1 -- 172.21.15.29:0/620199469 <== mon.0 v2:172.21.15.29:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7feaec007a00 con 0x7feaf40b38b0 2024-09-13T18:52:06.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.979+0000 7feae9ffb640 1 -- 172.21.15.29:0/620199469 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7feaf4145b90 con 0x7feaf40b38b0 2024-09-13T18:52:06.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.982+0000 7feafb93e640 1 -- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fead806ac00 msgr2=0x7fead806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:06.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.982+0000 7feafb93e640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fead806ac00 0x7fead806d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feaf0004f60 tx=0x7feaf0007e30 comp rx=0 tx=0).stop 2024-09-13T18:52:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.982+0000 7feafb93e640 1 -- 172.21.15.29:0/620199469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaf40b38b0 msgr2=0x7feaf41dc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.982+0000 7feafb93e640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaf40b38b0 0x7feaf41dc5f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feaec00cf20 tx=0x7feaec00a7d0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.982+0000 7feafb93e640 1 -- 172.21.15.29:0/620199469 shutdown_connections 2024-09-13T18:52:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.982+0000 7feafb93e640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fead806ac00 0x7fead806d0c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.982+0000 7feafb93e640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaf40b38b0 0x7feaf41dc5f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.982+0000 7feafb93e640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feaf40ac9e0 0x7feaf406e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.982+0000 7feafb93e640 1 --2- 172.21.15.29:0/620199469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feaf4071fb0 0x7feaf4144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.982+0000 7feafb93e640 1 -- 172.21.15.29:0/620199469 >> 172.21.15.29:0/620199469 conn(0x7feaf40b3fb0 msgr2=0x7feaf40b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.982+0000 7feafb93e640 1 -- 172.21.15.29:0/620199469 shutdown_connections 2024-09-13T18:52:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:06.982+0000 7feafb93e640 1 -- 172.21.15.29:0/620199469 wait complete. 2024-09-13T18:52:06.995 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:52:06.996 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:52:07.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.095+0000 7f2b944d7640 1 Processor -- start 2024-09-13T18:52:07.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.095+0000 7f2b944d7640 1 -- start start 2024-09-13T18:52:07.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.095+0000 7f2b944d7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b8c0b0330 0x7f2b8c145720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.095+0000 7f2b944d7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2b8c145c60 0x7f2b8c14c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.095+0000 7f2b944d7640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c0b0e10 con 0x7f2b8c0b2850 2024-09-13T18:52:07.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.095+0000 7f2b944d7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c06e920 con 0x7f2b8c145c60 2024-09-13T18:52:07.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.095+0000 7f2b944d7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c1460d0 con 0x7f2b8c0b0330 2024-09-13T18:52:07.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b92273640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2b8c0b2850 0x7f2b8c13be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56612/0 (socket says 172.21.15.29:56612) 2024-09-13T18:52:07.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b92273640 1 -- 172.21.15.29:0/218114735 learned_addr learned my addr 172.21.15.29:0/218114735 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:52:07.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b92a74640 1 --2- 172.21.15.29:0/218114735 >> v2:172.21.15.96:3300/0 conn(0x7f2b8c145c60 0x7f2b8c14c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91a72640 1 --2- 172.21.15.29:0/218114735 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b8c0b0330 0x7f2b8c145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306757616 0 0) 0x7f2b8c0b0e10 con 0x7f2b8c0b2850 2024-09-13T18:52:07.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b78003520 con 0x7f2b8c0b2850 2024-09-13T18:52:07.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1698297346 0 0) 0x7f2b78003520 con 0x7f2b8c0b2850 2024-09-13T18:52:07.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b8c0b0330 msgr2=0x7f2b8c145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:07.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 --2- 172.21.15.29:0/218114735 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b8c0b0330 0x7f2b8c145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 >> v2:172.21.15.96:3300/0 conn(0x7f2b8c145c60 msgr2=0x7f2b8c14c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:07.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 --2- 172.21.15.29:0/218114735 >> v2:172.21.15.96:3300/0 conn(0x7f2b8c145c60 0x7f2b8c14c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c0b2c30 con 0x7f2b8c0b2850 2024-09-13T18:52:07.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f2b88001670 con 0x7f2b8c0b2850 2024-09-13T18:52:07.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 >> v1:172.21.15.29:6789/0 conn(0x7f2b8c0b2850 legacy=0x7f2b8c13be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 --2- 172.21.15.29:0/218114735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b78003970 0x7f2b78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 --2- 172.21.15.29:0/218114735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b780047c0 0x7f2b78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 --2- 172.21.15.29:0/218114735 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b8c0b0330 0x7f2b78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c06e920 con 0x7f2b780047c0 2024-09-13T18:52:07.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c1460d0 con 0x7f2b78003970 2024-09-13T18:52:07.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7800dc40 con 0x7f2b8c0b0330 2024-09-13T18:52:07.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b92a74640 1 --2- 172.21.15.29:0/218114735 >> v2:172.21.15.96:3300/0 conn(0x7f2b8c145c60 0x7f2b8c14c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:07.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b91a72640 1 --2- 172.21.15.29:0/218114735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b780047c0 0x7f2b78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b92273640 1 --2- 172.21.15.29:0/218114735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b78003970 0x7f2b78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.096+0000 7f2b92a74640 1 --2- 172.21.15.29:0/218114735 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b8c0b0330 0x7f2b78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.097+0000 7f2b91a72640 1 -- 172.21.15.29:0/218114735 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b8c0b0330 msgr2=0x7f2b78005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:07.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.097+0000 7f2b91a72640 1 --2- 172.21.15.29:0/218114735 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b8c0b0330 0x7f2b78005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.097+0000 7f2b91a72640 1 -- 172.21.15.29:0/218114735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b78003970 msgr2=0x7f2b78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:07.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.097+0000 7f2b91a72640 1 --2- 172.21.15.29:0/218114735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b78003970 0x7f2b78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.097+0000 7f2b91a72640 1 -- 172.21.15.29:0/218114735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b78003520 con 0x7f2b780047c0 2024-09-13T18:52:07.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.097+0000 7f2b91a72640 1 --2- 172.21.15.29:0/218114735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b780047c0 0x7f2b78004c40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009ac0 tx=0x7f2b780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec65a5da59448548 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:07.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.097+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c031400 con 0x7f2b780047c0 2024-09-13T18:52:07.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.098+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2b7c02d050 con 0x7f2b780047c0 2024-09-13T18:52:07.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.098+0000 7f2b91271640 1 -- 172.21.15.29:0/218114735 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c0317a0 con 0x7f2b780047c0 2024-09-13T18:52:07.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.098+0000 7f2b944d7640 1 -- 172.21.15.29:0/218114735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b780047c0 msgr2=0x7f2b78004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.098+0000 7f2b944d7640 1 --2- 172.21.15.29:0/218114735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b780047c0 0x7f2b78004c40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009ac0 tx=0x7f2b780057f0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.098+0000 7f2b92a74640 1 -- 172.21.15.29:0/218114735 reap_dead start 2024-09-13T18:52:07.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.098+0000 7f2b944d7640 1 -- 172.21.15.29:0/218114735 shutdown_connections 2024-09-13T18:52:07.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.098+0000 7f2b944d7640 1 -- 172.21.15.29:0/218114735 >> 172.21.15.29:0/218114735 conn(0x7f2b8c06a890 msgr2=0x7f2b8c0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:07.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.098+0000 7f2b944d7640 1 -- 172.21.15.29:0/218114735 shutdown_connections 2024-09-13T18:52:07.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.098+0000 7f2b944d7640 1 -- 172.21.15.29:0/218114735 wait complete. 2024-09-13T18:52:07.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.099+0000 7f2b944d7640 1 Processor -- start 2024-09-13T18:52:07.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.099+0000 7f2b944d7640 1 -- start start 2024-09-13T18:52:07.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b944d7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b780047c0 0x7f2b8c1dedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b944d7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b8c141000 0x7f2b8c141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b944d7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c1424b0 0x7f2b8c13e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b944d7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c13d2c0 con 0x7f2b8c1424b0 2024-09-13T18:52:07.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b944d7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c1d5ca0 con 0x7f2b8c141000 2024-09-13T18:52:07.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b944d7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0adb40 con 0x7f2b780047c0 2024-09-13T18:52:07.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b92a74640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c1424b0 0x7f2b8c13e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b92a74640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c1424b0 0x7f2b8c13e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40320/0 (socket says 172.21.15.29:40320) 2024-09-13T18:52:07.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b92a74640 1 -- 172.21.15.29:0/175078676 learned_addr learned my addr 172.21.15.29:0/175078676 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:07.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b91a72640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b8c141000 0x7f2b8c141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b92273640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b780047c0 0x7f2b8c1dedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b92a74640 1 -- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b780047c0 msgr2=0x7f2b8c1dedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b92a74640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b780047c0 0x7f2b8c1dedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b92a74640 1 -- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b8c141000 msgr2=0x7f2b8c141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b92a74640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b8c141000 0x7f2b8c141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b92a74640 1 -- 172.21.15.29:0/175078676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c141490 con 0x7f2b8c1424b0 2024-09-13T18:52:07.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.100+0000 7f2b92a74640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c1424b0 0x7f2b8c13e690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c146040 tx=0x7f2b840075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:07.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.101+0000 7f2b82ffd640 1 -- 172.21.15.29:0/175078676 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8401a070 con 0x7f2b8c1424b0 2024-09-13T18:52:07.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.101+0000 7f2b82ffd640 1 -- 172.21.15.29:0/175078676 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2b84010040 con 0x7f2b8c1424b0 2024-09-13T18:52:07.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.101+0000 7f2b944d7640 1 -- 172.21.15.29:0/175078676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c141770 con 0x7f2b8c1424b0 2024-09-13T18:52:07.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.101+0000 7f2b82ffd640 1 -- 172.21.15.29:0/175078676 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b84003990 con 0x7f2b8c1424b0 2024-09-13T18:52:07.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.101+0000 7f2b944d7640 1 -- 172.21.15.29:0/175078676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c06fad0 con 0x7f2b8c1424b0 2024-09-13T18:52:07.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.102+0000 7f2b944d7640 1 -- 172.21.15.29:0/175078676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c141c90 con 0x7f2b8c1424b0 2024-09-13T18:52:07.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.102+0000 7f2b82ffd640 1 -- 172.21.15.29:0/175078676 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b84016480 con 0x7f2b8c1424b0 2024-09-13T18:52:07.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.103+0000 7f2b82ffd640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2b7006ac00 0x7f2b7006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.103+0000 7f2b82ffd640 1 -- 172.21.15.29:0/175078676 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2b84089c10 con 0x7f2b8c1424b0 2024-09-13T18:52:07.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.103+0000 7f2b92273640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2b7006ac00 0x7f2b7006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.103+0000 7f2b92273640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2b7006ac00 0x7f2b7006d0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c13cdd0 tx=0x7f2b880078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:07.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.107+0000 7f2b82ffd640 1 -- 172.21.15.29:0/175078676 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2b84054ac0 con 0x7f2b8c1424b0 2024-09-13T18:52:07.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.315+0000 7f2b944d7640 1 -- 172.21.15.29:0/175078676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b8c0b1090 con 0x7f2b8c1424b0 2024-09-13T18:52:07.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.316+0000 7f2b82ffd640 1 -- 172.21.15.29:0/175078676 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3215 (secure 0 0 0) 0x7f2b840580e0 con 0x7f2b8c1424b0 2024-09-13T18:52:07.318 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:52:07.319 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/3867151553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3867151553},{"type":"v1","addr":"172.21.15.96:6835","nonce":3867151553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:22.006847+0000","modified":"2024-09-13T18:45:43.067420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6833/175129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":175129703},{"type":"v1","addr":"172.21.15.29:6833","nonce":175129703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:52:07.319 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-09-13T18:52:07.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.317+0000 7f2b944d7640 1 -- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2b7006ac00 msgr2=0x7f2b7006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.317+0000 7f2b944d7640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2b7006ac00 0x7f2b7006d0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c13cdd0 tx=0x7f2b880078f0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.317+0000 7f2b944d7640 1 -- 172.21.15.29:0/175078676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c1424b0 msgr2=0x7f2b8c13e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.317+0000 7f2b944d7640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c1424b0 0x7f2b8c13e690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c146040 tx=0x7f2b840075c0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.317+0000 7f2b944d7640 1 -- 172.21.15.29:0/175078676 shutdown_connections 2024-09-13T18:52:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.317+0000 7f2b944d7640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f2b7006ac00 0x7f2b7006d0c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.317+0000 7f2b944d7640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c1424b0 0x7f2b8c13e690 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.317+0000 7f2b944d7640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b8c141000 0x7f2b8c141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.317+0000 7f2b944d7640 1 --2- 172.21.15.29:0/175078676 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b780047c0 0x7f2b8c1dedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.317+0000 7f2b944d7640 1 -- 172.21.15.29:0/175078676 >> 172.21.15.29:0/175078676 conn(0x7f2b8c06a890 msgr2=0x7f2b8c0b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.317+0000 7f2b944d7640 1 -- 172.21.15.29:0/175078676 shutdown_connections 2024-09-13T18:52:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.318+0000 7f2b944d7640 1 -- 172.21.15.29:0/175078676 wait complete. 2024-09-13T18:52:07.331 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:52:07.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.430+0000 7f94f13bc640 1 Processor -- start 2024-09-13T18:52:07.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.430+0000 7f94f13bc640 1 -- start start 2024-09-13T18:52:07.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94f13bc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f94ec13d6b0 0x7f94ec13db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94f13bc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec0b1b60 con 0x7f94ec14c0b0 2024-09-13T18:52:07.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94f13bc640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec0ba200 con 0x7f94ec0b9e20 2024-09-13T18:52:07.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94f13bc640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ec0b4650 con 0x7f94ec13d6b0 2024-09-13T18:52:07.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94eb7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f94ec14c0b0 0x7f94ec14e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56626/0 (socket says 172.21.15.29:56626) 2024-09-13T18:52:07.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94eb7fe640 1 -- 172.21.15.29:0/3833253243 learned_addr learned my addr 172.21.15.29:0/3833253243 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:52:07.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94e27fc640 1 --2- 172.21.15.29:0/3833253243 >> v2:172.21.15.96:3300/0 conn(0x7f94ec13d6b0 0x7f94ec13db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94ea7fc640 1 -- 172.21.15.29:0/3833253243 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108917532 0 0) 0x7f94ec0b1b60 con 0x7f94ec14c0b0 2024-09-13T18:52:07.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94ea7fc640 1 -- 172.21.15.29:0/3833253243 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d8003520 con 0x7f94ec14c0b0 2024-09-13T18:52:07.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94ea7fc640 1 -- 172.21.15.29:0/3833253243 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134542524 0 0) 0x7f94ec0ba200 con 0x7f94ec0b9e20 2024-09-13T18:52:07.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94ea7fc640 1 -- 172.21.15.29:0/3833253243 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94ec0b1b60 con 0x7f94ec0b9e20 2024-09-13T18:52:07.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94e27fc640 1 -- 172.21.15.29:0/3833253243 >> v1:172.21.15.96:6789/0 conn(0x7f94ec0b9e20 legacy=0x7f94ec0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94e27fc640 1 -- 172.21.15.29:0/3833253243 >> v1:172.21.15.29:6789/0 conn(0x7f94ec14c0b0 legacy=0x7f94ec14e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.431+0000 7f94e27fc640 1 -- 172.21.15.29:0/3833253243 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec0b0950 con 0x7f94ec13d6b0 2024-09-13T18:52:07.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.432+0000 7f94e27fc640 1 --2- 172.21.15.29:0/3833253243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94ec13d6b0 0x7f94ec13db40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94d40097a0 tx=0x7f94d402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2b294be49bfe32e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.432+0000 7f94ea7fc640 1 -- 172.21.15.29:0/3833253243 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4032440 con 0x7f94ec13d6b0 2024-09-13T18:52:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.432+0000 7f94ea7fc640 1 -- 172.21.15.29:0/3833253243 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f94d40325a0 con 0x7f94ec13d6b0 2024-09-13T18:52:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.432+0000 7f94ea7fc640 1 -- 172.21.15.29:0/3833253243 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4032910 con 0x7f94ec13d6b0 2024-09-13T18:52:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.433+0000 7f94f13bc640 1 -- 172.21.15.29:0/3833253243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94ec13d6b0 msgr2=0x7f94ec13db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.433+0000 7f94f13bc640 1 --2- 172.21.15.29:0/3833253243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94ec13d6b0 0x7f94ec13db40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94d40097a0 tx=0x7f94d402a230 comp rx=0 tx=0).stop 2024-09-13T18:52:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.433+0000 7f94f13bc640 1 -- 172.21.15.29:0/3833253243 shutdown_connections 2024-09-13T18:52:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.433+0000 7f94f13bc640 1 --2- 172.21.15.29:0/3833253243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94ec13d6b0 0x7f94ec13db40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.433+0000 7f94f13bc640 1 -- 172.21.15.29:0/3833253243 >> 172.21.15.29:0/3833253243 conn(0x7f94ec06a5c0 msgr2=0x7f94ec0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:07.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.433+0000 7f94f13bc640 1 -- 172.21.15.29:0/3833253243 shutdown_connections 2024-09-13T18:52:07.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.433+0000 7f94f13bc640 1 -- 172.21.15.29:0/3833253243 wait complete. 2024-09-13T18:52:07.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.434+0000 7f94f13bc640 1 Processor -- start 2024-09-13T18:52:07.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.434+0000 7f94f13bc640 1 -- start start 2024-09-13T18:52:07.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94f13bc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94ec0b9e20 0x7f94ec136a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94f13bc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f94ec13d6b0 0x7f94ec135f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94f13bc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94ec14c0b0 0x7f94ec1dc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94f13bc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec137ba0 con 0x7f94ec14c0b0 2024-09-13T18:52:07.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94f13bc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec1dc120 con 0x7f94ec0b9e20 2024-09-13T18:52:07.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94f13bc640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec1d8bb0 con 0x7f94ec13d6b0 2024-09-13T18:52:07.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94eb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94ec14c0b0 0x7f94ec1dc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94eb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94ec14c0b0 0x7f94ec1dc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40322/0 (socket says 172.21.15.29:40322) 2024-09-13T18:52:07.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94eb7fe640 1 -- 172.21.15.29:0/3527211500 learned_addr learned my addr 172.21.15.29:0/3527211500 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:07.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94eaffd640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94ec0b9e20 0x7f94ec136a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94e27fc640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f94ec13d6b0 0x7f94ec135f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94eb7fe640 1 -- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f94ec13d6b0 msgr2=0x7f94ec135f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94eb7fe640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f94ec13d6b0 0x7f94ec135f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94eb7fe640 1 -- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94ec0b9e20 msgr2=0x7f94ec136a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94eb7fe640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94ec0b9e20 0x7f94ec136a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94eb7fe640 1 -- 172.21.15.29:0/3527211500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d4009400 con 0x7f94ec14c0b0 2024-09-13T18:52:07.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94eb7fe640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94ec14c0b0 0x7f94ec1dc990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f94e400caf0 tx=0x7f94e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:07.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94e3fff640 1 -- 172.21.15.29:0/3527211500 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e400aca0 con 0x7f94ec14c0b0 2024-09-13T18:52:07.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.435+0000 7f94e3fff640 1 -- 172.21.15.29:0/3527211500 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f94e400ae00 con 0x7f94ec14c0b0 2024-09-13T18:52:07.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.436+0000 7f94f13bc640 1 -- 172.21.15.29:0/3527211500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ec137570 con 0x7f94ec14c0b0 2024-09-13T18:52:07.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.436+0000 7f94e3fff640 1 -- 172.21.15.29:0/3527211500 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4012640 con 0x7f94ec14c0b0 2024-09-13T18:52:07.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.436+0000 7f94f13bc640 1 -- 172.21.15.29:0/3527211500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec137200 con 0x7f94ec14c0b0 2024-09-13T18:52:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.437+0000 7f94f13bc640 1 -- 172.21.15.29:0/3527211500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec0b4d30 con 0x7f94ec14c0b0 2024-09-13T18:52:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.437+0000 7f94e3fff640 1 -- 172.21.15.29:0/3527211500 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f94e4007070 con 0x7f94ec14c0b0 2024-09-13T18:52:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.438+0000 7f94e3fff640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f94cc06ac00 0x7f94cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.438+0000 7f94e3fff640 1 -- 172.21.15.29:0/3527211500 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f94e4089600 con 0x7f94ec14c0b0 2024-09-13T18:52:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.438+0000 7f94eaffd640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f94cc06ac00 0x7f94cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.438+0000 7f94eaffd640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f94cc06ac00 0x7f94cc06d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0011e0 tx=0x7f94dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:07.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.442+0000 7f94e3fff640 1 -- 172.21.15.29:0/3527211500 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f94ec0b4d30 con 0x7f94ec14c0b0 2024-09-13T18:52:07.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.648+0000 7f94f13bc640 1 -- 172.21.15.29:0/3527211500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94ec1d90b0 con 0x7f94ec14c0b0 2024-09-13T18:52:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.648+0000 7f94e3fff640 1 -- 172.21.15.29:0/3527211500 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3215 (secure 0 0 0) 0x7f94e4017ca0 con 0x7f94ec14c0b0 2024-09-13T18:52:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:52:07.652 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/3867151553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3867151553},{"type":"v1","addr":"172.21.15.96:6835","nonce":3867151553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:22.006847+0000","modified":"2024-09-13T18:45:43.067420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6833/175129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":175129703},{"type":"v1","addr":"172.21.15.29:6833","nonce":175129703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:52:07.652 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-09-13T18:52:07.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.650+0000 7f94f13bc640 1 -- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f94cc06ac00 msgr2=0x7f94cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.650+0000 7f94f13bc640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f94cc06ac00 0x7f94cc06d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0011e0 tx=0x7f94dc009040 comp rx=0 tx=0).stop 2024-09-13T18:52:07.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.650+0000 7f94f13bc640 1 -- 172.21.15.29:0/3527211500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94ec14c0b0 msgr2=0x7f94ec1dc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.650+0000 7f94f13bc640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94ec14c0b0 0x7f94ec1dc990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f94e400caf0 tx=0x7f94e400a060 comp rx=0 tx=0).stop 2024-09-13T18:52:07.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.650+0000 7f94f13bc640 1 -- 172.21.15.29:0/3527211500 shutdown_connections 2024-09-13T18:52:07.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.650+0000 7f94f13bc640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f94cc06ac00 0x7f94cc06d0c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.650+0000 7f94f13bc640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94ec14c0b0 0x7f94ec1dc990 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.650+0000 7f94f13bc640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f94ec13d6b0 0x7f94ec135f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.650+0000 7f94f13bc640 1 --2- 172.21.15.29:0/3527211500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94ec0b9e20 0x7f94ec136a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.650+0000 7f94f13bc640 1 -- 172.21.15.29:0/3527211500 >> 172.21.15.29:0/3527211500 conn(0x7f94ec06a5c0 msgr2=0x7f94ec13c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:07.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.650+0000 7f94f13bc640 1 -- 172.21.15.29:0/3527211500 shutdown_connections 2024-09-13T18:52:07.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.651+0000 7f94f13bc640 1 -- 172.21.15.29:0/3527211500 wait complete. 2024-09-13T18:52:07.664 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:52:07.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.763+0000 7f85f3ed0640 1 Processor -- start 2024-09-13T18:52:07.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.764+0000 7f85f3ed0640 1 -- start start 2024-09-13T18:52:07.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.764+0000 7f85f3ed0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85ec0b31d0 0x7f85ec0b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.764+0000 7f85f3ed0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f85ec0b35b0 0x7f85ec1498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.764+0000 7f85f3ed0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85ec13f8e0 0x7f85ec13fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.764+0000 7f85f3ed0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec149410 con 0x7f85ec13f8e0 2024-09-13T18:52:07.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.764+0000 7f85f3ed0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec140290 con 0x7f85ec0b35b0 2024-09-13T18:52:07.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.764+0000 7f85f3ed0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0b4550 con 0x7f85ec0b31d0 2024-09-13T18:52:07.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.764+0000 7f85f246d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85ec13f8e0 0x7f85ec13fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.764+0000 7f85f246d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85ec13f8e0 0x7f85ec13fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40330/0 (socket says 172.21.15.29:40330) 2024-09-13T18:52:07.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.764+0000 7f85f246d640 1 -- 172.21.15.29:0/3898091247 learned_addr learned my addr 172.21.15.29:0/3898091247 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:07.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.765+0000 7f85f1c6c640 1 --2- 172.21.15.29:0/3898091247 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85ec0b31d0 0x7f85ec0b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.765+0000 7f85f146b640 1 --2- 172.21.15.29:0/3898091247 >> v2:172.21.15.96:3300/0 conn(0x7f85ec0b35b0 0x7f85ec1498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.765+0000 7f85f246d640 1 -- 172.21.15.29:0/3898091247 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85ec0b31d0 msgr2=0x7f85ec0b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.765+0000 7f85f246d640 1 --2- 172.21.15.29:0/3898091247 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85ec0b31d0 0x7f85ec0b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.765+0000 7f85f246d640 1 -- 172.21.15.29:0/3898091247 >> v2:172.21.15.96:3300/0 conn(0x7f85ec0b35b0 msgr2=0x7f85ec1498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.765+0000 7f85f246d640 1 --2- 172.21.15.29:0/3898091247 >> v2:172.21.15.96:3300/0 conn(0x7f85ec0b35b0 0x7f85ec1498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.765+0000 7f85f246d640 1 -- 172.21.15.29:0/3898091247 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0b4810 con 0x7f85ec13f8e0 2024-09-13T18:52:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.765+0000 7f85f1c6c640 1 --2- 172.21.15.29:0/3898091247 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85ec0b31d0 0x7f85ec0b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.765+0000 7f85f246d640 1 --2- 172.21.15.29:0/3898091247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85ec13f8e0 0x7f85ec13fd50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f85ec06b7a0 tx=0x7f85e402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad39c1d9a0e7143f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.766+0000 7f85f0c6a640 1 -- 172.21.15.29:0/3898091247 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4031600 con 0x7f85ec13f8e0 2024-09-13T18:52:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.766+0000 7f85f0c6a640 1 -- 172.21.15.29:0/3898091247 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f85e402d050 con 0x7f85ec13f8e0 2024-09-13T18:52:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.766+0000 7f85f0c6a640 1 -- 172.21.15.29:0/3898091247 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e40319a0 con 0x7f85ec13f8e0 2024-09-13T18:52:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.766+0000 7f85f3ed0640 1 -- 172.21.15.29:0/3898091247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85ec13f8e0 msgr2=0x7f85ec13fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.766+0000 7f85f3ed0640 1 --2- 172.21.15.29:0/3898091247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85ec13f8e0 0x7f85ec13fd50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f85ec06b7a0 tx=0x7f85e402a610 comp rx=0 tx=0).stop 2024-09-13T18:52:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.766+0000 7f85f3ed0640 1 -- 172.21.15.29:0/3898091247 shutdown_connections 2024-09-13T18:52:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.766+0000 7f85f3ed0640 1 --2- 172.21.15.29:0/3898091247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85ec13f8e0 0x7f85ec13fd50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.766+0000 7f85f3ed0640 1 --2- 172.21.15.29:0/3898091247 >> v2:172.21.15.96:3300/0 conn(0x7f85ec0b35b0 0x7f85ec1498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.766+0000 7f85f3ed0640 1 --2- 172.21.15.29:0/3898091247 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85ec0b31d0 0x7f85ec0b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.766+0000 7f85f3ed0640 1 -- 172.21.15.29:0/3898091247 >> 172.21.15.29:0/3898091247 conn(0x7f85ec0bb590 msgr2=0x7f85ec0bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.766+0000 7f85f3ed0640 1 -- 172.21.15.29:0/3898091247 shutdown_connections 2024-09-13T18:52:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.766+0000 7f85f3ed0640 1 -- 172.21.15.29:0/3898091247 wait complete. 2024-09-13T18:52:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.767+0000 7f85f3ed0640 1 Processor -- start 2024-09-13T18:52:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.767+0000 7f85f3ed0640 1 -- start start 2024-09-13T18:52:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f3ed0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85ec0b31d0 0x7f85ec142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f3ed0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85ec0b35b0 0x7f85ec0aa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f3ed0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85ec13f8e0 0x7f85ec0a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f3ed0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0aa400 con 0x7f85ec0b35b0 2024-09-13T18:52:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f3ed0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0abf00 con 0x7f85ec13f8e0 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f3ed0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0a9d30 con 0x7f85ec0b31d0 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f146b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85ec0b35b0 0x7f85ec0aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f146b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85ec0b35b0 0x7f85ec0aa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40332/0 (socket says 172.21.15.29:40332) 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f146b640 1 -- 172.21.15.29:0/2317179168 learned_addr learned my addr 172.21.15.29:0/2317179168 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f246d640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85ec13f8e0 0x7f85ec0a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f1c6c640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85ec0b31d0 0x7f85ec142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f146b640 1 -- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85ec0b31d0 msgr2=0x7f85ec142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f146b640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85ec0b31d0 0x7f85ec142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f146b640 1 -- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85ec13f8e0 msgr2=0x7f85ec0a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f146b640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85ec13f8e0 0x7f85ec0a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f146b640 1 -- 172.21.15.29:0/2317179168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e4009b30 con 0x7f85ec0b35b0 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f1c6c640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85ec0b31d0 0x7f85ec142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.768+0000 7f85f146b640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85ec0b35b0 0x7f85ec0aa820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00d800 tx=0x7f85dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.769+0000 7f85e27fc640 1 -- 172.21.15.29:0/2317179168 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc004030 con 0x7f85ec0b35b0 2024-09-13T18:52:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.769+0000 7f85e27fc640 1 -- 172.21.15.29:0/2317179168 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f85dc004190 con 0x7f85ec0b35b0 2024-09-13T18:52:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.769+0000 7f85f3ed0640 1 -- 172.21.15.29:0/2317179168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec0aa020 con 0x7f85ec0b35b0 2024-09-13T18:52:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.769+0000 7f85e27fc640 1 -- 172.21.15.29:0/2317179168 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc00b6c0 con 0x7f85ec0b35b0 2024-09-13T18:52:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.769+0000 7f85f3ed0640 1 -- 172.21.15.29:0/2317179168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec0a99d0 con 0x7f85ec0b35b0 2024-09-13T18:52:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.770+0000 7f85f3ed0640 1 -- 172.21.15.29:0/2317179168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec067300 con 0x7f85ec0b35b0 2024-09-13T18:52:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.770+0000 7f85e27fc640 1 -- 172.21.15.29:0/2317179168 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85dc00b820 con 0x7f85ec0b35b0 2024-09-13T18:52:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.770+0000 7f85e27fc640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f85d006ac00 0x7f85d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.771+0000 7f85e27fc640 1 -- 172.21.15.29:0/2317179168 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f85dc089920 con 0x7f85ec0b35b0 2024-09-13T18:52:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.771+0000 7f85f1c6c640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f85d006ac00 0x7f85d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.771+0000 7f85f1c6c640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f85d006ac00 0x7f85d006d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006b10 tx=0x7f85e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:07.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.775+0000 7f85e27fc640 1 -- 172.21.15.29:0/2317179168 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f85dc054730 con 0x7f85ec0b35b0 2024-09-13T18:52:07.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.945+0000 7f85f3ed0640 1 -- 172.21.15.29:0/2317179168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85ec1498a0 con 0x7f85ec0b35b0 2024-09-13T18:52:07.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.946+0000 7f85e27fc640 1 -- 172.21.15.29:0/2317179168 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18627 (secure 0 0 0) 0x7f85dc057d50 con 0x7f85ec0b35b0 2024-09-13T18:52:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-13T18:52:07.949 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"41f49ea7-93ea-4289-a814-d28f860525af","created":"2024-09-13T18:45:05.539772+0000","modified":"2024-09-13T18:46:11.136377+0000","last_up_change":"2024-09-13T18:45:15.604097+0000","last_in_change":"2024-09-13T18:45:07.566943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:45:17.630827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:20.113248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:20.978194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:24.059966+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3adb7e9-f0fd-4244-a0f1-468ccddc384d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6809","nonce":2605275306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6811","nonce":2605275306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6815","nonce":2605275306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":2605275306},{"type":"v1","addr":"172.21.15.29:6813","nonce":2605275306}]},"public_addr":"172.21.15.29:6809/2605275306","cluster_addr":"172.21.15.29:6811/2605275306","heartbeat_back_addr":"172.21.15.29:6815/2605275306","heartbeat_front_addr":"172.21.15.29:6813/2605275306","state":["exists","up"]},{"osd":1,"uuid":"5d5ac46e-c9d1-4d68-a145-1338dc5d9143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6825","nonce":2613470093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6827","nonce":2613470093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6831","nonce":2613470093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2613470093},{"type":"v1","addr":"172.21.15.29:6829","nonce":2613470093}]},"public_addr":"172.21.15.29:6825/2613470093","cluster_addr":"172.21.15.29:6827/2613470093","heartbeat_back_addr":"172.21.15.29:6831/2613470093","heartbeat_front_addr":"172.21.15.29:6829/2613470093","state":["exists","up"]},{"osd":2,"uuid":"ef27cd51-cf7b-4f49-9277-75d870bc33d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6801","nonce":3954589082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6803","nonce":3954589082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6807","nonce":3954589082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3954589082},{"type":"v1","addr":"172.21.15.29:6805","nonce":3954589082}]},"public_addr":"172.21.15.29:6801/3954589082","cluster_addr":"172.21.15.29:6803/3954589082","heartbeat_back_addr":"172.21.15.29:6807/3954589082","heartbeat_front_addr":"172.21.15.29:6805/3954589082","state":["exists","up"]},{"osd":3,"uuid":"72fefc5d-f071-4dbe-a47a-6070df5d9ebc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6817","nonce":286406825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6819","nonce":286406825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6823","nonce":286406825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":286406825},{"type":"v1","addr":"172.21.15.29:6821","nonce":286406825}]},"public_addr":"172.21.15.29:6817/286406825","cluster_addr":"172.21.15.29:6819/286406825","heartbeat_back_addr":"172.21.15.29:6823/286406825","heartbeat_front_addr":"172.21.15.29:6821/286406825","state":["exists","up"]},{"osd":4,"uuid":"89da78eb-01be-4cbe-ab06-6bd8c319b5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6809","nonce":1598807756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6811","nonce":1598807756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6815","nonce":1598807756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":1598807756},{"type":"v1","addr":"172.21.15.96:6813","nonce":1598807756}]},"public_addr":"172.21.15.96:6809/1598807756","cluster_addr":"172.21.15.96:6811/1598807756","heartbeat_back_addr":"172.21.15.96:6815/1598807756","heartbeat_front_addr":"172.21.15.96:6813/1598807756","state":["exists","up"]},{"osd":5,"uuid":"3335c111-d168-4325-acfb-a5ba644be4fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6825","nonce":1577126037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6827","nonce":1577126037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6831","nonce":1577126037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1577126037},{"type":"v1","addr":"172.21.15.96:6829","nonce":1577126037}]},"public_addr":"172.21.15.96:6825/1577126037","cluster_addr":"172.21.15.96:6827/1577126037","heartbeat_back_addr":"172.21.15.96:6831/1577126037","heartbeat_front_addr":"172.21.15.96:6829/1577126037","state":["exists","up"]},{"osd":6,"uuid":"1dff2d03-b474-4166-9296-56f38623b932","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6801","nonce":2433452864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6803","nonce":2433452864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6807","nonce":2433452864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2433452864},{"type":"v1","addr":"172.21.15.96:6805","nonce":2433452864}]},"public_addr":"172.21.15.96:6801/2433452864","cluster_addr":"172.21.15.96:6803/2433452864","heartbeat_back_addr":"172.21.15.96:6807/2433452864","heartbeat_front_addr":"172.21.15.96:6805/2433452864","state":["exists","up"]},{"osd":7,"uuid":"ca44193d-15b6-4bf0-be72-be3664f790b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6817","nonce":1178210252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6819","nonce":1178210252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6823","nonce":1178210252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1178210252},{"type":"v1","addr":"172.21.15.96:6821","nonce":1178210252}]},"public_addr":"172.21.15.96:6817/1178210252","cluster_addr":"172.21.15.96:6819/1178210252","heartbeat_back_addr":"172.21.15.96:6823/1178210252","heartbeat_front_addr":"172.21.15.96:6821/1178210252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.725566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.702637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.692117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.708242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.740464+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.786007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.703109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:45:12.778462+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.f","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:52:07.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.948+0000 7f85f3ed0640 1 -- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f85d006ac00 msgr2=0x7f85d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.948+0000 7f85f3ed0640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f85d006ac00 0x7f85d006d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006b10 tx=0x7f85e8008040 comp rx=0 tx=0).stop 2024-09-13T18:52:07.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.948+0000 7f85f3ed0640 1 -- 172.21.15.29:0/2317179168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85ec0b35b0 msgr2=0x7f85ec0aa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:07.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.948+0000 7f85f3ed0640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85ec0b35b0 0x7f85ec0aa820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00d800 tx=0x7f85dc00dcc0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.948+0000 7f85f3ed0640 1 -- 172.21.15.29:0/2317179168 shutdown_connections 2024-09-13T18:52:07.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.948+0000 7f85f3ed0640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f85d006ac00 0x7f85d006d0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.948+0000 7f85f3ed0640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85ec13f8e0 0x7f85ec0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.948+0000 7f85f3ed0640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85ec0b35b0 0x7f85ec0aa820 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.948+0000 7f85f3ed0640 1 --2- 172.21.15.29:0/2317179168 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85ec0b31d0 0x7f85ec142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:07.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.948+0000 7f85f3ed0640 1 -- 172.21.15.29:0/2317179168 >> 172.21.15.29:0/2317179168 conn(0x7f85ec0bb590 msgr2=0x7f85ec0b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:07.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.948+0000 7f85f3ed0640 1 -- 172.21.15.29:0/2317179168 shutdown_connections 2024-09-13T18:52:07.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:07.948+0000 7f85f3ed0640 1 -- 172.21.15.29:0/2317179168 wait complete. 2024-09-13T18:52:07.962 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:52:08.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.063+0000 7fde0c5f4640 1 Processor -- start 2024-09-13T18:52:08.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.063+0000 7fde0c5f4640 1 -- start start 2024-09-13T18:52:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.063+0000 7fde0c5f4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fde040b3ef0 0x7fde04071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde0c5f4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde041430b0 0x7fde04071f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde0c5f4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde040b8c60 con 0x7fde0406fe70 2024-09-13T18:52:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde0c5f4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde040724b0 con 0x7fde040b3ef0 2024-09-13T18:52:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde0c5f4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040b42d0 con 0x7fde041430b0 2024-09-13T18:52:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde09b8f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fde0406fe70 0x7fde041429a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56640/0 (socket says 172.21.15.29:56640) 2024-09-13T18:52:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde09b8f640 1 -- 172.21.15.29:0/2643488789 learned_addr learned my addr 172.21.15.29:0/2643488789 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:52:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde0a390640 1 --2- 172.21.15.29:0/2643488789 >> v2:172.21.15.96:3300/0 conn(0x7fde040b3ef0 0x7fde04071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde0ab91640 1 --2- 172.21.15.29:0/2643488789 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde041430b0 0x7fde04071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde0938e640 1 -- 172.21.15.29:0/2643488789 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696024088 0 0) 0x7fde040b8c60 con 0x7fde0406fe70 2024-09-13T18:52:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde0938e640 1 -- 172.21.15.29:0/2643488789 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf0003520 con 0x7fde0406fe70 2024-09-13T18:52:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde0a390640 1 -- 172.21.15.29:0/2643488789 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde041430b0 msgr2=0x7fde04071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde0a390640 1 --2- 172.21.15.29:0/2643488789 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde041430b0 0x7fde04071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde0a390640 1 -- 172.21.15.29:0/2643488789 >> v1:172.21.15.29:6789/0 conn(0x7fde0406fe70 legacy=0x7fde041429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.064+0000 7fde0a390640 1 -- 172.21.15.29:0/2643488789 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde040712c0 con 0x7fde040b3ef0 2024-09-13T18:52:08.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.065+0000 7fde0a390640 1 --2- 172.21.15.29:0/2643488789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde040b3ef0 0x7fde04071a30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde000097a0 tx=0x7fde0002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22aff8ad131f0fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:08.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.065+0000 7fde0938e640 1 -- 172.21.15.29:0/2643488789 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00032440 con 0x7fde040b3ef0 2024-09-13T18:52:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.065+0000 7fde0938e640 1 -- 172.21.15.29:0/2643488789 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde000325a0 con 0x7fde040b3ef0 2024-09-13T18:52:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.065+0000 7fde0938e640 1 -- 172.21.15.29:0/2643488789 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00032910 con 0x7fde040b3ef0 2024-09-13T18:52:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.066+0000 7fde0c5f4640 1 -- 172.21.15.29:0/2643488789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde040b3ef0 msgr2=0x7fde04071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.066+0000 7fde0c5f4640 1 --2- 172.21.15.29:0/2643488789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde040b3ef0 0x7fde04071a30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde000097a0 tx=0x7fde0002a180 comp rx=0 tx=0).stop 2024-09-13T18:52:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.066+0000 7fde0c5f4640 1 -- 172.21.15.29:0/2643488789 shutdown_connections 2024-09-13T18:52:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.066+0000 7fde0c5f4640 1 --2- 172.21.15.29:0/2643488789 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde041430b0 0x7fde04071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.066+0000 7fde0c5f4640 1 --2- 172.21.15.29:0/2643488789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde040b3ef0 0x7fde04071a30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.066+0000 7fde0c5f4640 1 -- 172.21.15.29:0/2643488789 >> 172.21.15.29:0/2643488789 conn(0x7fde0406b610 msgr2=0x7fde040b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.066+0000 7fde0c5f4640 1 -- 172.21.15.29:0/2643488789 shutdown_connections 2024-09-13T18:52:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.066+0000 7fde0c5f4640 1 -- 172.21.15.29:0/2643488789 wait complete. 2024-09-13T18:52:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.067+0000 7fde0c5f4640 1 Processor -- start 2024-09-13T18:52:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.067+0000 7fde0c5f4640 1 -- start start 2024-09-13T18:52:08.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0c5f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde0406fe70 0x7fde040afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0c5f4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde040b3ef0 0x7fde040b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0c5f4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde041430b0 0x7fde040ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0c5f4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040ac510 con 0x7fde0406fe70 2024-09-13T18:52:08.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0c5f4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040b2460 con 0x7fde041430b0 2024-09-13T18:52:08.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0c5f4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde041d0d90 con 0x7fde040b3ef0 2024-09-13T18:52:08.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0a390640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde0406fe70 0x7fde040afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0a390640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde0406fe70 0x7fde040afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40342/0 (socket says 172.21.15.29:40342) 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0a390640 1 -- 172.21.15.29:0/3907657165 learned_addr learned my addr 172.21.15.29:0/3907657165 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0ab91640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde041430b0 0x7fde040ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde09b8f640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde040b3ef0 0x7fde040b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0a390640 1 -- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde040b3ef0 msgr2=0x7fde040b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0a390640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde040b3ef0 0x7fde040b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0a390640 1 -- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde041430b0 msgr2=0x7fde040ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0a390640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde041430b0 0x7fde040ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0a390640 1 -- 172.21.15.29:0/3907657165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde00009400 con 0x7fde0406fe70 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0ab91640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde041430b0 0x7fde040ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0a390640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde0406fe70 0x7fde040afda0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fde000097a0 tx=0x7fde000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fddf6ffd640 1 -- 172.21.15.29:0/3907657165 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00006e10 con 0x7fde0406fe70 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fddf6ffd640 1 -- 172.21.15.29:0/3907657165 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde000044e0 con 0x7fde0406fe70 2024-09-13T18:52:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fde0c5f4640 1 -- 172.21.15.29:0/3907657165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde040b26e0 con 0x7fde0406fe70 2024-09-13T18:52:08.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.068+0000 7fddf6ffd640 1 -- 172.21.15.29:0/3907657165 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00003870 con 0x7fde0406fe70 2024-09-13T18:52:08.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.069+0000 7fde0c5f4640 1 -- 172.21.15.29:0/3907657165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde040adf50 con 0x7fde0406fe70 2024-09-13T18:52:08.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.069+0000 7fde0c5f4640 1 -- 172.21.15.29:0/3907657165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde041d0bf0 con 0x7fde0406fe70 2024-09-13T18:52:08.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.070+0000 7fddf6ffd640 1 -- 172.21.15.29:0/3907657165 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fde000039d0 con 0x7fde0406fe70 2024-09-13T18:52:08.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.070+0000 7fddf6ffd640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdde806ac30 0x7fdde806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.071+0000 7fddf6ffd640 1 -- 172.21.15.29:0/3907657165 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fde000aa410 con 0x7fde0406fe70 2024-09-13T18:52:08.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.071+0000 7fde09b8f640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdde806ac30 0x7fdde806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.071+0000 7fde09b8f640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdde806ac30 0x7fdde806d0f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fde040afac0 tx=0x7fddf8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:08.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.075+0000 7fddf6ffd640 1 -- 172.21.15.29:0/3907657165 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fde041d0bf0 con 0x7fde0406fe70 2024-09-13T18:52:08.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.279+0000 7fde0c5f4640 1 -- 172.21.15.29:0/3907657165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fde041d0bf0 con 0x7fde0406fe70 2024-09-13T18:52:08.282 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:52:08.285 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:52:08.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.313+0000 7fddf6ffd640 1 -- 172.21.15.29:0/3907657165 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fde041d0bf0 con 0x7fde0406fe70 2024-09-13T18:52:08.316 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:52:08.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.315+0000 7fde0c5f4640 1 -- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdde806ac30 msgr2=0x7fdde806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:08.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.316+0000 7fde0c5f4640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdde806ac30 0x7fdde806d0f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fde040afac0 tx=0x7fddf8009040 comp rx=0 tx=0).stop 2024-09-13T18:52:08.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.316+0000 7fde0c5f4640 1 -- 172.21.15.29:0/3907657165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde0406fe70 msgr2=0x7fde040afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.316+0000 7fde0c5f4640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde0406fe70 0x7fde040afda0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fde000097a0 tx=0x7fde000046c0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.316+0000 7fde0c5f4640 1 -- 172.21.15.29:0/3907657165 shutdown_connections 2024-09-13T18:52:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.316+0000 7fde0c5f4640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fdde806ac30 0x7fdde806d0f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.316+0000 7fde0c5f4640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde041430b0 0x7fde040ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.316+0000 7fde0c5f4640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde040b3ef0 0x7fde040b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.316+0000 7fde0c5f4640 1 --2- 172.21.15.29:0/3907657165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde0406fe70 0x7fde040afda0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.316+0000 7fde0c5f4640 1 -- 172.21.15.29:0/3907657165 >> 172.21.15.29:0/3907657165 conn(0x7fde0406b610 msgr2=0x7fde040b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.316+0000 7fde0c5f4640 1 -- 172.21.15.29:0/3907657165 shutdown_connections 2024-09-13T18:52:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.316+0000 7fde0c5f4640 1 -- 172.21.15.29:0/3907657165 wait complete. 2024-09-13T18:52:08.330 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:52:08.413 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-09-13T18:52:08.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.471+0000 7fe92e73e640 1 Processor -- start 2024-09-13T18:52:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.471+0000 7fe92e73e640 1 -- start start 2024-09-13T18:52:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe92e73e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe9280b30b0 0x7fe92813d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe92e73e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280b9210 con 0x7fe92813dbf0 2024-09-13T18:52:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe92e73e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92813e060 con 0x7fe9280b8e30 2024-09-13T18:52:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe92e73e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9280b0be0 con 0x7fe9280b30b0 2024-09-13T18:52:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe92ccdb640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe92813dbf0 0x7fe92814e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56648/0 (socket says 172.21.15.29:56648) 2024-09-13T18:52:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe92ccdb640 1 -- 172.21.15.29:0/4006533745 learned_addr learned my addr 172.21.15.29:0/4006533745 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:52:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe91ffff640 1 --2- 172.21.15.29:0/4006533745 >> v2:172.21.15.96:3300/0 conn(0x7fe9280b30b0 0x7fe92813d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499344788 0 0) 0x7fe9280b9210 con 0x7fe92813dbf0 2024-09-13T18:52:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe914003520 con 0x7fe92813dbf0 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4280411034 0 0) 0x7fe914003520 con 0x7fe92813dbf0 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 >> v2:172.21.15.96:3300/0 conn(0x7fe9280b30b0 msgr2=0x7fe92813d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 --2- 172.21.15.29:0/4006533745 >> v2:172.21.15.96:3300/0 conn(0x7fe9280b30b0 0x7fe92813d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 >> v1:172.21.15.96:6789/0 conn(0x7fe9280b8e30 legacy=0x7fe9280b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280b3540 con 0x7fe92813dbf0 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7fe9200019f0 con 0x7fe92813dbf0 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 >> v1:172.21.15.29:6789/0 conn(0x7fe92813dbf0 legacy=0x7fe92814e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 --2- 172.21.15.29:0/4006533745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe914003970 0x7fe914003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 --2- 172.21.15.29:0/4006533745 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9140047c0 0x7fe914004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 --2- 172.21.15.29:0/4006533745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe914005180 0x7fe91400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91400c0f0 con 0x7fe914003970 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91400c260 con 0x7fe914005180 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.472+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91400c420 con 0x7fe9140047c0 2024-09-13T18:52:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.473+0000 7fe927fff640 1 --2- 172.21.15.29:0/4006533745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe914003970 0x7fe914003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.473+0000 7fe92ccdb640 1 --2- 172.21.15.29:0/4006533745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe914005180 0x7fe91400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.473+0000 7fe91ffff640 1 --2- 172.21.15.29:0/4006533745 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9140047c0 0x7fe914004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.473+0000 7fe927fff640 1 -- 172.21.15.29:0/4006533745 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9140047c0 msgr2=0x7fe914004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.473+0000 7fe927fff640 1 --2- 172.21.15.29:0/4006533745 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9140047c0 0x7fe914004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.473+0000 7fe927fff640 1 -- 172.21.15.29:0/4006533745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe914005180 msgr2=0x7fe91400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.473+0000 7fe927fff640 1 --2- 172.21.15.29:0/4006533745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe914005180 0x7fe91400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.473+0000 7fe927fff640 1 -- 172.21.15.29:0/4006533745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe914003520 con 0x7fe914003970 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.473+0000 7fe92ccdb640 1 -- 172.21.15.29:0/4006533745 reap_dead start 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.474+0000 7fe927fff640 1 --2- 172.21.15.29:0/4006533745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe914003970 0x7fe914003d90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe918001750 tx=0x7fe9140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6d4db9045ec603 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.474+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9180052d0 con 0x7fe914003970 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.474+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe918005430 con 0x7fe914003970 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.474+0000 7fe9277fe640 1 -- 172.21.15.29:0/4006533745 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91802abe0 con 0x7fe914003970 2024-09-13T18:52:08.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.474+0000 7fe92e73e640 1 -- 172.21.15.29:0/4006533745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe914003970 msgr2=0x7fe914003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.474+0000 7fe92e73e640 1 --2- 172.21.15.29:0/4006533745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe914003970 0x7fe914003d90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe918001750 tx=0x7fe9140057f0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.474+0000 7fe92e73e640 1 -- 172.21.15.29:0/4006533745 shutdown_connections 2024-09-13T18:52:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.474+0000 7fe92e73e640 1 --2- 172.21.15.29:0/4006533745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe914003970 0x7fe914003d90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.474+0000 7fe92e73e640 1 -- 172.21.15.29:0/4006533745 >> 172.21.15.29:0/4006533745 conn(0x7fe92806b610 msgr2=0x7fe9280b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.474+0000 7fe92e73e640 1 -- 172.21.15.29:0/4006533745 shutdown_connections 2024-09-13T18:52:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.474+0000 7fe92e73e640 1 -- 172.21.15.29:0/4006533745 wait complete. 2024-09-13T18:52:08.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.475+0000 7fe92e73e640 1 Processor -- start 2024-09-13T18:52:08.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.475+0000 7fe92e73e640 1 -- start start 2024-09-13T18:52:08.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe92e73e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe914003970 0x7fe928138cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe92e73e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9281db1c0 0x7fe9281ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe92e73e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9281cfca0 0x7fe928136750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe92e73e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9281ce9a0 con 0x7fe9281db1c0 2024-09-13T18:52:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe92e73e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9281ce350 con 0x7fe9281cfca0 2024-09-13T18:52:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe92e73e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe928134240 con 0x7fe914003970 2024-09-13T18:52:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe91ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9281db1c0 0x7fe9281ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe91ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9281db1c0 0x7fe9281ceda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40376/0 (socket says 172.21.15.29:40376) 2024-09-13T18:52:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe91ffff640 1 -- 172.21.15.29:0/2692035701 learned_addr learned my addr 172.21.15.29:0/2692035701 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe927fff640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe914003970 0x7fe928138cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe92ccdb640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9281cfca0 0x7fe928136750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe91ffff640 1 -- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe914003970 msgr2=0x7fe928138cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe91ffff640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe914003970 0x7fe928138cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe91ffff640 1 -- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9281cfca0 msgr2=0x7fe928136750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.476+0000 7fe91ffff640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9281cfca0 0x7fe928136750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.477+0000 7fe91ffff640 1 -- 172.21.15.29:0/2692035701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9281d01d0 con 0x7fe9281db1c0 2024-09-13T18:52:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.477+0000 7fe91ffff640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9281db1c0 0x7fe9281ceda0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe910011960 tx=0x7fe910011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.477+0000 7fe9257fa640 1 -- 172.21.15.29:0/2692035701 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91000f9b0 con 0x7fe9281db1c0 2024-09-13T18:52:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.477+0000 7fe9257fa640 1 -- 172.21.15.29:0/2692035701 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe91000fb10 con 0x7fe9281db1c0 2024-09-13T18:52:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.477+0000 7fe92e73e640 1 -- 172.21.15.29:0/2692035701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9281cf2e0 con 0x7fe9281db1c0 2024-09-13T18:52:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.477+0000 7fe9257fa640 1 -- 172.21.15.29:0/2692035701 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91000fee0 con 0x7fe9281db1c0 2024-09-13T18:52:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.477+0000 7fe92e73e640 1 -- 172.21.15.29:0/2692035701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9281cdd90 con 0x7fe9281db1c0 2024-09-13T18:52:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.478+0000 7fe92e73e640 1 -- 172.21.15.29:0/2692035701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9280b4090 con 0x7fe9281db1c0 2024-09-13T18:52:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.478+0000 7fe9257fa640 1 -- 172.21.15.29:0/2692035701 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe910014440 con 0x7fe9281db1c0 2024-09-13T18:52:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.479+0000 7fe9257fa640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe90806ac00 0x7fe90806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:08.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.479+0000 7fe9257fa640 1 -- 172.21.15.29:0/2692035701 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fe910089cc0 con 0x7fe9281db1c0 2024-09-13T18:52:08.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.479+0000 7fe927fff640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe90806ac00 0x7fe90806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:08.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.480+0000 7fe927fff640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe90806ac00 0x7fe90806d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe918032000 tx=0x7fe91802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:08.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.483+0000 7fe9257fa640 1 -- 172.21.15.29:0/2692035701 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe910054b20 con 0x7fe9281db1c0 2024-09-13T18:52:08.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:08.689+0000 7fe92e73e640 1 -- 172.21.15.29:0/2692035701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe9280b8830 con 0x7fe9281db1c0 2024-09-13T18:52:09.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.315+0000 7fe9257fa640 1 -- 172.21.15.29:0/2692035701 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe910058140 con 0x7fe9281db1c0 2024-09-13T18:52:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.318+0000 7fe92e73e640 1 -- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe90806ac00 msgr2=0x7fe90806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.318+0000 7fe92e73e640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe90806ac00 0x7fe90806d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe918032000 tx=0x7fe91802e000 comp rx=0 tx=0).stop 2024-09-13T18:52:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.318+0000 7fe92e73e640 1 -- 172.21.15.29:0/2692035701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9281db1c0 msgr2=0x7fe9281ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.318+0000 7fe92e73e640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9281db1c0 0x7fe9281ceda0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe910011960 tx=0x7fe910011d60 comp rx=0 tx=0).stop 2024-09-13T18:52:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.318+0000 7fe92e73e640 1 -- 172.21.15.29:0/2692035701 shutdown_connections 2024-09-13T18:52:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.318+0000 7fe92e73e640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fe90806ac00 0x7fe90806d0c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.318+0000 7fe92e73e640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9281cfca0 0x7fe928136750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.318+0000 7fe92e73e640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9281db1c0 0x7fe9281ceda0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.318+0000 7fe92e73e640 1 --2- 172.21.15.29:0/2692035701 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe914003970 0x7fe928138cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.318+0000 7fe92e73e640 1 -- 172.21.15.29:0/2692035701 >> 172.21.15.29:0/2692035701 conn(0x7fe92806b610 msgr2=0x7fe9280b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:09.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.318+0000 7fe92e73e640 1 -- 172.21.15.29:0/2692035701 shutdown_connections 2024-09-13T18:52:09.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.318+0000 7fe92e73e640 1 -- 172.21.15.29:0/2692035701 wait complete. 2024-09-13T18:52:09.333 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:52:09.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.479+0000 7fd003d95640 1 Processor -- start 2024-09-13T18:52:09.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.479+0000 7fd003d95640 1 -- start start 2024-09-13T18:52:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.479+0000 7fd003d95640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcffc0b7b10 0x7fcffc0b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.479+0000 7fd003d95640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcffc06b5b0 0x7fcffc144010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.479+0000 7fd003d95640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcffc0b3ce0 con 0x7fcffc144550 2024-09-13T18:52:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.479+0000 7fd003d95640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc06c4e0 con 0x7fcffc06b5b0 2024-09-13T18:52:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.479+0000 7fd003d95640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc0b6930 con 0x7fcffc0b7b10 2024-09-13T18:52:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.480+0000 7fd001330640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcffc06b5b0 0x7fcffc144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.480+0000 7fd001330640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcffc06b5b0 0x7fcffc144010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40378/0 (socket says 172.21.15.29:40378) 2024-09-13T18:52:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.480+0000 7fd001330640 1 -- 172.21.15.29:0/4011776638 learned_addr learned my addr 172.21.15.29:0/4011776638 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.480+0000 7fd001b31640 1 --2- 172.21.15.29:0/4011776638 >> v2:172.21.15.96:3300/0 conn(0x7fcffc0b7b10 0x7fcffc0b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.480+0000 7fd001330640 1 -- 172.21.15.29:0/4011776638 >> v2:172.21.15.96:3300/0 conn(0x7fcffc0b7b10 msgr2=0x7fcffc0b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:09.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.480+0000 7fd001330640 1 --2- 172.21.15.29:0/4011776638 >> v2:172.21.15.96:3300/0 conn(0x7fcffc0b7b10 0x7fcffc0b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:09.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.480+0000 7fd001330640 1 -- 172.21.15.29:0/4011776638 >> v1:172.21.15.96:6789/0 conn(0x7fcffc144550 legacy=0x7fcffc0b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:09.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.480+0000 7fd001330640 1 -- 172.21.15.29:0/4011776638 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc0b66c0 con 0x7fcffc06b5b0 2024-09-13T18:52:09.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.481+0000 7fd001330640 1 --2- 172.21.15.29:0/4011776638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc06b5b0 0x7fcffc144010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcffc06d0a0 tx=0x7fcfec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ebd9079e3c492c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.481+0000 7fd000b2f640 1 -- 172.21.15.29:0/4011776638 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec02ae20 con 0x7fcffc06b5b0 2024-09-13T18:52:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.481+0000 7fd000b2f640 1 -- 172.21.15.29:0/4011776638 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcfec032440 con 0x7fcffc06b5b0 2024-09-13T18:52:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.481+0000 7fd000b2f640 1 -- 172.21.15.29:0/4011776638 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec0327f0 con 0x7fcffc06b5b0 2024-09-13T18:52:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.481+0000 7fd003d95640 1 -- 172.21.15.29:0/4011776638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc06b5b0 msgr2=0x7fcffc144010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.481+0000 7fd003d95640 1 --2- 172.21.15.29:0/4011776638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc06b5b0 0x7fcffc144010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcffc06d0a0 tx=0x7fcfec02a110 comp rx=0 tx=0).stop 2024-09-13T18:52:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.481+0000 7fd003d95640 1 -- 172.21.15.29:0/4011776638 shutdown_connections 2024-09-13T18:52:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.481+0000 7fd003d95640 1 --2- 172.21.15.29:0/4011776638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc06b5b0 0x7fcffc144010 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.481+0000 7fd003d95640 1 --2- 172.21.15.29:0/4011776638 >> v2:172.21.15.96:3300/0 conn(0x7fcffc0b7b10 0x7fcffc0b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.481+0000 7fd003d95640 1 -- 172.21.15.29:0/4011776638 >> 172.21.15.29:0/4011776638 conn(0x7fcffc06a2f0 msgr2=0x7fcffc06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.482+0000 7fd003d95640 1 -- 172.21.15.29:0/4011776638 shutdown_connections 2024-09-13T18:52:09.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.482+0000 7fd003d95640 1 -- 172.21.15.29:0/4011776638 wait complete. 2024-09-13T18:52:09.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd003d95640 1 Processor -- start 2024-09-13T18:52:09.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd003d95640 1 -- start start 2024-09-13T18:52:09.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd003d95640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcffc06b5b0 0x7fcffc1c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:09.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd003d95640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc0b7b10 0x7fcffc13f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:09.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd003d95640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcffc144550 0x7fcffc1cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:09.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd003d95640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc1dc670 con 0x7fcffc0b7b10 2024-09-13T18:52:09.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd003d95640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc1dc8c0 con 0x7fcffc144550 2024-09-13T18:52:09.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd003d95640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc1dcba0 con 0x7fcffc06b5b0 2024-09-13T18:52:09.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd001330640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc0b7b10 0x7fcffc13f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:09.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd001330640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc0b7b10 0x7fcffc13f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40384/0 (socket says 172.21.15.29:40384) 2024-09-13T18:52:09.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd001330640 1 -- 172.21.15.29:0/1806591942 learned_addr learned my addr 172.21.15.29:0/1806591942 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:09.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd002332640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcffc144550 0x7fcffc1cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:09.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.483+0000 7fd001b31640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcffc06b5b0 0x7fcffc1c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fd001330640 1 -- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcffc06b5b0 msgr2=0x7fcffc1c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fd001330640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcffc06b5b0 0x7fcffc1c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fd001330640 1 -- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcffc144550 msgr2=0x7fcffc1cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fd001330640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcffc144550 0x7fcffc1cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fd001330640 1 -- 172.21.15.29:0/1806591942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec0094d0 con 0x7fcffc0b7b10 2024-09-13T18:52:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fd002332640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcffc144550 0x7fcffc1cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fd001b31640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcffc06b5b0 0x7fcffc1c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fd001330640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc0b7b10 0x7fcffc13f3e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcfec02a150 tx=0x7fcfec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fcff27fc640 1 -- 172.21.15.29:0/1806591942 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec030970 con 0x7fcffc0b7b10 2024-09-13T18:52:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fcff27fc640 1 -- 172.21.15.29:0/1806591942 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcfec030af0 con 0x7fcffc0b7b10 2024-09-13T18:52:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fd003d95640 1 -- 172.21.15.29:0/1806591942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc1dce80 con 0x7fcffc0b7b10 2024-09-13T18:52:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fcff27fc640 1 -- 172.21.15.29:0/1806591942 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec03d420 con 0x7fcffc0b7b10 2024-09-13T18:52:09.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.484+0000 7fd003d95640 1 -- 172.21.15.29:0/1806591942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc1cb930 con 0x7fcffc0b7b10 2024-09-13T18:52:09.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.485+0000 7fd003d95640 1 -- 172.21.15.29:0/1806591942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcffc0672b0 con 0x7fcffc0b7b10 2024-09-13T18:52:09.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.486+0000 7fcff27fc640 1 -- 172.21.15.29:0/1806591942 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcfec039040 con 0x7fcffc0b7b10 2024-09-13T18:52:09.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.486+0000 7fcff27fc640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fcfe006ac00 0x7fcfe006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:09.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.486+0000 7fcff27fc640 1 -- 172.21.15.29:0/1806591942 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fcfec0aa3f0 con 0x7fcffc0b7b10 2024-09-13T18:52:09.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.486+0000 7fd001b31640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fcfe006ac00 0x7fcfe006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:09.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.487+0000 7fd001b31640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fcfe006ac00 0x7fcfe006d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcff8006fd0 tx=0x7fcff8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:09.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.491+0000 7fcff27fc640 1 -- 172.21.15.29:0/1806591942 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcfec0751c0 con 0x7fcffc0b7b10 2024-09-13T18:52:09.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:09.665+0000 7fd003d95640 1 -- 172.21.15.29:0/1806591942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcffc1dd070 con 0x7fcffc0b7b10 2024-09-13T18:52:10.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.322+0000 7fcff27fc640 1 -- 172.21.15.29:0/1806591942 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcfec0787e0 con 0x7fcffc0b7b10 2024-09-13T18:52:10.325 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:52:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.325+0000 7fd003d95640 1 -- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fcfe006ac00 msgr2=0x7fcfe006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.325+0000 7fd003d95640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fcfe006ac00 0x7fcfe006d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcff8006fd0 tx=0x7fcff8008040 comp rx=0 tx=0).stop 2024-09-13T18:52:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.325+0000 7fd003d95640 1 -- 172.21.15.29:0/1806591942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc0b7b10 msgr2=0x7fcffc13f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.325+0000 7fd003d95640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc0b7b10 0x7fcffc13f3e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcfec02a150 tx=0x7fcfec0046c0 comp rx=0 tx=0).stop 2024-09-13T18:52:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.326+0000 7fd003d95640 1 -- 172.21.15.29:0/1806591942 shutdown_connections 2024-09-13T18:52:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.326+0000 7fd003d95640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7fcfe006ac00 0x7fcfe006d0c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.326+0000 7fd003d95640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcffc144550 0x7fcffc1cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.326+0000 7fd003d95640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc0b7b10 0x7fcffc13f3e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.326+0000 7fd003d95640 1 --2- 172.21.15.29:0/1806591942 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcffc06b5b0 0x7fcffc1c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.326+0000 7fd003d95640 1 -- 172.21.15.29:0/1806591942 >> 172.21.15.29:0/1806591942 conn(0x7fcffc06a2f0 msgr2=0x7fcffc099210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:10.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.326+0000 7fd003d95640 1 -- 172.21.15.29:0/1806591942 shutdown_connections 2024-09-13T18:52:10.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.326+0000 7fd003d95640 1 -- 172.21.15.29:0/1806591942 wait complete. 2024-09-13T18:52:10.343 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:52:10.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.452+0000 7f923c69c640 1 Processor -- start 2024-09-13T18:52:10.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.452+0000 7f923c69c640 1 -- start start 2024-09-13T18:52:10.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f923c69c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f92340b7b10 0x7f92340b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:10.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f923c69c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234144720 0x7f923414e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:10.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f923c69c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92340b3ce0 con 0x7f923406b5b0 2024-09-13T18:52:10.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f923c69c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923406c4e0 con 0x7f92340b7b10 2024-09-13T18:52:10.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f923c69c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92340b6930 con 0x7f9234144720 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239c37640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f923406b5b0 0x7f9234144010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56662/0 (socket says 172.21.15.29:56662) 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239c37640 1 -- 172.21.15.29:0/1573213607 learned_addr learned my addr 172.21.15.29:0/1573213607 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f923ac39640 1 --2- 172.21.15.29:0/1573213607 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234144720 0x7f923414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f923a438640 1 --2- 172.21.15.29:0/1573213607 >> v2:172.21.15.96:3300/0 conn(0x7f92340b7b10 0x7f92340b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755544234 0 0) 0x7f92340b3ce0 con 0x7f923406b5b0 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9220003520 con 0x7f923406b5b0 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3271878038 0 0) 0x7f9220003520 con 0x7f923406b5b0 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234144720 msgr2=0x7f923414e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239436640 1 --2- 172.21.15.29:0/1573213607 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234144720 0x7f923414e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 >> v2:172.21.15.96:3300/0 conn(0x7f92340b7b10 msgr2=0x7f92340b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239436640 1 --2- 172.21.15.29:0/1573213607 >> v2:172.21.15.96:3300/0 conn(0x7f92340b7b10 0x7f92340b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92340b66c0 con 0x7f923406b5b0 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f9224001670 con 0x7f923406b5b0 2024-09-13T18:52:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 >> v1:172.21.15.29:6789/0 conn(0x7f923406b5b0 legacy=0x7f9234144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239436640 1 --2- 172.21.15.29:0/1573213607 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234144720 0x7f9220003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.453+0000 7f9239436640 1 --2- 172.21.15.29:0/1573213607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9220003ef0 0x7f92200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.454+0000 7f9239436640 1 --2- 172.21.15.29:0/1573213607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9220004d00 0x7f9220005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.454+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923406c4e0 con 0x7f9220004d00 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.454+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92340b6930 con 0x7f9220003ef0 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.454+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922000ba60 con 0x7f9234144720 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.454+0000 7f923ac39640 1 --2- 172.21.15.29:0/1573213607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9220004d00 0x7f9220005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.454+0000 7f9239c37640 1 --2- 172.21.15.29:0/1573213607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9220003ef0 0x7f92200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.454+0000 7f923a438640 1 --2- 172.21.15.29:0/1573213607 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234144720 0x7f9220003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.454+0000 7f923ac39640 1 -- 172.21.15.29:0/1573213607 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234144720 msgr2=0x7f9220003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.454+0000 7f923ac39640 1 --2- 172.21.15.29:0/1573213607 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234144720 0x7f9220003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.454+0000 7f923ac39640 1 -- 172.21.15.29:0/1573213607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9220003ef0 msgr2=0x7f92200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.454+0000 7f923ac39640 1 --2- 172.21.15.29:0/1573213607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9220003ef0 0x7f92200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.454+0000 7f923ac39640 1 -- 172.21.15.29:0/1573213607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220003520 con 0x7f9220004d00 2024-09-13T18:52:10.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.455+0000 7f923ac39640 1 --2- 172.21.15.29:0/1573213607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9220004d00 0x7f9220005180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f922c009fc0 tx=0x7f92200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0667693cc4f7973 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:10.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.455+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c031640 con 0x7f9220004d00 2024-09-13T18:52:10.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.455+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f922c02d070 con 0x7f9220004d00 2024-09-13T18:52:10.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.455+0000 7f9239436640 1 -- 172.21.15.29:0/1573213607 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c031a00 con 0x7f9220004d00 2024-09-13T18:52:10.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.455+0000 7f923c69c640 1 -- 172.21.15.29:0/1573213607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9220004d00 msgr2=0x7f9220005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:10.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.455+0000 7f923c69c640 1 --2- 172.21.15.29:0/1573213607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9220004d00 0x7f9220005180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f922c009fc0 tx=0x7f92200057f0 comp rx=0 tx=0).stop 2024-09-13T18:52:10.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.455+0000 7f923ac39640 1 -- 172.21.15.29:0/1573213607 reap_dead start 2024-09-13T18:52:10.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.456+0000 7f923c69c640 1 -- 172.21.15.29:0/1573213607 shutdown_connections 2024-09-13T18:52:10.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.456+0000 7f923c69c640 1 -- 172.21.15.29:0/1573213607 >> 172.21.15.29:0/1573213607 conn(0x7f923406a2f0 msgr2=0x7f923406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:10.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.456+0000 7f923c69c640 1 -- 172.21.15.29:0/1573213607 shutdown_connections 2024-09-13T18:52:10.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.456+0000 7f923c69c640 1 -- 172.21.15.29:0/1573213607 wait complete. 2024-09-13T18:52:10.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.457+0000 7f923c69c640 1 Processor -- start 2024-09-13T18:52:10.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.457+0000 7f923c69c640 1 -- start start 2024-09-13T18:52:10.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.457+0000 7f923c69c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9220004d00 0x7f923413b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:10.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.457+0000 7f923c69c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9234142af0 0x7f9234141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.457+0000 7f923c69c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234141a50 0x7f92341400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.457+0000 7f923c69c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923413bb30 con 0x7f9220004d00 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.457+0000 7f923c69c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9234141eb0 con 0x7f9234142af0 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.457+0000 7f923c69c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923413c0b0 con 0x7f9234141a50 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.457+0000 7f923a438640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9220004d00 0x7f923413b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.457+0000 7f923a438640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9220004d00 0x7f923413b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40394/0 (socket says 172.21.15.29:40394) 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.457+0000 7f923a438640 1 -- 172.21.15.29:0/187232307 learned_addr learned my addr 172.21.15.29:0/187232307 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f923ac39640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234141a50 0x7f92341400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f9239c37640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9234142af0 0x7f9234141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f923a438640 1 -- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234141a50 msgr2=0x7f92341400b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f923a438640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234141a50 0x7f92341400b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f923a438640 1 -- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9234142af0 msgr2=0x7f9234141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:10.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f923a438640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9234142af0 0x7f9234141510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:10.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f923a438640 1 -- 172.21.15.29:0/187232307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234136e00 con 0x7f9220004d00 2024-09-13T18:52:10.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f923a438640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9220004d00 0x7f923413b4a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9230011a70 tx=0x7f9230011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:10.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f922affd640 1 -- 172.21.15.29:0/187232307 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230009680 con 0x7f9220004d00 2024-09-13T18:52:10.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f922affd640 1 -- 172.21.15.29:0/187232307 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f923000fb50 con 0x7f9220004d00 2024-09-13T18:52:10.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f923c69c640 1 -- 172.21.15.29:0/187232307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92341370e0 con 0x7f9220004d00 2024-09-13T18:52:10.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f922affd640 1 -- 172.21.15.29:0/187232307 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230014440 con 0x7f9220004d00 2024-09-13T18:52:10.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.458+0000 7f923c69c640 1 -- 172.21.15.29:0/187232307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923413bdd0 con 0x7f9220004d00 2024-09-13T18:52:10.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.459+0000 7f923c69c640 1 -- 172.21.15.29:0/187232307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92340672b0 con 0x7f9220004d00 2024-09-13T18:52:10.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.460+0000 7f922affd640 1 -- 172.21.15.29:0/187232307 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f92300145a0 con 0x7f9220004d00 2024-09-13T18:52:10.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.460+0000 7f922affd640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f921806ac00 0x7f921806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:10.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.460+0000 7f922affd640 1 -- 172.21.15.29:0/187232307 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f9230089d90 con 0x7f9220004d00 2024-09-13T18:52:10.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.460+0000 7f9239c37640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f921806ac00 0x7f921806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:10.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.461+0000 7f9239c37640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f921806ac00 0x7f921806d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f92240010e0 tx=0x7f92240078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:10.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.465+0000 7f922affd640 1 -- 172.21.15.29:0/187232307 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9230054e50 con 0x7f9220004d00 2024-09-13T18:52:10.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:10.637+0000 7f923c69c640 1 -- 172.21.15.29:0/187232307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f92340b13c0 con 0x7f9220004d00 2024-09-13T18:52:11.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.331+0000 7f922affd640 1 -- 172.21.15.29:0/187232307 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9230058470 con 0x7f9220004d00 2024-09-13T18:52:11.334 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2024-09-13T18:52:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.334+0000 7f923c69c640 1 -- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f921806ac00 msgr2=0x7f921806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.334+0000 7f923c69c640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f921806ac00 0x7f921806d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f92240010e0 tx=0x7f92240078f0 comp rx=0 tx=0).stop 2024-09-13T18:52:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.334+0000 7f923c69c640 1 -- 172.21.15.29:0/187232307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9220004d00 msgr2=0x7f923413b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.334+0000 7f923c69c640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9220004d00 0x7f923413b4a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9230011a70 tx=0x7f9230011f30 comp rx=0 tx=0).stop 2024-09-13T18:52:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.335+0000 7f923c69c640 1 -- 172.21.15.29:0/187232307 shutdown_connections 2024-09-13T18:52:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.335+0000 7f923c69c640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f921806ac00 0x7f921806d0c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.335+0000 7f923c69c640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9234141a50 0x7f92341400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.335+0000 7f923c69c640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9234142af0 0x7f9234141510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.335+0000 7f923c69c640 1 --2- 172.21.15.29:0/187232307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9220004d00 0x7f923413b4a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.335+0000 7f923c69c640 1 -- 172.21.15.29:0/187232307 >> 172.21.15.29:0/187232307 conn(0x7f923406a2f0 msgr2=0x7f923413c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.335+0000 7f923c69c640 1 -- 172.21.15.29:0/187232307 shutdown_connections 2024-09-13T18:52:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.335+0000 7f923c69c640 1 -- 172.21.15.29:0/187232307 wait complete. 2024-09-13T18:52:11.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T18:52:11.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.467+0000 7f40f0508640 1 Processor -- start 2024-09-13T18:52:11.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.467+0000 7f40f0508640 1 -- start start 2024-09-13T18:52:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.467+0000 7f40f0508640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e80b4ae0 0x7f40e8070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40f0508640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e8140290 con 0x7f40e806a140 2024-09-13T18:52:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40f0508640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e8071300 con 0x7f40e813f6f0 2024-09-13T18:52:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40f0508640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e806a520 con 0x7f40e80b4ae0 2024-09-13T18:52:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ee2a4640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f40e806a140 0x7f40e80b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56678/0 (socket says 172.21.15.29:56678) 2024-09-13T18:52:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ee2a4640 1 -- 172.21.15.29:0/1659604492 learned_addr learned my addr 172.21.15.29:0/1659604492 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-13T18:52:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40edaa3640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e80b4ae0 0x7f40e8070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376687616 0 0) 0x7f40e4001110 con 0x7f40e806a140 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d4003520 con 0x7f40e806a140 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128998784 0 0) 0x7f40e8071300 con 0x7f40e813f6f0 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40e4001110 con 0x7f40e813f6f0 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1941725034 0 0) 0x7f40d4003520 con 0x7f40e806a140 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e80b4ae0 msgr2=0x7f40e8070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e80b4ae0 0x7f40e8070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 >> v1:172.21.15.96:6789/0 conn(0x7f40e813f6f0 legacy=0x7f40e813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8071e70 con 0x7f40e806a140 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2362769823 0 0) 0x7f40e4001800 con 0x7f40e806a140 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 >> v1:172.21.15.29:6789/0 conn(0x7f40e806a140 legacy=0x7f40e80b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e80b4ae0 0x7f40d4003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d4004090 0x7f40d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40d4004d00 0x7f40d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e806a520 con 0x7f40d4004d00 2024-09-13T18:52:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d400bb10 con 0x7f40d4004090 2024-09-13T18:52:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.468+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d400bca0 con 0x7f40e80b4ae0 2024-09-13T18:52:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.469+0000 7f40eeaa5640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40d4004d00 0x7f40d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.469+0000 7f40ee2a4640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e80b4ae0 0x7f40d4003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.469+0000 7f40edaa3640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d4004090 0x7f40d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.469+0000 7f40eeaa5640 1 -- 172.21.15.29:0/1659604492 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e80b4ae0 msgr2=0x7f40d4003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.469+0000 7f40eeaa5640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e80b4ae0 0x7f40d4003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.469+0000 7f40eeaa5640 1 -- 172.21.15.29:0/1659604492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d4004090 msgr2=0x7f40d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.469+0000 7f40eeaa5640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d4004090 0x7f40d40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.469+0000 7f40eeaa5640 1 -- 172.21.15.29:0/1659604492 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d4003520 con 0x7f40d4004d00 2024-09-13T18:52:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.469+0000 7f40ee2a4640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e80b4ae0 0x7f40d4003b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.470+0000 7f40eeaa5640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40d4004d00 0x7f40d4005180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f40e0001fd0 tx=0x7f40d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126fe3061584064c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.470+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0003b70 con 0x7f40d4004d00 2024-09-13T18:52:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.470+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f40e002d050 con 0x7f40d4004d00 2024-09-13T18:52:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.470+0000 7f40ed2a2640 1 -- 172.21.15.29:0/1659604492 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00050d0 con 0x7f40d4004d00 2024-09-13T18:52:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.470+0000 7f40f0508640 1 -- 172.21.15.29:0/1659604492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40d4004d00 msgr2=0x7f40d4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.470+0000 7f40f0508640 1 --2- 172.21.15.29:0/1659604492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40d4004d00 0x7f40d4005180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f40e0001fd0 tx=0x7f40d40057f0 comp rx=0 tx=0).stop 2024-09-13T18:52:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.470+0000 7f40eeaa5640 1 -- 172.21.15.29:0/1659604492 reap_dead start 2024-09-13T18:52:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.470+0000 7f40f0508640 1 -- 172.21.15.29:0/1659604492 shutdown_connections 2024-09-13T18:52:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.470+0000 7f40f0508640 1 -- 172.21.15.29:0/1659604492 >> 172.21.15.29:0/1659604492 conn(0x7f40e80b8440 msgr2=0x7f40e80b8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.470+0000 7f40f0508640 1 -- 172.21.15.29:0/1659604492 shutdown_connections 2024-09-13T18:52:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.470+0000 7f40f0508640 1 -- 172.21.15.29:0/1659604492 wait complete. 2024-09-13T18:52:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.471+0000 7f40f0508640 1 Processor -- start 2024-09-13T18:52:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40f0508640 1 -- start start 2024-09-13T18:52:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40f0508640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d4004d00 0x7f40e81de2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40f0508640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e8148020 0x7f40e81d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40f0508640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e8148480 0x7f40e81dad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40f0508640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e81defd0 con 0x7f40e8148020 2024-09-13T18:52:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40f0508640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8141b20 con 0x7f40d4004d00 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40f0508640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8140430 con 0x7f40e8148480 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40edaa3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e8148020 0x7f40e81d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40edaa3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e8148020 0x7f40e81d4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40406/0 (socket says 172.21.15.29:40406) 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40edaa3640 1 -- 172.21.15.29:0/2020621427 learned_addr learned my addr 172.21.15.29:0/2020621427 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40ee2a4640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d4004d00 0x7f40e81de2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40eeaa5640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e8148480 0x7f40e81dad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40edaa3640 1 -- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e8148480 msgr2=0x7f40e81dad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40edaa3640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e8148480 0x7f40e81dad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.472+0000 7f40edaa3640 1 -- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d4004d00 msgr2=0x7f40e81de2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.473+0000 7f40edaa3640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d4004d00 0x7f40e81de2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.473+0000 7f40edaa3640 1 -- 172.21.15.29:0/2020621427 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e81de910 con 0x7f40e8148020 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.473+0000 7f40edaa3640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e8148020 0x7f40e81d4db0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f40d8011960 tx=0x7f40d8011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.473+0000 7f40deffd640 1 -- 172.21.15.29:0/2020621427 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8004240 con 0x7f40e8148020 2024-09-13T18:52:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.473+0000 7f40deffd640 1 -- 172.21.15.29:0/2020621427 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f40d80043a0 con 0x7f40e8148020 2024-09-13T18:52:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.473+0000 7f40f0508640 1 -- 172.21.15.29:0/2020621427 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e81debf0 con 0x7f40e8148020 2024-09-13T18:52:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.473+0000 7f40deffd640 1 -- 172.21.15.29:0/2020621427 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d800fa80 con 0x7f40e8148020 2024-09-13T18:52:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.473+0000 7f40f0508640 1 -- 172.21.15.29:0/2020621427 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e81d52f0 con 0x7f40e8148020 2024-09-13T18:52:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.474+0000 7f40f0508640 1 -- 172.21.15.29:0/2020621427 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e8070140 con 0x7f40e8148020 2024-09-13T18:52:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.474+0000 7f40deffd640 1 -- 172.21.15.29:0/2020621427 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f40d800fbe0 con 0x7f40e8148020 2024-09-13T18:52:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.475+0000 7f40deffd640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f40cc06ac30 0x7f40cc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.475+0000 7f40deffd640 1 -- 172.21.15.29:0/2020621427 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f40d80898f0 con 0x7f40e8148020 2024-09-13T18:52:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.475+0000 7f40ee2a4640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f40cc06ac30 0x7f40cc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.475+0000 7f40ee2a4640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f40cc06ac30 0x7f40cc06d0f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40e4000ff0 tx=0x7f40e40079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:11.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.479+0000 7f40deffd640 1 -- 172.21.15.29:0/2020621427 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f40d8054b30 con 0x7f40e8148020 2024-09-13T18:52:11.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:11.650+0000 7f40f0508640 1 -- 172.21.15.29:0/2020621427 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f40e813f020 con 0x7f40e8148020 2024-09-13T18:52:12.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.336+0000 7f40deffd640 1 -- 172.21.15.29:0/2020621427 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f40d80230d0 con 0x7f40e8148020 2024-09-13T18:52:12.339 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' removed 2024-09-13T18:52:12.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.340+0000 7f40f0508640 1 -- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f40cc06ac30 msgr2=0x7f40cc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:12.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.340+0000 7f40f0508640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f40cc06ac30 0x7f40cc06d0f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40e4000ff0 tx=0x7f40e40079a0 comp rx=0 tx=0).stop 2024-09-13T18:52:12.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.340+0000 7f40f0508640 1 -- 172.21.15.29:0/2020621427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e8148020 msgr2=0x7f40e81d4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:12.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.340+0000 7f40f0508640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e8148020 0x7f40e81d4db0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f40d8011960 tx=0x7f40d8011d60 comp rx=0 tx=0).stop 2024-09-13T18:52:12.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.340+0000 7f40f0508640 1 -- 172.21.15.29:0/2020621427 shutdown_connections 2024-09-13T18:52:12.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.340+0000 7f40f0508640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:6832/4217971068,v1:172.21.15.96:6833/4217971068] conn(0x7f40cc06ac30 0x7f40cc06d0f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:12.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.340+0000 7f40f0508640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40e8148480 0x7f40e81dad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:12.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.340+0000 7f40f0508640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e8148020 0x7f40e81d4db0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:12.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.340+0000 7f40f0508640 1 --2- 172.21.15.29:0/2020621427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d4004d00 0x7f40e81de2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:12.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.340+0000 7f40f0508640 1 -- 172.21.15.29:0/2020621427 >> 172.21.15.29:0/2020621427 conn(0x7f40e80b8440 msgr2=0x7f40e80b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:12.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.340+0000 7f40f0508640 1 -- 172.21.15.29:0/2020621427 shutdown_connections 2024-09-13T18:52:12.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-13T18:52:12.340+0000 7f40f0508640 1 -- 172.21.15.29:0/2020621427 wait complete. 2024-09-13T18:52:12.356 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T18:52:12.356 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:52:12.356 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.366 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:52:12.366 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:52:12.367 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.377 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:52:12.377 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T18:52:12.377 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T18:52:12.377 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.442 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T18:52:12.443 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T18:52:12.443 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.522 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T18:52:12.522 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T18:52:12.522 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.592 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T18:52:12.592 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T18:52:12.593 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.658 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T18:52:12.659 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T18:52:12.659 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.695 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T18:52:12.695 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T18:52:12.695 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.765 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T18:52:12.766 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T18:52:12.766 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.835 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T18:52:12.835 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T18:52:12.835 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.901 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T18:52:12.901 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T18:52:12.902 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T18:52:12.902 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.931 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T18:52:12.931 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T18:52:12.931 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.970 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T18:52:12.970 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T18:52:12.970 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T18:52:12.971 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:12.985 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T18:52:12.985 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T18:52:12.985 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:13.022 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T18:52:13.023 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T18:52:13.023 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:13.074 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T18:52:13.075 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T18:52:13.075 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T18:52:13.135 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:52:13.135 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T18:52:13.452 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:52:13.453 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T18:52:13.564 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:52:13.564 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T18:52:13.622 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:52:13.623 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T18:52:13.671 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-13T18:52:13.671 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T18:52:13.921 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-13T18:52:13.921 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T18:52:14.033 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-13T18:52:14.033 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T18:52:14.090 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-13T18:52:14.090 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T18:52:14.148 INFO:tasks.ceph:Archiving mon data... 2024-09-13T18:52:14.150 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004/data/mon.a.tgz 2024-09-13T18:52:14.150 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-09-13T18:52:14.177 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.MI4mPpMy9h 2024-09-13T18:52:14.178 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.MI4mPpMy9h 2024-09-13T18:52:14.340 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.MI4mPpMy9h 2024-09-13T18:52:14.442 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.MI4mPpMy9h is 324KB 2024-09-13T18:52:14.538 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.MI4mPpMy9h 2024-09-13T18:52:14.554 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004/data/mon.b.tgz 2024-09-13T18:52:14.555 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-09-13T18:52:14.573 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.3xTT0l0ONa 2024-09-13T18:52:14.574 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.3xTT0l0ONa 2024-09-13T18:52:14.743 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.3xTT0l0ONa 2024-09-13T18:52:14.828 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.3xTT0l0ONa is 435KB 2024-09-13T18:52:14.929 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.3xTT0l0ONa 2024-09-13T18:52:14.944 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004/data/mon.c.tgz 2024-09-13T18:52:14.944 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-09-13T18:52:14.998 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.HHVYVjHZP2 2024-09-13T18:52:14.998 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.HHVYVjHZP2 2024-09-13T18:52:15.151 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.HHVYVjHZP2 2024-09-13T18:52:15.233 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.HHVYVjHZP2 is 435KB 2024-09-13T18:52:15.330 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.HHVYVjHZP2 2024-09-13T18:52:15.345 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T18:52:15.345 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:52:15.348 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:52:15.409 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T18:52:15.409 DEBUG:teuthology.orchestra.run.smithi029:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:52:15.425 DEBUG:teuthology.orchestra.run.smithi096:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:52:15.468 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:52:15.475 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:52:15.480 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T18:52:15.482 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004/remote/smithi029/crash 2024-09-13T18:52:15.482 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:52:15.511 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004/remote/smithi096/crash 2024-09-13T18:52:15.512 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:52:15.544 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T18:52:15.544 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:52:15.555 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:52:15.637 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:52:15.665 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:52:15.690 INFO:tasks.ceph:Compressing logs... 2024-09-13T18:52:15.690 DEBUG:teuthology.orchestra.run.smithi029:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:52:15.708 DEBUG:teuthology.orchestra.run.smithi096:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:52:21.599 INFO:tasks.ceph:Archiving logs... 2024-09-13T18:52:21.600 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004/remote/smithi029/log 2024-09-13T18:52:21.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:52:22.245 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004/remote/smithi096/log 2024-09-13T18:52:22.246 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:52:22.731 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T18:52:22.743 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T18:52:22.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:52:22.746 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:52:22.844 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T18:52:22.853 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T18:52:22.853 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:52:22.856 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:52:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:52:22.873 INFO:teuthology.orchestra.run.smithi096.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:52:22.875 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:52:22.875 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-09-13T18:52:22.875 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 -1240us[-1244us] +/- 37ms 2024-09-13T18:52:22.875 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 +3184us[+3184us] +/- 59ms 2024-09-13T18:52:22.876 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 -1405us[-1409us] +/- 71ms 2024-09-13T18:52:22.876 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:52:22.878 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:52:22.878 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2024-09-13T18:52:22.878 INFO:teuthology.orchestra.run.smithi096.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 -1236us[-1211us] +/- 37ms 2024-09-13T18:52:22.878 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 +3189us[+3189us] +/- 59ms 2024-09-13T18:52:22.878 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 -1416us[-1391us] +/- 71ms 2024-09-13T18:52:22.878 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:52:22.878 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T18:52:22.904 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T18:52:22.905 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T18:52:22.914 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:52:23.091 DEBUG:teuthology.orchestra.run.smithi096:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:52:23.159 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:52:23.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:52:23.192 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:52:23.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:52:23.222 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T18:52:23.232 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T18:52:23.240 INFO:teuthology.task.internal:Duration was 808.055040 seconds 2024-09-13T18:52:23.241 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T18:52:23.250 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T18:52:23.250 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:52:23.253 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:52:23.303 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:52:23.389 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:52:23.751 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T18:52:23.751 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-09-13T18:52:23.752 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:52:23.776 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-09-13T18:52:23.776 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:52:23.805 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T18:52:23.805 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:52:23.819 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:52:23.874 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T18:52:23.874 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:52:23.890 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:52:24.018 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T18:52:24.029 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T18:52:24.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:52:24.087 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:52:24.113 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T18:52:24.146 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:52:24.149 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:52:24.176 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-09-13T18:52:24.185 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-09-13T18:52:24.215 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:52:24.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:52:24.268 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:52:24.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:52:24.282 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T18:52:24.293 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T18:52:24.294 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004/remote/smithi029 2024-09-13T18:52:24.294 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:52:24.344 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904004/remote/smithi096 2024-09-13T18:52:24.344 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:52:24.377 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T18:52:24.377 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:52:24.380 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:52:24.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T18:52:24.439 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T18:52:24.439 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T18:52:24.448 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T18:52:24.448 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:52:24.454 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:52:24.467 INFO:teuthology.orchestra.run.smithi029.stdout: 265811 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:52 /home/ubuntu/cephtest 2024-09-13T18:52:24.482 INFO:teuthology.orchestra.run.smithi096.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:52 /home/ubuntu/cephtest 2024-09-13T18:52:24.483 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T18:52:24.493 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T18:52:24.516 INFO:teuthology.run:Summary data: description: fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} duration: 808.0550403594971 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T18:52:24.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:52:24.649 INFO:teuthology.run:pass